Oct 26 03:16:06 user nova-compute[74630]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74630) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 03:16:06 user nova-compute[74630]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74630) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 03:16:06 user nova-compute[74630]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74630) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 03:16:06 user nova-compute[74630]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:16:07 user nova-compute[74630]: INFO nova.virt.driver [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 26 03:16:07 user nova-compute[74630]: INFO nova.compute.provider_config [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] Acquiring lock "singleton_lock" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] Acquired lock "singleton_lock" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] Releasing lock "singleton_lock" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] Full set of CONF: {{(pid=74630) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ******************************************************************************** {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] Configuration options gathered from: {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ================================================================================ {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] allow_resize_to_same_host      = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] arq_binding_timeout            = 300 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] backdoor_port                  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] backdoor_socket                = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] block_device_allocate_retries  = 300 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] block_device_allocate_retries_interval = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cert                           = self.pem {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] compute_monitors               = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] config_dir                     = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] config_drive_format            = iso9660 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] config_source                  = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] console_host                   = user {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] control_exchange               = nova {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cpu_allocation_ratio           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] daemon                         = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] debug                          = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] default_access_ip_network_name = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] default_availability_zone      = nova {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] default_ephemeral_format       = ext4 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] default_green_pool_size        = 1000 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] default_schedule_zone          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] disk_allocation_ratio          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] enable_new_services            = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] enabled_apis                   = ['osapi_compute'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] enabled_ssl_apis               = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] flat_injected                  = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] force_config_drive             = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] force_raw_images               = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] graceful_shutdown_timeout      = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] heal_instance_info_cache_interval = 60 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] host                           = user {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] instance_build_timeout         = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] instance_delete_interval       = 300 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] instance_format                = [instance: %(uuid)s]  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] instance_name_template         = instance-%08x {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] instance_usage_audit           = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] instance_usage_audit_period    = month {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] internal_service_availability_zone = internal {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] key                            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] live_migration_retry_count     = 30 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] log_config_append              = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] log_dir                        = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] log_file                       = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] log_options                    = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] log_rotate_interval            = 1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] log_rotate_interval_type       = days {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] log_rotation_type              = none {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] long_rpc_timeout               = 1800 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] max_concurrent_builds          = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] max_concurrent_live_migrations = 1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] max_concurrent_snapshots       = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] max_local_block_devices        = 3 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] max_logfile_count              = 30 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] max_logfile_size_mb            = 200 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] maximum_instance_delete_attempts = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] metadata_listen                = 0.0.0.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] metadata_listen_port           = 8775 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] metadata_workers               = 3 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] migrate_max_retries            = -1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] mkisofs_cmd                    = genisoimage {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] my_ip                          = 10.0.0.210 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] network_allocate_retries       = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] osapi_compute_listen_port      = 8774 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] osapi_compute_unique_server_name_scope =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] osapi_compute_workers          = 3 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] password_length                = 12 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] periodic_enable                = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] periodic_fuzzy_delay           = 60 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] pointer_model                  = ps2mouse {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] preallocate_images             = none {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] publish_errors                 = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] pybasedir                      = /opt/stack/nova {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ram_allocation_ratio           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] rate_limit_burst               = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] rate_limit_except_level        = CRITICAL {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] rate_limit_interval            = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] reboot_timeout                 = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] reclaim_instance_interval      = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] record                         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] reimage_timeout_per_gb         = 60 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] report_interval                = 120 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] rescue_timeout                 = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] reserved_host_cpus             = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] reserved_host_disk_mb          = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] reserved_host_memory_mb        = 512 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] reserved_huge_pages            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] resize_confirm_window          = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] resize_fs_using_block_device   = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] resume_guests_state_on_host_boot = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] rpc_response_timeout           = 60 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] run_external_periodic_tasks    = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] running_deleted_instance_action = reap {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] running_deleted_instance_poll_interval = 1800 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] running_deleted_instance_timeout = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] scheduler_instance_sync_interval = 120 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] service_down_time              = 720 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] servicegroup_driver            = db {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] shelved_offload_time           = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] shelved_poll_interval          = 3600 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] shutdown_timeout               = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] source_is_ipv6                 = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ssl_only                       = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] state_path                     = /opt/stack/data/nova {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] sync_power_state_interval      = 600 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] sync_power_state_pool_size     = 1000 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] syslog_log_facility            = LOG_USER {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] tempdir                        = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] timeout_nbd                    = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] transport_url                  = **** {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] update_resources_interval      = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] use_cow_images                 = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] use_eventlog                   = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] use_journal                    = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] use_json                       = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] use_rootwrap_daemon            = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] use_stderr                     = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] use_syslog                     = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vcpu_pin_set                   = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vif_plugging_is_fatal          = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vif_plugging_timeout           = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] virt_mkfs                      = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] volume_usage_poll_interval     = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] watch_log_file                 = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] web                            = /usr/share/spice-html5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_concurrency.disable_process_locking = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.auth_strategy              = keystone {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.compute_link_prefix        = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.dhcp_domain                = novalocal {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.enable_instance_password   = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.glance_link_prefix         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.instance_list_per_project_cells = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.list_records_by_skipping_down_cells = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.local_metadata_per_cell    = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.max_limit                  = 1000 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.metadata_cache_expiration  = 15 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.neutron_default_tenant_id  = default {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.use_forwarded_for          = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.use_neutron_default_nets   = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.vendordata_dynamic_targets = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.vendordata_jsonfile_path   = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.backend                  = dogpile.cache.memcached {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.backend_argument         = **** {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.config_prefix            = cache.oslo {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.dead_timeout             = 60.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.debug_cache_backend      = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.enable_retry_client      = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.enable_socket_keepalive  = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.enabled                  = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.expiration_time          = 600 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.hashclient_retry_attempts = 2 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.memcache_dead_retry      = 300 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.memcache_password        =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.memcache_pool_maxsize    = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.memcache_sasl_enabled    = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.memcache_username        =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.proxies                  = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.retry_attempts           = 2 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.retry_delay              = 0.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.socket_keepalive_count   = 1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.socket_keepalive_idle    = 1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.socket_keepalive_interval = 1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.tls_allowed_ciphers      = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.tls_cafile               = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.tls_certfile             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.tls_enabled              = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cache.tls_keyfile              = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cinder.auth_section            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cinder.auth_type               = password {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cinder.cafile                  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cinder.certfile                = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cinder.collect_timing          = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cinder.cross_az_attach         = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cinder.debug                   = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cinder.endpoint_template       = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cinder.http_retries            = 3 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cinder.insecure                = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cinder.keyfile                 = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cinder.os_region_name          = RegionOne {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cinder.split_loggers           = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cinder.timeout                 = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] compute.cpu_dedicated_set      = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] compute.cpu_shared_set         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] compute.image_type_exclude_list = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] compute.max_concurrent_disk_ops = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] compute.max_disk_devices_to_attach = -1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] compute.resource_provider_association_refresh = 300 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] compute.shutdown_retry_interval = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] conductor.workers              = 3 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] console.allowed_origins        = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] console.ssl_ciphers            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] console.ssl_minimum_version    = default {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] consoleauth.token_ttl          = 600 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.cafile                  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.certfile                = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.collect_timing          = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.connect_retries         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.connect_retry_delay     = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.endpoint_override       = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.insecure                = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.keyfile                 = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.max_version             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.min_version             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.region_name             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.service_name            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.service_type            = accelerator {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.split_loggers           = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.status_code_retries     = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.status_code_retry_delay = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.timeout                 = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] cyborg.version                 = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.backend               = sqlalchemy {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.connection            = **** {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.connection_debug      = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.connection_parameters =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.connection_recycle_time = 3600 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.connection_trace      = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.db_inc_retry_interval = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.db_max_retries        = 20 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.db_max_retry_interval = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.db_retry_interval     = 1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.max_overflow          = 50 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.max_pool_size         = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.max_retries           = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.mysql_wsrep_sync_wait = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.pool_timeout          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.retry_interval        = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.slave_connection      = **** {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] database.sqlite_synchronous    = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.backend           = sqlalchemy {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.connection        = **** {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.connection_debug  = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.connection_parameters =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.connection_recycle_time = 3600 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.connection_trace  = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.db_inc_retry_interval = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.db_max_retries    = 20 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.db_max_retry_interval = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.db_retry_interval = 1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.max_overflow      = 50 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.max_pool_size     = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.max_retries       = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.pool_timeout      = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.retry_interval    = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.slave_connection  = **** {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] api_database.sqlite_synchronous = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] devices.enabled_mdev_types     = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ephemeral_storage_encryption.enabled = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.api_servers             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.cafile                  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.certfile                = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.collect_timing          = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.connect_retries         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.connect_retry_delay     = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.debug                   = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.default_trusted_certificate_ids = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.enable_certificate_validation = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.enable_rbd_download     = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.endpoint_override       = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.insecure                = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.keyfile                 = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.max_version             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.min_version             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.num_retries             = 3 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.rbd_ceph_conf           =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.rbd_connect_timeout     = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.rbd_pool                =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.rbd_user                =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.region_name             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.service_name            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.service_type            = image {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.split_loggers           = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.status_code_retries     = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.status_code_retry_delay = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.timeout                 = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.verify_glance_signatures = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] glance.version                 = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] guestfs.debug                  = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.config_drive_cdrom      = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.config_drive_inject_password = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.enable_instance_metrics_collection = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.enable_remotefx         = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.instances_path_share    =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.iscsi_initiator_list    = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.limit_cpu_features      = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.power_state_check_timeframe = 60 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.use_multipath_io        = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.volume_attach_retry_count = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.vswitch_name            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] mks.enabled                    = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] image_cache.manager_interval   = 2400 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] image_cache.precache_concurrency = 1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] image_cache.remove_unused_base_images = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] image_cache.subdirectory_name  = _base {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.api_max_retries         = 60 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.api_retry_interval      = 2 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.auth_section            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.auth_type               = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.cafile                  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.certfile                = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.collect_timing          = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.conductor_group         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.connect_retries         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.connect_retry_delay     = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.endpoint_override       = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.insecure                = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.keyfile                 = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.max_version             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.min_version             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.peer_list               = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.region_name             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.serial_console_state_timeout = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.service_name            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.service_type            = baremetal {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.split_loggers           = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.status_code_retries     = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.status_code_retry_delay = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.timeout                 = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ironic.version                 = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] key_manager.fixed_key          = **** {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.barbican_api_version  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.barbican_endpoint     = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.barbican_endpoint_type = public {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.barbican_region_name  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.cafile                = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.certfile              = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.collect_timing        = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.insecure              = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.keyfile               = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.number_of_retries     = 60 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.retry_delay           = 1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.send_service_user_token = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.split_loggers         = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.timeout               = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.verify_ssl            = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican.verify_ssl_path       = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican_service_user.auth_section = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican_service_user.auth_type = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican_service_user.cafile   = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican_service_user.certfile = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican_service_user.collect_timing = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican_service_user.insecure = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican_service_user.keyfile  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican_service_user.split_loggers = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] barbican_service_user.timeout  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.approle_role_id          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.approle_secret_id        = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.cafile                   = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.certfile                 = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.collect_timing           = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.insecure                 = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.keyfile                  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.kv_mountpoint            = secret {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.kv_path                  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.kv_version               = 2 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.namespace                = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.root_token_id            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.split_loggers            = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.ssl_ca_crt_file          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.timeout                  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.use_ssl                  = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.auth_section          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.auth_type             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.cafile                = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.certfile              = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.collect_timing        = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.connect_retries       = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.connect_retry_delay   = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.endpoint_override     = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.insecure              = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.keyfile               = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.max_version           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.min_version           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.region_name           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.service_name          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.service_type          = identity {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.split_loggers         = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.status_code_retries   = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.status_code_retry_delay = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.timeout               = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] keystone.version               = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.connection_uri         =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.cpu_mode               = custom {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: WARNING oslo_config.cfg [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.cpu_power_governor_high = performance {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.cpu_power_governor_low = powersave {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.cpu_power_management   = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.device_detach_attempts = 8 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.device_detach_timeout  = 20 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.disk_cachemodes        = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.disk_prefix            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.enabled_perf_events    = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.file_backed_memory     = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.gid_maps               = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.hw_disk_discard        = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.hw_machine_type        = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.images_rbd_glance_store_name =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.images_rbd_pool        = rbd {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.images_type            = default {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.images_volume_group    = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.inject_key             = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.inject_partition       = -2 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.inject_password        = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.iscsi_iface            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.iser_use_multipath     = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.live_migration_bandwidth = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.live_migration_downtime = 500 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.live_migration_inbound_addr = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.live_migration_permit_post_copy = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.live_migration_scheme  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.live_migration_timeout_action = abort {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.live_migration_tunnelled = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: WARNING oslo_config.cfg [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 26 03:16:07 user nova-compute[74630]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 26 03:16:07 user nova-compute[74630]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 26 03:16:07 user nova-compute[74630]: and ``live_migration_inbound_addr`` respectively.
Oct 26 03:16:07 user nova-compute[74630]: ).  Its value may be silently ignored in the future.
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.live_migration_with_native_tls = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.max_queues             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.nfs_mount_options      = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.num_memory_encrypted_guests = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.num_pcie_ports         = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.pmem_namespaces        = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.quobyte_client_cfg     = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.rbd_secret_uuid        = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.rbd_user               = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.remote_filesystem_transport = ssh {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.rescue_image_id        = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.rescue_kernel_id       = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.rescue_ramdisk_id      = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.rx_queue_size          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.smbfs_mount_options    =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.snapshot_compression   = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.snapshot_image_format  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.sparse_logical_volumes = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.swtpm_enabled          = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.swtpm_group            = tss {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.swtpm_user             = tss {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.sysinfo_serial         = unique {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.tb_cache_size          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.tx_queue_size          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.uid_maps               = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.use_virtio_for_bridges = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.virt_type              = kvm {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.volume_clear           = zero {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.volume_clear_size      = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.volume_use_multipath   = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.vzstorage_cache_path   = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.vzstorage_mount_user   = stack {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.auth_section           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.auth_type              = password {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.cafile                 = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.certfile               = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.collect_timing         = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.connect_retries        = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.connect_retry_delay    = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.default_floating_pool  = public {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.endpoint_override      = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.extension_sync_interval = 600 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.http_retries           = 3 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.insecure               = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.keyfile                = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.max_version            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.min_version            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.ovs_bridge             = br-int {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.physnets               = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.region_name            = RegionOne {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.service_metadata_proxy = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.service_name           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.service_type           = network {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.split_loggers          = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.status_code_retries    = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.status_code_retry_delay = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.timeout                = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] neutron.version                = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] notifications.bdms_in_notifications = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] notifications.default_level    = INFO {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] notifications.notification_format = unversioned {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] notifications.notify_on_state_change = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] pci.alias                      = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] pci.device_spec                = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] pci.report_in_placement        = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.auth_section         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.auth_type            = password {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.cafile               = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.certfile             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.collect_timing       = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.connect_retries      = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.connect_retry_delay  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.default_domain_id    = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.default_domain_name  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.domain_id            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.domain_name          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.endpoint_override    = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.insecure             = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.keyfile              = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.max_version          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.min_version          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.password             = **** {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.project_domain_id    = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.project_domain_name  = Default {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.project_id           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.project_name         = service {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.region_name          = RegionOne {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.service_name         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.service_type         = placement {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.split_loggers        = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.status_code_retries  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.status_code_retry_delay = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.system_scope         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.timeout              = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.trust_id             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.user_domain_id       = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.user_domain_name     = Default {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.user_id              = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.username             = placement {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] placement.version              = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] quota.cores                    = 20 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] quota.count_usage_from_placement = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] quota.injected_file_content_bytes = 10240 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] quota.injected_file_path_length = 255 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] quota.injected_files           = 5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] quota.instances                = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] quota.key_pairs                = 100 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] quota.metadata_items           = 128 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] quota.ram                      = 51200 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] quota.recheck_quota            = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] quota.server_group_members     = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] quota.server_groups            = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] rdp.enabled                    = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] scheduler.image_metadata_prefilter = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] scheduler.max_attempts         = 3 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] scheduler.max_placement_results = 1000 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] scheduler.query_placement_for_image_type_support = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] scheduler.workers              = 3 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.host_subset_size = 1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.isolated_hosts = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.isolated_images = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.pci_in_placement = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.track_instance_changes = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] metrics.required               = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] metrics.weight_multiplier      = 1.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] metrics.weight_setting         = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] serial_console.enabled         = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] serial_console.port_range      = 10000:20000 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] serial_console.serialproxy_port = 6083 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] service_user.auth_section      = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] service_user.auth_type         = password {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] service_user.cafile            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] service_user.certfile          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] service_user.collect_timing    = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] service_user.insecure          = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] service_user.keyfile           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] service_user.send_service_user_token = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] service_user.split_loggers     = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] service_user.timeout           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] spice.agent_enabled            = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] spice.enabled                  = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] spice.html5proxy_port          = 6082 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] spice.image_compression        = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] spice.jpeg_compression         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] spice.playback_compression     = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] spice.server_listen            = 127.0.0.1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] spice.streaming_mode           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] spice.zlib_compression         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] upgrade_levels.baseapi         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] upgrade_levels.cert            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] upgrade_levels.compute         = auto {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] upgrade_levels.conductor       = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] upgrade_levels.scheduler       = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vendordata_dynamic_auth.auth_section = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vendordata_dynamic_auth.auth_type = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vendordata_dynamic_auth.cafile = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vendordata_dynamic_auth.certfile = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vendordata_dynamic_auth.insecure = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vendordata_dynamic_auth.keyfile = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vendordata_dynamic_auth.timeout = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.api_retry_count         = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.ca_file                 = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.cache_prefix            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.cluster_name            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.connection_pool_size    = 10 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.console_delay_seconds   = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.datastore_regex         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.host_ip                 = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.host_password           = **** {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.host_port               = 443 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.host_username           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.insecure                = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.integration_bridge      = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.maximum_objects         = 100 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.pbm_default_policy      = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.pbm_enabled             = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.pbm_wsdl_location       = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.serial_port_proxy_uri   = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.serial_port_service_uri = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.task_poll_interval      = 0.5 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.use_linked_clone        = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.vnc_keymap              = en-us {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.vnc_port                = 5900 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vmware.vnc_port_total          = 10000 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vnc.auth_schemes               = ['none'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vnc.enabled                    = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vnc.novncproxy_port            = 6080 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vnc.server_listen              = 0.0.0.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vnc.vencrypt_ca_certs          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vnc.vencrypt_client_cert       = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vnc.vencrypt_client_key        = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.disable_rootwrap   = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.enable_numa_live_migration = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.libvirt_disable_apic = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] wsgi.client_socket_timeout     = 900 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] wsgi.default_pool_size         = 1000 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] wsgi.keep_alive                = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] wsgi.max_header_line           = 16384 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] wsgi.ssl_ca_file               = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] wsgi.ssl_cert_file             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] wsgi.ssl_key_file              = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] wsgi.tcp_keepidle              = 600 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] zvm.ca_file                    = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] zvm.cloud_connector_url        = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] zvm.reachable_timeout          = 300 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_policy.enforce_new_defaults = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_policy.enforce_scope      = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_policy.policy_default_rule = default {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_policy.policy_file        = policy.yaml {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] profiler.connection_string     = messaging:// {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] profiler.enabled               = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] profiler.es_doc_type           = notification {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] profiler.es_scroll_size        = 10000 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] profiler.es_scroll_time        = 2m {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] profiler.filter_error_trace    = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] profiler.hmac_keys             = **** {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] profiler.sentinel_service_name = mymaster {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] profiler.socket_timeout        = 0.1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] profiler.trace_requests        = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] profiler.trace_sqlalchemy      = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] profiler_jaeger.process_tags   = {} {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] profiler_jaeger.service_name_prefix = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] profiler_otlp.service_name_prefix = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] remote_debug.host              = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] remote_debug.port              = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.ssl      = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_notifications.retry = -1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_messaging_notifications.transport_url = **** {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.auth_section        = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.auth_type           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.cafile              = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.certfile            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.collect_timing      = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.connect_retries     = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.connect_retry_delay = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.endpoint_id         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.endpoint_override   = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.insecure            = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.keyfile             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.max_version         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.min_version         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.region_name         = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.service_name        = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.service_type        = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.split_loggers       = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.status_code_retries = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.status_code_retry_delay = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.timeout             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.valid_interfaces    = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_limit.version             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_reports.file_event_handler = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] oslo_reports.log_dir           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vif_plug_ovs_privileged.group  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] vif_plug_ovs_privileged.user   = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_vif_linux_bridge.flat_interface = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_vif_ovs.isolate_vif         = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_vif_ovs.per_port_bridge     = False {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] os_brick.lock_path             = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] privsep_osbrick.capabilities   = [21] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] privsep_osbrick.group          = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] privsep_osbrick.helper_command = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] privsep_osbrick.user           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] nova_sys_admin.group           = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] nova_sys_admin.helper_command  = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] nova_sys_admin.user            = None {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG oslo_service.service [None req-6363f8cc-aeaa-4435-aa1f-c9b3d334476c None None] ******************************************************************************** {{(pid=74630) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 26 03:16:07 user nova-compute[74630]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 26 03:16:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Connecting to libvirt: qemu:///system {{(pid=74630) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f3185066590> {{(pid=74630) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 26 03:16:07 user nova-compute[74630]: libvirt:  error : internal error: could not initialize domain event timer
Oct 26 03:16:07 user nova-compute[74630]: WARNING nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 26 03:16:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f3185066590> {{(pid=74630) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Starting native event thread {{(pid=74630) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Starting green dispatch thread {{(pid=74630) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 26 03:16:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Starting connection event dispatch thread {{(pid=74630) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 26 03:16:07 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Connection event '1' reason 'None'
Oct 26 03:16:07 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 26 03:16:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.mount [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Initialising _HostMountState generation 0 {{(pid=74630) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 26 03:16:14 user nova-compute[74630]: INFO nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Libvirt host capabilities <capabilities>
Oct 26 03:16:14 user nova-compute[74630]:   <host>
Oct 26 03:16:14 user nova-compute[74630]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 26 03:16:14 user nova-compute[74630]:     <cpu>
Oct 26 03:16:14 user nova-compute[74630]:       <arch>x86_64</arch>
Oct 26 03:16:14 user nova-compute[74630]:       <model>IvyBridge-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <vendor>Intel</vendor>
Oct 26 03:16:14 user nova-compute[74630]:       <microcode version='1070'/>
Oct 26 03:16:14 user nova-compute[74630]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 26 03:16:14 user nova-compute[74630]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature name='ss'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature name='vmx'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature name='pcid'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature name='osxsave'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature name='hypervisor'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature name='arat'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature name='tsc_adjust'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature name='md-clear'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature name='stibp'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature name='arch-capabilities'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature name='ssbd'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature name='invtsc'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature name='rsba'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature name='skip-l1dfl-vmentry'/>
Oct 26 03:16:14 user nova-compute[74630]:       <pages unit='KiB' size='4'/>
Oct 26 03:16:14 user nova-compute[74630]:       <pages unit='KiB' size='2048'/>
Oct 26 03:16:14 user nova-compute[74630]:     </cpu>
Oct 26 03:16:14 user nova-compute[74630]:     <power_management>
Oct 26 03:16:14 user nova-compute[74630]:       <suspend_mem/>
Oct 26 03:16:14 user nova-compute[74630]:       <suspend_disk/>
Oct 26 03:16:14 user nova-compute[74630]:       <suspend_hybrid/>
Oct 26 03:16:14 user nova-compute[74630]:     </power_management>
Oct 26 03:16:14 user nova-compute[74630]:     <iommu support='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     <migration_features>
Oct 26 03:16:14 user nova-compute[74630]:       <live/>
Oct 26 03:16:14 user nova-compute[74630]:       <uri_transports>
Oct 26 03:16:14 user nova-compute[74630]:         <uri_transport>tcp</uri_transport>
Oct 26 03:16:14 user nova-compute[74630]:         <uri_transport>rdma</uri_transport>
Oct 26 03:16:14 user nova-compute[74630]:       </uri_transports>
Oct 26 03:16:14 user nova-compute[74630]:     </migration_features>
Oct 26 03:16:14 user nova-compute[74630]:     <topology>
Oct 26 03:16:14 user nova-compute[74630]:       <cells num='2'>
Oct 26 03:16:14 user nova-compute[74630]:         <cell id='0'>
Oct 26 03:16:14 user nova-compute[74630]:           <memory unit='KiB'>8189224</memory>
Oct 26 03:16:14 user nova-compute[74630]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 26 03:16:14 user nova-compute[74630]:           <pages unit='KiB' size='2048'>0</pages>
Oct 26 03:16:14 user nova-compute[74630]:           <distances>
Oct 26 03:16:14 user nova-compute[74630]:             <sibling id='0' value='10'/>
Oct 26 03:16:14 user nova-compute[74630]:             <sibling id='1' value='20'/>
Oct 26 03:16:14 user nova-compute[74630]:           </distances>
Oct 26 03:16:14 user nova-compute[74630]:           <cpus num='6'>
Oct 26 03:16:14 user nova-compute[74630]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 26 03:16:14 user nova-compute[74630]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 26 03:16:14 user nova-compute[74630]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 26 03:16:14 user nova-compute[74630]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 26 03:16:14 user nova-compute[74630]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 26 03:16:14 user nova-compute[74630]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 26 03:16:14 user nova-compute[74630]:           </cpus>
Oct 26 03:16:14 user nova-compute[74630]:         </cell>
Oct 26 03:16:14 user nova-compute[74630]:         <cell id='1'>
Oct 26 03:16:14 user nova-compute[74630]:           <memory unit='KiB'>8206460</memory>
Oct 26 03:16:14 user nova-compute[74630]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 26 03:16:14 user nova-compute[74630]:           <pages unit='KiB' size='2048'>0</pages>
Oct 26 03:16:14 user nova-compute[74630]:           <distances>
Oct 26 03:16:14 user nova-compute[74630]:             <sibling id='0' value='20'/>
Oct 26 03:16:14 user nova-compute[74630]:             <sibling id='1' value='10'/>
Oct 26 03:16:14 user nova-compute[74630]:           </distances>
Oct 26 03:16:14 user nova-compute[74630]:           <cpus num='6'>
Oct 26 03:16:14 user nova-compute[74630]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 26 03:16:14 user nova-compute[74630]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 26 03:16:14 user nova-compute[74630]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 26 03:16:14 user nova-compute[74630]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 26 03:16:14 user nova-compute[74630]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 26 03:16:14 user nova-compute[74630]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 26 03:16:14 user nova-compute[74630]:           </cpus>
Oct 26 03:16:14 user nova-compute[74630]:         </cell>
Oct 26 03:16:14 user nova-compute[74630]:       </cells>
Oct 26 03:16:14 user nova-compute[74630]:     </topology>
Oct 26 03:16:14 user nova-compute[74630]:     <cache>
Oct 26 03:16:14 user nova-compute[74630]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 26 03:16:14 user nova-compute[74630]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 26 03:16:14 user nova-compute[74630]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 26 03:16:14 user nova-compute[74630]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 26 03:16:14 user nova-compute[74630]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 26 03:16:14 user nova-compute[74630]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 26 03:16:14 user nova-compute[74630]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 26 03:16:14 user nova-compute[74630]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 26 03:16:14 user nova-compute[74630]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 26 03:16:14 user nova-compute[74630]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 26 03:16:14 user nova-compute[74630]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 26 03:16:14 user nova-compute[74630]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 26 03:16:14 user nova-compute[74630]:     </cache>
Oct 26 03:16:14 user nova-compute[74630]:     <secmodel>
Oct 26 03:16:14 user nova-compute[74630]:       <model>apparmor</model>
Oct 26 03:16:14 user nova-compute[74630]:       <doi>0</doi>
Oct 26 03:16:14 user nova-compute[74630]:     </secmodel>
Oct 26 03:16:14 user nova-compute[74630]:     <secmodel>
Oct 26 03:16:14 user nova-compute[74630]:       <model>dac</model>
Oct 26 03:16:14 user nova-compute[74630]:       <doi>0</doi>
Oct 26 03:16:14 user nova-compute[74630]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 26 03:16:14 user nova-compute[74630]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 26 03:16:14 user nova-compute[74630]:     </secmodel>
Oct 26 03:16:14 user nova-compute[74630]:   </host>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='alpha'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>64</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>clipper</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='armv6l'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>32</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>spitz</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>nuri</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>kzm</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sx1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>z2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>tosa</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>n810</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>n800</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>terrier</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>midway</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>microbit</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>verdex</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>highbank</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>akita</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>connex</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>collie</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='armv7l'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>32</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>spitz</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>nuri</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>kzm</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sx1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>z2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>tosa</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>n810</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>n800</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>terrier</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>midway</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>microbit</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>verdex</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>highbank</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>akita</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>connex</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>collie</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='aarch64'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>64</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>spitz</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>nuri</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>kzm</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sx1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>z2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>tosa</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>n810</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>n800</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>terrier</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>midway</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>microbit</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>verdex</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>raspi3b</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>highbank</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>akita</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>connex</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>collie</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <acpi default='on' toggle='yes'/>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='cris'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>32</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='i686'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>32</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>x-remote</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>isapc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>microvm</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='kvm'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <pae/>
Oct 26 03:16:14 user nova-compute[74630]:       <nonpae/>
Oct 26 03:16:14 user nova-compute[74630]:       <acpi default='on' toggle='yes'/>
Oct 26 03:16:14 user nova-compute[74630]:       <apic default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='m68k'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>32</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>an5206</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>q800</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>next-cube</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='microblaze'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>32</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='microblazeel'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>32</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='mips'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>32</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='16'>malta</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='mipsel'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>32</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='16'>malta</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='mips64'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>64</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='16'>malta</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>pica61</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>magnum</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='mips64el'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>64</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='16'>malta</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>pica61</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>magnum</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='16'>boston</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='ppc'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>32</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mac99</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>40p</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>taihu</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='ppc64'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>64</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2048'>powernv9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>taihu</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2048'>powernv10</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>40p</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mac99</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2048'>powernv8</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='ppc64le'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>64</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2048'>powernv9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>taihu</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2048'>powernv10</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>40p</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>mac99</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2048'>powernv8</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='riscv32'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>32</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='8'>spike</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>opentitan</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='5'>sifive_u</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sifive_e</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='8'>virt</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='riscv64'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>64</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='8'>spike</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='5'>sifive_u</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>shakti_c</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sifive_e</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='8'>virt</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='s390x'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>64</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='sh4'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>32</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>shix</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>r2d</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='sh4eb'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>64</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>shix</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>r2d</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='sparc'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>32</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>SS-5</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>SS-20</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>LX</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>SS-4</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>SS-10</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>Voyager</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='sparc64'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>64</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sun4u</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>niagara</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>sun4v</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='x86_64'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>64</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>x-remote</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='1'>isapc</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>microvm</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='kvm'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <acpi default='on' toggle='yes'/>
Oct 26 03:16:14 user nova-compute[74630]:       <apic default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='xtensa'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>32</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>sim</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>kc705</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>ml605</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>virt</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>lx200</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>lx60</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]:   <guest>
Oct 26 03:16:14 user nova-compute[74630]:     <os_type>hvm</os_type>
Oct 26 03:16:14 user nova-compute[74630]:     <arch name='xtensaeb'>
Oct 26 03:16:14 user nova-compute[74630]:       <wordsize>32</wordsize>
Oct 26 03:16:14 user nova-compute[74630]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='4'>sim</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>kc705</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>ml605</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>virt</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>lx200</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>lx60</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 26 03:16:14 user nova-compute[74630]:       <domain type='qemu'/>
Oct 26 03:16:14 user nova-compute[74630]:     </arch>
Oct 26 03:16:14 user nova-compute[74630]:     <features>
Oct 26 03:16:14 user nova-compute[74630]:       <cpuselection/>
Oct 26 03:16:14 user nova-compute[74630]:       <deviceboot/>
Oct 26 03:16:14 user nova-compute[74630]:       <disksnapshot default='on' toggle='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     </features>
Oct 26 03:16:14 user nova-compute[74630]:   </guest>
Oct 26 03:16:14 user nova-compute[74630]: </capabilities>
Oct 26 03:16:14 user nova-compute[74630]: 
Oct 26 03:16:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 26 03:16:14 user nova-compute[74630]: <domainCapabilities>
Oct 26 03:16:14 user nova-compute[74630]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 03:16:14 user nova-compute[74630]:   <domain>kvm</domain>
Oct 26 03:16:14 user nova-compute[74630]:   <machine>pc-i440fx-6.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:   <arch>i686</arch>
Oct 26 03:16:14 user nova-compute[74630]:   <vcpu max='255'/>
Oct 26 03:16:14 user nova-compute[74630]:   <iothreads supported='yes'/>
Oct 26 03:16:14 user nova-compute[74630]:   <os supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:     <enum name='firmware'/>
Oct 26 03:16:14 user nova-compute[74630]:     <loader supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>rom</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>pflash</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='readonly'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>yes</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='secure'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </loader>
Oct 26 03:16:14 user nova-compute[74630]:   </os>
Oct 26 03:16:14 user nova-compute[74630]:   <cpu>
Oct 26 03:16:14 user nova-compute[74630]:     <mode name='host-passthrough' supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='hostPassthroughMigratable'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </mode>
Oct 26 03:16:14 user nova-compute[74630]:     <mode name='maximum' supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='maximumMigratable'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>on</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </mode>
Oct 26 03:16:14 user nova-compute[74630]:     <mode name='host-model' supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <vendor>Intel</vendor>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='ss'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='vmx'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='pcid'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='hypervisor'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='arat'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='umip'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='md-clear'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='stibp'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='ssbd'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='ibpb'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='ibrs'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='amd-stibp'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='disable' name='erms'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='disable' name='lm'/>
Oct 26 03:16:14 user nova-compute[74630]:     </mode>
Oct 26 03:16:14 user nova-compute[74630]:     <mode name='custom' supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>qemu64</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>qemu32</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>phenom</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>pentium3</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>pentium2</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>pentium</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>n270</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>kvm64</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>kvm32</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>coreduo</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>core2duo</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>athlon</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Westmere</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Snowridge</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Server</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Client</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>SandyBridge</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Penryn</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Opteron_G5</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Opteron_G4</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Opteron_G3</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Opteron_G2</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Opteron_G1</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Nehalem</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>IvyBridge</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Icelake-Server</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Haswell</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>EPYC-Rome</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>EPYC-Milan</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>EPYC</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Dhyana</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Cooperlake</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Conroe</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Broadwell</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>486</model>
Oct 26 03:16:14 user nova-compute[74630]:     </mode>
Oct 26 03:16:14 user nova-compute[74630]:   </cpu>
Oct 26 03:16:14 user nova-compute[74630]:   <memoryBacking supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:     <enum name='sourceType'>
Oct 26 03:16:14 user nova-compute[74630]:       <value>file</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>anonymous</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>memfd</value>
Oct 26 03:16:14 user nova-compute[74630]:     </enum>
Oct 26 03:16:14 user nova-compute[74630]:   </memoryBacking>
Oct 26 03:16:14 user nova-compute[74630]:   <devices>
Oct 26 03:16:14 user nova-compute[74630]:     <disk supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='diskDevice'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>disk</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>cdrom</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>floppy</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>lun</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='bus'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>ide</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>fdc</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>sata</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </disk>
Oct 26 03:16:14 user nova-compute[74630]:     <graphics supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>sdl</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>vnc</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>spice</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>egl-headless</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </graphics>
Oct 26 03:16:14 user nova-compute[74630]:     <video supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='modelType'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>vga</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>cirrus</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>vmvga</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>qxl</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>none</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>bochs</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>ramfb</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </video>
Oct 26 03:16:14 user nova-compute[74630]:     <hostdev supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='mode'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>subsystem</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='startupPolicy'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>default</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>mandatory</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>requisite</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>optional</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='subsysType'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>pci</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='capsType'/>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='pciBackend'/>
Oct 26 03:16:14 user nova-compute[74630]:     </hostdev>
Oct 26 03:16:14 user nova-compute[74630]:     <rng supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>random</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>egd</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>builtin</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </rng>
Oct 26 03:16:14 user nova-compute[74630]:     <filesystem supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='driverType'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>path</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>handle</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtiofs</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </filesystem>
Oct 26 03:16:14 user nova-compute[74630]:     <tpm supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>tpm-tis</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>tpm-crb</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>passthrough</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>emulator</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </tpm>
Oct 26 03:16:14 user nova-compute[74630]:   </devices>
Oct 26 03:16:14 user nova-compute[74630]:   <features>
Oct 26 03:16:14 user nova-compute[74630]:     <gic supported='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     <vmcoreinfo supported='yes'/>
Oct 26 03:16:14 user nova-compute[74630]:     <genid supported='yes'/>
Oct 26 03:16:14 user nova-compute[74630]:     <backingStoreInput supported='yes'/>
Oct 26 03:16:14 user nova-compute[74630]:     <backup supported='yes'/>
Oct 26 03:16:14 user nova-compute[74630]:     <sev supported='no'/>
Oct 26 03:16:14 user nova-compute[74630]:   </features>
Oct 26 03:16:14 user nova-compute[74630]: </domainCapabilities>
Oct 26 03:16:14 user nova-compute[74630]:  {{(pid=74630) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 03:16:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 26 03:16:14 user nova-compute[74630]: <domainCapabilities>
Oct 26 03:16:14 user nova-compute[74630]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 03:16:14 user nova-compute[74630]:   <domain>kvm</domain>
Oct 26 03:16:14 user nova-compute[74630]:   <machine>pc-q35-6.2</machine>
Oct 26 03:16:14 user nova-compute[74630]:   <arch>i686</arch>
Oct 26 03:16:14 user nova-compute[74630]:   <vcpu max='288'/>
Oct 26 03:16:14 user nova-compute[74630]:   <iothreads supported='yes'/>
Oct 26 03:16:14 user nova-compute[74630]:   <os supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:     <enum name='firmware'/>
Oct 26 03:16:14 user nova-compute[74630]:     <loader supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>rom</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>pflash</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='readonly'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>yes</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='secure'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </loader>
Oct 26 03:16:14 user nova-compute[74630]:   </os>
Oct 26 03:16:14 user nova-compute[74630]:   <cpu>
Oct 26 03:16:14 user nova-compute[74630]:     <mode name='host-passthrough' supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='hostPassthroughMigratable'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </mode>
Oct 26 03:16:14 user nova-compute[74630]:     <mode name='maximum' supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='maximumMigratable'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>on</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </mode>
Oct 26 03:16:14 user nova-compute[74630]:     <mode name='host-model' supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <vendor>Intel</vendor>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='ss'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='vmx'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='pcid'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='hypervisor'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='arat'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='umip'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='md-clear'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='stibp'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='ssbd'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='ibpb'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='ibrs'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='amd-stibp'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='disable' name='erms'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='disable' name='lm'/>
Oct 26 03:16:14 user nova-compute[74630]:     </mode>
Oct 26 03:16:14 user nova-compute[74630]:     <mode name='custom' supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>qemu64</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>qemu32</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>phenom</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>pentium3</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>pentium2</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>pentium</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>n270</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>kvm64</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>kvm32</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>coreduo</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>core2duo</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>athlon</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Westmere</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Snowridge</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Server</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Client</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>SandyBridge</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Penryn</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Opteron_G5</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Opteron_G4</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Opteron_G3</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Opteron_G2</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Opteron_G1</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Nehalem</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>IvyBridge</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Icelake-Server</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Haswell</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>EPYC-Rome</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>EPYC-Milan</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>EPYC</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Dhyana</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Cooperlake</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Conroe</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Broadwell</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>486</model>
Oct 26 03:16:14 user nova-compute[74630]:     </mode>
Oct 26 03:16:14 user nova-compute[74630]:   </cpu>
Oct 26 03:16:14 user nova-compute[74630]:   <memoryBacking supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:     <enum name='sourceType'>
Oct 26 03:16:14 user nova-compute[74630]:       <value>file</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>anonymous</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>memfd</value>
Oct 26 03:16:14 user nova-compute[74630]:     </enum>
Oct 26 03:16:14 user nova-compute[74630]:   </memoryBacking>
Oct 26 03:16:14 user nova-compute[74630]:   <devices>
Oct 26 03:16:14 user nova-compute[74630]:     <disk supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='diskDevice'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>disk</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>cdrom</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>floppy</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>lun</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='bus'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>fdc</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>sata</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </disk>
Oct 26 03:16:14 user nova-compute[74630]:     <graphics supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>sdl</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>vnc</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>spice</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>egl-headless</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </graphics>
Oct 26 03:16:14 user nova-compute[74630]:     <video supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='modelType'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>vga</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>cirrus</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>vmvga</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>qxl</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>none</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>bochs</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>ramfb</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </video>
Oct 26 03:16:14 user nova-compute[74630]:     <hostdev supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='mode'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>subsystem</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='startupPolicy'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>default</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>mandatory</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>requisite</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>optional</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='subsysType'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>pci</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='capsType'/>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='pciBackend'/>
Oct 26 03:16:14 user nova-compute[74630]:     </hostdev>
Oct 26 03:16:14 user nova-compute[74630]:     <rng supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>random</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>egd</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>builtin</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </rng>
Oct 26 03:16:14 user nova-compute[74630]:     <filesystem supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='driverType'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>path</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>handle</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtiofs</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </filesystem>
Oct 26 03:16:14 user nova-compute[74630]:     <tpm supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>tpm-tis</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>tpm-crb</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>passthrough</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>emulator</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </tpm>
Oct 26 03:16:14 user nova-compute[74630]:   </devices>
Oct 26 03:16:14 user nova-compute[74630]:   <features>
Oct 26 03:16:14 user nova-compute[74630]:     <gic supported='no'/>
Oct 26 03:16:14 user nova-compute[74630]:     <vmcoreinfo supported='yes'/>
Oct 26 03:16:14 user nova-compute[74630]:     <genid supported='yes'/>
Oct 26 03:16:14 user nova-compute[74630]:     <backingStoreInput supported='yes'/>
Oct 26 03:16:14 user nova-compute[74630]:     <backup supported='yes'/>
Oct 26 03:16:14 user nova-compute[74630]:     <sev supported='no'/>
Oct 26 03:16:14 user nova-compute[74630]:   </features>
Oct 26 03:16:14 user nova-compute[74630]: </domainCapabilities>
Oct 26 03:16:14 user nova-compute[74630]:  {{(pid=74630) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 03:16:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 26 03:16:14 user nova-compute[74630]: <domainCapabilities>
Oct 26 03:16:14 user nova-compute[74630]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 03:16:14 user nova-compute[74630]:   <domain>kvm</domain>
Oct 26 03:16:14 user nova-compute[74630]:   <machine>pc-q35-jammy</machine>
Oct 26 03:16:14 user nova-compute[74630]:   <arch>i686</arch>
Oct 26 03:16:14 user nova-compute[74630]:   <vcpu max='288'/>
Oct 26 03:16:14 user nova-compute[74630]:   <iothreads supported='yes'/>
Oct 26 03:16:14 user nova-compute[74630]:   <os supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:     <enum name='firmware'/>
Oct 26 03:16:14 user nova-compute[74630]:     <loader supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>rom</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>pflash</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='readonly'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>yes</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='secure'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </loader>
Oct 26 03:16:14 user nova-compute[74630]:   </os>
Oct 26 03:16:14 user nova-compute[74630]:   <cpu>
Oct 26 03:16:14 user nova-compute[74630]:     <mode name='host-passthrough' supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='hostPassthroughMigratable'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </mode>
Oct 26 03:16:14 user nova-compute[74630]:     <mode name='maximum' supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='maximumMigratable'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>on</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </mode>
Oct 26 03:16:14 user nova-compute[74630]:     <mode name='host-model' supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <vendor>Intel</vendor>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='ss'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='vmx'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='pcid'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='hypervisor'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='arat'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='umip'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='md-clear'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='stibp'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='ssbd'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='ibpb'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='ibrs'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='amd-stibp'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='disable' name='erms'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 03:16:14 user nova-compute[74630]:       <feature policy='disable' name='lm'/>
Oct 26 03:16:14 user nova-compute[74630]:     </mode>
Oct 26 03:16:14 user nova-compute[74630]:     <mode name='custom' supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>qemu64</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>qemu32</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>phenom</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>pentium3</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>pentium2</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>pentium</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>n270</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>kvm64</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>kvm32</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>coreduo</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>core2duo</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>athlon</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Westmere</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Snowridge</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Server</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Skylake-Client</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>SandyBridge</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Penryn</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Opteron_G5</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Opteron_G4</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Opteron_G3</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Opteron_G2</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Opteron_G1</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Nehalem</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>IvyBridge</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Icelake-Server</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Haswell</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>EPYC-Rome</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>EPYC-Milan</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>EPYC</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Dhyana</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Cooperlake</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Conroe</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='no'>Broadwell</model>
Oct 26 03:16:14 user nova-compute[74630]:       <model usable='yes'>486</model>
Oct 26 03:16:14 user nova-compute[74630]:     </mode>
Oct 26 03:16:14 user nova-compute[74630]:   </cpu>
Oct 26 03:16:14 user nova-compute[74630]:   <memoryBacking supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:     <enum name='sourceType'>
Oct 26 03:16:14 user nova-compute[74630]:       <value>file</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>anonymous</value>
Oct 26 03:16:14 user nova-compute[74630]:       <value>memfd</value>
Oct 26 03:16:14 user nova-compute[74630]:     </enum>
Oct 26 03:16:14 user nova-compute[74630]:   </memoryBacking>
Oct 26 03:16:14 user nova-compute[74630]:   <devices>
Oct 26 03:16:14 user nova-compute[74630]:     <disk supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='diskDevice'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>disk</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>cdrom</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>floppy</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>lun</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='bus'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>fdc</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>sata</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </disk>
Oct 26 03:16:14 user nova-compute[74630]:     <graphics supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>sdl</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>vnc</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>spice</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>egl-headless</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </graphics>
Oct 26 03:16:14 user nova-compute[74630]:     <video supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='modelType'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>vga</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>cirrus</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>vmvga</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>qxl</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>none</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>bochs</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>ramfb</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:     </video>
Oct 26 03:16:14 user nova-compute[74630]:     <hostdev supported='yes'>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='mode'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>subsystem</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:14 user nova-compute[74630]:       <enum name='startupPolicy'>
Oct 26 03:16:14 user nova-compute[74630]:         <value>default</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>mandatory</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>requisite</value>
Oct 26 03:16:14 user nova-compute[74630]:         <value>optional</value>
Oct 26 03:16:14 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='subsysType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>pci</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='capsType'/>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='pciBackend'/>
Oct 26 03:16:15 user nova-compute[74630]:     </hostdev>
Oct 26 03:16:15 user nova-compute[74630]:     <rng supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>random</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>egd</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>builtin</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </rng>
Oct 26 03:16:15 user nova-compute[74630]:     <filesystem supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='driverType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>path</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>handle</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtiofs</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </filesystem>
Oct 26 03:16:15 user nova-compute[74630]:     <tpm supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>tpm-tis</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>tpm-crb</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>passthrough</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>emulator</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </tpm>
Oct 26 03:16:15 user nova-compute[74630]:   </devices>
Oct 26 03:16:15 user nova-compute[74630]:   <features>
Oct 26 03:16:15 user nova-compute[74630]:     <gic supported='no'/>
Oct 26 03:16:15 user nova-compute[74630]:     <vmcoreinfo supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <genid supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <backingStoreInput supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <backup supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <sev supported='no'/>
Oct 26 03:16:15 user nova-compute[74630]:   </features>
Oct 26 03:16:15 user nova-compute[74630]: </domainCapabilities>
Oct 26 03:16:15 user nova-compute[74630]:  {{(pid=74630) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 26 03:16:15 user nova-compute[74630]: <domainCapabilities>
Oct 26 03:16:15 user nova-compute[74630]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 03:16:15 user nova-compute[74630]:   <domain>kvm</domain>
Oct 26 03:16:15 user nova-compute[74630]:   <machine>pc-i440fx-jammy</machine>
Oct 26 03:16:15 user nova-compute[74630]:   <arch>i686</arch>
Oct 26 03:16:15 user nova-compute[74630]:   <vcpu max='255'/>
Oct 26 03:16:15 user nova-compute[74630]:   <iothreads supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:   <os supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:     <enum name='firmware'/>
Oct 26 03:16:15 user nova-compute[74630]:     <loader supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>rom</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>pflash</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='readonly'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>yes</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='secure'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </loader>
Oct 26 03:16:15 user nova-compute[74630]:   </os>
Oct 26 03:16:15 user nova-compute[74630]:   <cpu>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='host-passthrough' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='hostPassthroughMigratable'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='maximum' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='maximumMigratable'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>on</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='host-model' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <vendor>Intel</vendor>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ss'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='vmx'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='pcid'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='hypervisor'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='arat'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='umip'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='md-clear'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='stibp'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ssbd'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ibpb'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ibrs'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='amd-stibp'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='disable' name='erms'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='disable' name='lm'/>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='custom' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>qemu64</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>qemu32</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>phenom</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>pentium3</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>pentium2</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>pentium</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>n270</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>kvm64</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>kvm32</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>coreduo</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>core2duo</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>athlon</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Westmere</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Snowridge</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Server</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Client</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>SandyBridge</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Penryn</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G5</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G4</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G3</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G2</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G1</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Nehalem</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>IvyBridge</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Icelake-Server</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC-Rome</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC-Milan</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Dhyana</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Cooperlake</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Conroe</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>486</model>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:   </cpu>
Oct 26 03:16:15 user nova-compute[74630]:   <memoryBacking supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:     <enum name='sourceType'>
Oct 26 03:16:15 user nova-compute[74630]:       <value>file</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>anonymous</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>memfd</value>
Oct 26 03:16:15 user nova-compute[74630]:     </enum>
Oct 26 03:16:15 user nova-compute[74630]:   </memoryBacking>
Oct 26 03:16:15 user nova-compute[74630]:   <devices>
Oct 26 03:16:15 user nova-compute[74630]:     <disk supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='diskDevice'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>disk</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>cdrom</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>floppy</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>lun</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='bus'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>ide</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>fdc</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>sata</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </disk>
Oct 26 03:16:15 user nova-compute[74630]:     <graphics supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>sdl</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>vnc</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>spice</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>egl-headless</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </graphics>
Oct 26 03:16:15 user nova-compute[74630]:     <video supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='modelType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>vga</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>cirrus</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>vmvga</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>qxl</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>none</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>bochs</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>ramfb</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </video>
Oct 26 03:16:15 user nova-compute[74630]:     <hostdev supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='mode'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>subsystem</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='startupPolicy'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>default</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>mandatory</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>requisite</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>optional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='subsysType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>pci</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='capsType'/>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='pciBackend'/>
Oct 26 03:16:15 user nova-compute[74630]:     </hostdev>
Oct 26 03:16:15 user nova-compute[74630]:     <rng supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>random</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>egd</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>builtin</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </rng>
Oct 26 03:16:15 user nova-compute[74630]:     <filesystem supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='driverType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>path</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>handle</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtiofs</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </filesystem>
Oct 26 03:16:15 user nova-compute[74630]:     <tpm supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>tpm-tis</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>tpm-crb</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>passthrough</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>emulator</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </tpm>
Oct 26 03:16:15 user nova-compute[74630]:   </devices>
Oct 26 03:16:15 user nova-compute[74630]:   <features>
Oct 26 03:16:15 user nova-compute[74630]:     <gic supported='no'/>
Oct 26 03:16:15 user nova-compute[74630]:     <vmcoreinfo supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <genid supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <backingStoreInput supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <backup supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <sev supported='no'/>
Oct 26 03:16:15 user nova-compute[74630]:   </features>
Oct 26 03:16:15 user nova-compute[74630]: </domainCapabilities>
Oct 26 03:16:15 user nova-compute[74630]:  {{(pid=74630) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 26 03:16:15 user nova-compute[74630]: <domainCapabilities>
Oct 26 03:16:15 user nova-compute[74630]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 03:16:15 user nova-compute[74630]:   <domain>kvm</domain>
Oct 26 03:16:15 user nova-compute[74630]:   <machine>pc-i440fx-6.2</machine>
Oct 26 03:16:15 user nova-compute[74630]:   <arch>x86_64</arch>
Oct 26 03:16:15 user nova-compute[74630]:   <vcpu max='255'/>
Oct 26 03:16:15 user nova-compute[74630]:   <iothreads supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:   <os supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:     <enum name='firmware'>
Oct 26 03:16:15 user nova-compute[74630]:       <value>efi</value>
Oct 26 03:16:15 user nova-compute[74630]:     </enum>
Oct 26 03:16:15 user nova-compute[74630]:     <loader supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>rom</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>pflash</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='readonly'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>yes</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='secure'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </loader>
Oct 26 03:16:15 user nova-compute[74630]:   </os>
Oct 26 03:16:15 user nova-compute[74630]:   <cpu>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='host-passthrough' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='hostPassthroughMigratable'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>on</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='maximum' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='maximumMigratable'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>on</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='host-model' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <vendor>Intel</vendor>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ss'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='vmx'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='pcid'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='hypervisor'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='arat'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='umip'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='md-clear'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='stibp'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ssbd'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='invtsc'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ibpb'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ibrs'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='amd-stibp'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='rsba'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='disable' name='erms'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='custom' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>qemu64</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>qemu32</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>phenom</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>pentium3</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>pentium2</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>pentium</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>n270</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>kvm64</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>kvm32</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>coreduo</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>core2duo</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>athlon</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Westmere</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Snowridge</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Server</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Client</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>SandyBridge</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Penryn</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G5</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G4</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G3</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G2</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Opteron_G1</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Nehalem</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>IvyBridge</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Icelake-Server</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC-Rome</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC-Milan</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Dhyana</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Cooperlake</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Conroe</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>486</model>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:   </cpu>
Oct 26 03:16:15 user nova-compute[74630]:   <memoryBacking supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:     <enum name='sourceType'>
Oct 26 03:16:15 user nova-compute[74630]:       <value>file</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>anonymous</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>memfd</value>
Oct 26 03:16:15 user nova-compute[74630]:     </enum>
Oct 26 03:16:15 user nova-compute[74630]:   </memoryBacking>
Oct 26 03:16:15 user nova-compute[74630]:   <devices>
Oct 26 03:16:15 user nova-compute[74630]:     <disk supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='diskDevice'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>disk</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>cdrom</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>floppy</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>lun</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='bus'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>ide</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>fdc</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>sata</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </disk>
Oct 26 03:16:15 user nova-compute[74630]:     <graphics supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>sdl</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>vnc</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>spice</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>egl-headless</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </graphics>
Oct 26 03:16:15 user nova-compute[74630]:     <video supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='modelType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>vga</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>cirrus</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>vmvga</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>qxl</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>none</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>bochs</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>ramfb</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </video>
Oct 26 03:16:15 user nova-compute[74630]:     <hostdev supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='mode'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>subsystem</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='startupPolicy'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>default</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>mandatory</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>requisite</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>optional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='subsysType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>pci</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='capsType'/>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='pciBackend'/>
Oct 26 03:16:15 user nova-compute[74630]:     </hostdev>
Oct 26 03:16:15 user nova-compute[74630]:     <rng supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>random</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>egd</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>builtin</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </rng>
Oct 26 03:16:15 user nova-compute[74630]:     <filesystem supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='driverType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>path</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>handle</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtiofs</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </filesystem>
Oct 26 03:16:15 user nova-compute[74630]:     <tpm supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>tpm-tis</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>tpm-crb</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>passthrough</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>emulator</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </tpm>
Oct 26 03:16:15 user nova-compute[74630]:   </devices>
Oct 26 03:16:15 user nova-compute[74630]:   <features>
Oct 26 03:16:15 user nova-compute[74630]:     <gic supported='no'/>
Oct 26 03:16:15 user nova-compute[74630]:     <vmcoreinfo supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <genid supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <backingStoreInput supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <backup supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <sev supported='no'/>
Oct 26 03:16:15 user nova-compute[74630]:   </features>
Oct 26 03:16:15 user nova-compute[74630]: </domainCapabilities>
Oct 26 03:16:15 user nova-compute[74630]:  {{(pid=74630) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 26 03:16:15 user nova-compute[74630]: <domainCapabilities>
Oct 26 03:16:15 user nova-compute[74630]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 03:16:15 user nova-compute[74630]:   <domain>kvm</domain>
Oct 26 03:16:15 user nova-compute[74630]:   <machine>pc-q35-6.2</machine>
Oct 26 03:16:15 user nova-compute[74630]:   <arch>x86_64</arch>
Oct 26 03:16:15 user nova-compute[74630]:   <vcpu max='288'/>
Oct 26 03:16:15 user nova-compute[74630]:   <iothreads supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:   <os supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:     <enum name='firmware'>
Oct 26 03:16:15 user nova-compute[74630]:       <value>efi</value>
Oct 26 03:16:15 user nova-compute[74630]:     </enum>
Oct 26 03:16:15 user nova-compute[74630]:     <loader supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>rom</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>pflash</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='readonly'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>yes</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='secure'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>yes</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </loader>
Oct 26 03:16:15 user nova-compute[74630]:   </os>
Oct 26 03:16:15 user nova-compute[74630]:   <cpu>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='host-passthrough' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='hostPassthroughMigratable'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>on</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='maximum' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='maximumMigratable'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>on</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='host-model' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <vendor>Intel</vendor>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ss'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='vmx'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='pcid'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='hypervisor'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='arat'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='umip'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='md-clear'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='stibp'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ssbd'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='invtsc'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ibpb'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ibrs'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='amd-stibp'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='rsba'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='disable' name='erms'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='custom' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>qemu64</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>qemu32</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>phenom</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>pentium3</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>pentium2</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>pentium</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>n270</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>kvm64</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>kvm32</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>coreduo</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>core2duo</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>athlon</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Westmere</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Snowridge</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Server</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Client</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>SandyBridge</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Penryn</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G5</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G4</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G3</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G2</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Opteron_G1</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Nehalem</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>IvyBridge</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Icelake-Server</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC-Rome</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC-Milan</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Dhyana</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Cooperlake</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Conroe</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>486</model>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:   </cpu>
Oct 26 03:16:15 user nova-compute[74630]:   <memoryBacking supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:     <enum name='sourceType'>
Oct 26 03:16:15 user nova-compute[74630]:       <value>file</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>anonymous</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>memfd</value>
Oct 26 03:16:15 user nova-compute[74630]:     </enum>
Oct 26 03:16:15 user nova-compute[74630]:   </memoryBacking>
Oct 26 03:16:15 user nova-compute[74630]:   <devices>
Oct 26 03:16:15 user nova-compute[74630]:     <disk supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='diskDevice'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>disk</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>cdrom</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>floppy</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>lun</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='bus'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>fdc</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>sata</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </disk>
Oct 26 03:16:15 user nova-compute[74630]:     <graphics supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>sdl</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>vnc</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>spice</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>egl-headless</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </graphics>
Oct 26 03:16:15 user nova-compute[74630]:     <video supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='modelType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>vga</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>cirrus</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>vmvga</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>qxl</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>none</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>bochs</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>ramfb</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </video>
Oct 26 03:16:15 user nova-compute[74630]:     <hostdev supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='mode'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>subsystem</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='startupPolicy'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>default</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>mandatory</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>requisite</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>optional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='subsysType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>pci</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='capsType'/>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='pciBackend'/>
Oct 26 03:16:15 user nova-compute[74630]:     </hostdev>
Oct 26 03:16:15 user nova-compute[74630]:     <rng supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>random</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>egd</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>builtin</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </rng>
Oct 26 03:16:15 user nova-compute[74630]:     <filesystem supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='driverType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>path</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>handle</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtiofs</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </filesystem>
Oct 26 03:16:15 user nova-compute[74630]:     <tpm supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>tpm-tis</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>tpm-crb</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>passthrough</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>emulator</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </tpm>
Oct 26 03:16:15 user nova-compute[74630]:   </devices>
Oct 26 03:16:15 user nova-compute[74630]:   <features>
Oct 26 03:16:15 user nova-compute[74630]:     <gic supported='no'/>
Oct 26 03:16:15 user nova-compute[74630]:     <vmcoreinfo supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <genid supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <backingStoreInput supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <backup supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <sev supported='no'/>
Oct 26 03:16:15 user nova-compute[74630]:   </features>
Oct 26 03:16:15 user nova-compute[74630]: </domainCapabilities>
Oct 26 03:16:15 user nova-compute[74630]:  {{(pid=74630) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 26 03:16:15 user nova-compute[74630]: <domainCapabilities>
Oct 26 03:16:15 user nova-compute[74630]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 03:16:15 user nova-compute[74630]:   <domain>kvm</domain>
Oct 26 03:16:15 user nova-compute[74630]:   <machine>pc-q35-jammy</machine>
Oct 26 03:16:15 user nova-compute[74630]:   <arch>x86_64</arch>
Oct 26 03:16:15 user nova-compute[74630]:   <vcpu max='288'/>
Oct 26 03:16:15 user nova-compute[74630]:   <iothreads supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:   <os supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:     <enum name='firmware'>
Oct 26 03:16:15 user nova-compute[74630]:       <value>efi</value>
Oct 26 03:16:15 user nova-compute[74630]:     </enum>
Oct 26 03:16:15 user nova-compute[74630]:     <loader supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>rom</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>pflash</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='readonly'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>yes</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='secure'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>yes</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </loader>
Oct 26 03:16:15 user nova-compute[74630]:   </os>
Oct 26 03:16:15 user nova-compute[74630]:   <cpu>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='host-passthrough' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='hostPassthroughMigratable'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>on</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='maximum' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='maximumMigratable'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>on</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='host-model' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <vendor>Intel</vendor>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ss'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='vmx'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='pcid'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='hypervisor'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='arat'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='umip'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='md-clear'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='stibp'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ssbd'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='invtsc'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ibpb'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ibrs'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='amd-stibp'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='rsba'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='disable' name='erms'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='custom' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>qemu64</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>qemu32</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>phenom</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>pentium3</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>pentium2</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>pentium</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>n270</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>kvm64</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>kvm32</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>coreduo</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>core2duo</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>athlon</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Westmere</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Snowridge</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Server</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Client</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>SandyBridge</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Penryn</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G5</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G4</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G3</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G2</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Opteron_G1</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Nehalem</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>IvyBridge</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Icelake-Server</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC-Rome</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC-Milan</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Dhyana</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Cooperlake</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Conroe</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>486</model>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:   </cpu>
Oct 26 03:16:15 user nova-compute[74630]:   <memoryBacking supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:     <enum name='sourceType'>
Oct 26 03:16:15 user nova-compute[74630]:       <value>file</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>anonymous</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>memfd</value>
Oct 26 03:16:15 user nova-compute[74630]:     </enum>
Oct 26 03:16:15 user nova-compute[74630]:   </memoryBacking>
Oct 26 03:16:15 user nova-compute[74630]:   <devices>
Oct 26 03:16:15 user nova-compute[74630]:     <disk supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='diskDevice'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>disk</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>cdrom</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>floppy</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>lun</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='bus'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>fdc</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>sata</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </disk>
Oct 26 03:16:15 user nova-compute[74630]:     <graphics supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>sdl</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>vnc</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>spice</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>egl-headless</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </graphics>
Oct 26 03:16:15 user nova-compute[74630]:     <video supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='modelType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>vga</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>cirrus</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>vmvga</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>qxl</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>none</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>bochs</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>ramfb</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </video>
Oct 26 03:16:15 user nova-compute[74630]:     <hostdev supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='mode'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>subsystem</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='startupPolicy'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>default</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>mandatory</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>requisite</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>optional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='subsysType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>pci</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='capsType'/>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='pciBackend'/>
Oct 26 03:16:15 user nova-compute[74630]:     </hostdev>
Oct 26 03:16:15 user nova-compute[74630]:     <rng supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>random</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>egd</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>builtin</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </rng>
Oct 26 03:16:15 user nova-compute[74630]:     <filesystem supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='driverType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>path</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>handle</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtiofs</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </filesystem>
Oct 26 03:16:15 user nova-compute[74630]:     <tpm supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>tpm-tis</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>tpm-crb</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>passthrough</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>emulator</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </tpm>
Oct 26 03:16:15 user nova-compute[74630]:   </devices>
Oct 26 03:16:15 user nova-compute[74630]:   <features>
Oct 26 03:16:15 user nova-compute[74630]:     <gic supported='no'/>
Oct 26 03:16:15 user nova-compute[74630]:     <vmcoreinfo supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <genid supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <backingStoreInput supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <backup supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <sev supported='no'/>
Oct 26 03:16:15 user nova-compute[74630]:   </features>
Oct 26 03:16:15 user nova-compute[74630]: </domainCapabilities>
Oct 26 03:16:15 user nova-compute[74630]:  {{(pid=74630) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 26 03:16:15 user nova-compute[74630]: <domainCapabilities>
Oct 26 03:16:15 user nova-compute[74630]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 03:16:15 user nova-compute[74630]:   <domain>kvm</domain>
Oct 26 03:16:15 user nova-compute[74630]:   <machine>pc-i440fx-jammy</machine>
Oct 26 03:16:15 user nova-compute[74630]:   <arch>x86_64</arch>
Oct 26 03:16:15 user nova-compute[74630]:   <vcpu max='255'/>
Oct 26 03:16:15 user nova-compute[74630]:   <iothreads supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:   <os supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:     <enum name='firmware'>
Oct 26 03:16:15 user nova-compute[74630]:       <value>efi</value>
Oct 26 03:16:15 user nova-compute[74630]:     </enum>
Oct 26 03:16:15 user nova-compute[74630]:     <loader supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>rom</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>pflash</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='readonly'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>yes</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='secure'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>no</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </loader>
Oct 26 03:16:15 user nova-compute[74630]:   </os>
Oct 26 03:16:15 user nova-compute[74630]:   <cpu>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='host-passthrough' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='hostPassthroughMigratable'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>on</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='maximum' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='maximumMigratable'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>on</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>off</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='host-model' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <vendor>Intel</vendor>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ss'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='vmx'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='pcid'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='hypervisor'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='arat'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='umip'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='md-clear'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='stibp'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ssbd'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='invtsc'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ibpb'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='ibrs'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='amd-stibp'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='rsba'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='disable' name='erms'/>
Oct 26 03:16:15 user nova-compute[74630]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:     <mode name='custom' supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>qemu64</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>qemu32</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>phenom</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>pentium3</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>pentium2</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>pentium</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>n270</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>kvm64</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>kvm32</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>coreduo</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>core2duo</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>athlon</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Westmere</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Snowridge</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Server</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Skylake-Client</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>SandyBridge</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Penryn</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G5</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G4</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G3</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Opteron_G2</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Opteron_G1</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Nehalem</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>IvyBridge</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Icelake-Server</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Haswell</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC-Rome</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC-Milan</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>EPYC</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Dhyana</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Cooperlake</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>Conroe</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='no'>Broadwell</model>
Oct 26 03:16:15 user nova-compute[74630]:       <model usable='yes'>486</model>
Oct 26 03:16:15 user nova-compute[74630]:     </mode>
Oct 26 03:16:15 user nova-compute[74630]:   </cpu>
Oct 26 03:16:15 user nova-compute[74630]:   <memoryBacking supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:     <enum name='sourceType'>
Oct 26 03:16:15 user nova-compute[74630]:       <value>file</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>anonymous</value>
Oct 26 03:16:15 user nova-compute[74630]:       <value>memfd</value>
Oct 26 03:16:15 user nova-compute[74630]:     </enum>
Oct 26 03:16:15 user nova-compute[74630]:   </memoryBacking>
Oct 26 03:16:15 user nova-compute[74630]:   <devices>
Oct 26 03:16:15 user nova-compute[74630]:     <disk supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='diskDevice'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>disk</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>cdrom</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>floppy</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>lun</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='bus'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>ide</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>fdc</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>sata</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </disk>
Oct 26 03:16:15 user nova-compute[74630]:     <graphics supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='type'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>sdl</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>vnc</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>spice</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>egl-headless</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </graphics>
Oct 26 03:16:15 user nova-compute[74630]:     <video supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='modelType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>vga</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>cirrus</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>vmvga</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>qxl</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>none</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>bochs</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>ramfb</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </video>
Oct 26 03:16:15 user nova-compute[74630]:     <hostdev supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='mode'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>subsystem</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='startupPolicy'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>default</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>mandatory</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>requisite</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>optional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='subsysType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>usb</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>pci</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>scsi</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='capsType'/>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='pciBackend'/>
Oct 26 03:16:15 user nova-compute[74630]:     </hostdev>
Oct 26 03:16:15 user nova-compute[74630]:     <rng supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtio-non-transitional</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>random</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>egd</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>builtin</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </rng>
Oct 26 03:16:15 user nova-compute[74630]:     <filesystem supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='driverType'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>path</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>handle</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>virtiofs</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </filesystem>
Oct 26 03:16:15 user nova-compute[74630]:     <tpm supported='yes'>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='model'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>tpm-tis</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>tpm-crb</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:       <enum name='backendModel'>
Oct 26 03:16:15 user nova-compute[74630]:         <value>passthrough</value>
Oct 26 03:16:15 user nova-compute[74630]:         <value>emulator</value>
Oct 26 03:16:15 user nova-compute[74630]:       </enum>
Oct 26 03:16:15 user nova-compute[74630]:     </tpm>
Oct 26 03:16:15 user nova-compute[74630]:   </devices>
Oct 26 03:16:15 user nova-compute[74630]:   <features>
Oct 26 03:16:15 user nova-compute[74630]:     <gic supported='no'/>
Oct 26 03:16:15 user nova-compute[74630]:     <vmcoreinfo supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <genid supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <backingStoreInput supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <backup supported='yes'/>
Oct 26 03:16:15 user nova-compute[74630]:     <sev supported='no'/>
Oct 26 03:16:15 user nova-compute[74630]:   </features>
Oct 26 03:16:15 user nova-compute[74630]: </domainCapabilities>
Oct 26 03:16:15 user nova-compute[74630]:  {{(pid=74630) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74630) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74630) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Checking secure boot support for host arch (x86_64) {{(pid=74630) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Checking secure boot support for host arch (x86_64) {{(pid=74630) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Checking secure boot support for host arch (x86_64) {{(pid=74630) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 26 03:16:15 user nova-compute[74630]: INFO nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Secure Boot support detected
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] cpu compare xml: <cpu match="exact">
Oct 26 03:16:15 user nova-compute[74630]:   <model>Nehalem</model>
Oct 26 03:16:15 user nova-compute[74630]: </cpu>
Oct 26 03:16:15 user nova-compute[74630]:  {{(pid=74630) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 26 03:16:15 user nova-compute[74630]: INFO nova.virt.node [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Generated node identity 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5
Oct 26 03:16:15 user nova-compute[74630]: INFO nova.virt.node [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Wrote node identity 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 to /opt/stack/data/nova/compute_id
Oct 26 03:16:15 user nova-compute[74630]: WARNING nova.compute.manager [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Compute nodes ['2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 26 03:16:15 user nova-compute[74630]: INFO nova.compute.manager [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 26 03:16:15 user nova-compute[74630]: WARNING nova.compute.manager [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 26 03:16:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:16:15 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:16:15 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Hypervisor/Node resource view: name=user free_ram=10949MB free_disk=26.10285186767578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:16:15 user nova-compute[74630]: WARNING nova.compute.resource_tracker [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] No compute node record for user:2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 could not be found.
Oct 26 03:16:15 user nova-compute[74630]: INFO nova.compute.resource_tracker [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Compute node record created for user:user with uuid: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:16:15 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] [req-3be3eb3c-0575-4d9b-b82c-501c64b73d9d] Created resource provider record via placement API for resource provider with UUID 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 and name user.
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74630) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 26 03:16:15 user nova-compute[74630]: INFO nova.virt.libvirt.host [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] kernel doesn't support AMD SEV
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Updating inventory in ProviderTree for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Libvirt baseline CPU <cpu>
Oct 26 03:16:15 user nova-compute[74630]:   <arch>x86_64</arch>
Oct 26 03:16:15 user nova-compute[74630]:   <model>Nehalem</model>
Oct 26 03:16:15 user nova-compute[74630]:   <vendor>Intel</vendor>
Oct 26 03:16:15 user nova-compute[74630]:   <topology sockets="6" cores="1" threads="1"/>
Oct 26 03:16:15 user nova-compute[74630]: </cpu>
Oct 26 03:16:15 user nova-compute[74630]:  {{(pid=74630) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Updated inventory for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Updating resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 generation from 0 to 1 during operation: update_inventory {{(pid=74630) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 26 03:16:15 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Updating inventory in ProviderTree for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 03:16:16 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Updating resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 generation from 1 to 2 during operation: update_traits {{(pid=74630) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 26 03:16:16 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:16:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:16:16 user nova-compute[74630]: DEBUG nova.service [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Creating RPC server for service compute {{(pid=74630) start /opt/stack/nova/nova/service.py:182}}
Oct 26 03:16:16 user nova-compute[74630]: DEBUG nova.service [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] Join ServiceGroup membership for this service compute {{(pid=74630) start /opt/stack/nova/nova/service.py:199}}
Oct 26 03:16:16 user nova-compute[74630]: DEBUG nova.servicegroup.drivers.db [None req-d98d7d7b-9402-4775-a587-2fad915700ad None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74630) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 26 03:16:29 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:16:29 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:17:07 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:17:07 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:17:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=10371MB free_disk=26.006568908691406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:17:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:18:07 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:18:07 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:18:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=10308MB free_disk=26.07076644897461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:18:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:18:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:18:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:18:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:18:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:19:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:19:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:19:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:19:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:19:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:19:07 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:19:07 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:19:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=10300MB free_disk=25.824359893798828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:19:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:19:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:19:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:19:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:19:07 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:19:07 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:19:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:19:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:19:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:19:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:19:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:19:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:19:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:19:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 03:19:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:19:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:19:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:19:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:19:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:19:11 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:20:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:20:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:20:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:20:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:20:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:20:09 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:09 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=9576MB free_disk=25.844341278076172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:20:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:20:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:20:09 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:20:09 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:20:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:20:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:10 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:20:10 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:20:10 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:20:10 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 03:20:10 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:20:10 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:20:11 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:20:11 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:20:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:20:12 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:20:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "fa1dd816-9dc1-4d48-b608-aa0218f22369" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:20:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:16 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:20:16 user nova-compute[74630]: INFO nova.compute.claims [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Claim successful on node user
Oct 26 03:20:16 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:20:16 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:20:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:16 user nova-compute[74630]: DEBUG nova.compute.manager [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:20:16 user nova-compute[74630]: DEBUG nova.compute.manager [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:20:16 user nova-compute[74630]: DEBUG nova.network.neutron [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:20:16 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:20:16 user nova-compute[74630]: DEBUG nova.compute.manager [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:20:16 user nova-compute[74630]: DEBUG nova.compute.manager [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:20:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:20:16 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Creating image(s)
Oct 26 03:20:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "/opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "/opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b.part --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG nova.policy [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8694c5db6e34f1e88595b55f8e5fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e396316ddc243c594c29f5c434501cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Acquiring lock "82be4c02-7dbe-4ed7-af19-e4da1855065d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b.part --force-share --output=json" returned: 0 in 0.231s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG nova.virt.images [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] 8519fea8-ccda-4565-9023-82b90e4bb746 was qcow2, converting to raw {{(pid=74630) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b.part /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b.converted {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:20:17 user nova-compute[74630]: INFO nova.compute.claims [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Claim successful on node user
Oct 26 03:20:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b.part /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b.converted" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b.converted --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b.converted --force-share --output=json" returned: 0 in 0.263s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.126s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:17 user nova-compute[74630]: INFO oslo.privsep.daemon [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp7kk5kfhe/privsep.sock']
Oct 26 03:20:17 user sudo[83887]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp7kk5kfhe/privsep.sock
Oct 26 03:20:17 user sudo[83887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 03:20:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.403s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:20:18 user nova-compute[74630]: INFO nova.compute.claims [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Claim successful on node user
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.network.neutron [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "32264781-acf7-4afa-830a-5469b6a4c744" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:20:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Creating image(s)
Oct 26 03:20:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Acquiring lock "/opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "/opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "/opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.policy [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6a5a26bca1143e69720627d76b6e15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d9b74567e04da0b94a1077f1b57bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.145s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:20:18 user nova-compute[74630]: INFO nova.compute.claims [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Claim successful on node user
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:20:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:20:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:20:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Creating image(s)
Oct 26 03:20:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "/opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "/opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "/opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:18 user nova-compute[74630]: DEBUG nova.policy [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3f70e566f1b46b8bd4131758921f49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2fa2469fb44a7ea42666b7ba4eab31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.network.neutron [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Successfully created port: 2f8d8a99-3185-41a0-b8a2-85b0c4d22003 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.750s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.641s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:20:19 user nova-compute[74630]: INFO nova.compute.claims [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Claim successful on node user
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.network.neutron [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:20:19 user sudo[83887]: pam_unix(sudo:session): session closed for user root
Oct 26 03:20:19 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:20:19 user nova-compute[74630]: INFO oslo.privsep.daemon [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Spawned new privsep daemon via rootwrap
Oct 26 03:20:19 user nova-compute[74630]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 03:20:19 user nova-compute[74630]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 03:20:19 user nova-compute[74630]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 26 03:20:19 user nova-compute[74630]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83892
Oct 26 03:20:19 user nova-compute[74630]: WARNING oslo_privsep.priv_context [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] privsep daemon already running
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:20:19 user nova-compute[74630]: WARNING oslo_privsep.priv_context [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] privsep daemon already running
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:20:19 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Creating image(s)
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "/opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "/opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "/opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.policy [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62370747d10a420b81009d23e3ba324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b652c6f02780451b89d51d74178bf6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.212s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.228s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.223s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.213s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:19 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.205s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk 1073741824" returned: 0 in 0.077s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.283s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:20:20 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Creating image(s)
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "/opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "/opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "/opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:20:20 user nova-compute[74630]: INFO nova.compute.claims [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Claim successful on node user
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.213s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.212s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk 1073741824" returned: 0 in 0.050s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.524s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Cannot resize image /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Ensure instance console log exists: /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.policy [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e27a2c56890d4be0a3fb46bd748fa7cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03fc5bdbf0b947b49f6a6c8d44630ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.network.neutron [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Successfully created port: 2722ab74-ccfd-44dc-ba27-6a2b98375ef8 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.205s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk 1073741824" returned: 0 in 0.043s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.819s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.615s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Cannot resize image /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Ensure instance console log exists: /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.network.neutron [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.193s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Checking if we can resize image /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:20 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk 1073741824" returned: 0 in 0.099s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.683s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Cannot resize image /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Ensure instance console log exists: /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "f9890dde-e678-41d4-8447-24bf626c2983" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f9890dde-e678-41d4-8447-24bf626c2983" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:20:21 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Creating image(s)
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "/opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "/opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "/opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.compute.manager [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.223s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.224s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Successfully created port: bea61e08-ab64-488a-bd39-88fd0649d434 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk 1073741824" returned: 0 in 0.050s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.policy [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62370747d10a420b81009d23e3ba324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b652c6f02780451b89d51d74178bf6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.205s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:20:21 user nova-compute[74630]: INFO nova.compute.claims [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Claim successful on node user
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Cannot resize image /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Ensure instance console log exists: /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.network.neutron [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Successfully updated port: 2f8d8a99-3185-41a0-b8a2-85b0c4d22003 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.303s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.243s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "refresh_cache-fa1dd816-9dc1-4d48-b608-aa0218f22369" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquired lock "refresh_cache-fa1dd816-9dc1-4d48-b608-aa0218f22369" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.network.neutron [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Cannot resize image /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Ensure instance console log exists: /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk 1073741824" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.452s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.178s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.network.neutron [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-1981d496-f66e-458d-afcb-12dad1e39383 req-1f655224-d567-4797-b21e-d29ee7cc256e service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Received event network-changed-2f8d8a99-3185-41a0-b8a2-85b0c4d22003 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-1981d496-f66e-458d-afcb-12dad1e39383 req-1f655224-d567-4797-b21e-d29ee7cc256e service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Refreshing instance network info cache due to event network-changed-2f8d8a99-3185-41a0-b8a2-85b0c4d22003. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1981d496-f66e-458d-afcb-12dad1e39383 req-1f655224-d567-4797-b21e-d29ee7cc256e service nova] Acquiring lock "refresh_cache-fa1dd816-9dc1-4d48-b608-aa0218f22369" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.806s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Cannot resize image /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Ensure instance console log exists: /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.network.neutron [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Successfully created port: 13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.network.neutron [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:20:22 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:20:22 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Creating image(s)
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "/opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "/opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.170s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG nova.policy [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a419737713f4797ab27db62d5aa746c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51542ffdf7a84ac5a61f14e124eb2087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk 1073741824" returned: 0 in 0.046s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.network.neutron [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Updating instance_info_cache with network_info: [{"id": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "address": "fa:16:3e:27:88:e1", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8d8a99-31", "ovs_interfaceid": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Releasing lock "refresh_cache-fa1dd816-9dc1-4d48-b608-aa0218f22369" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.compute.manager [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Instance network_info: |[{"id": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "address": "fa:16:3e:27:88:e1", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8d8a99-31", "ovs_interfaceid": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1981d496-f66e-458d-afcb-12dad1e39383 req-1f655224-d567-4797-b21e-d29ee7cc256e service nova] Acquired lock "refresh_cache-fa1dd816-9dc1-4d48-b608-aa0218f22369" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.network.neutron [req-1981d496-f66e-458d-afcb-12dad1e39383 req-1f655224-d567-4797-b21e-d29ee7cc256e service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Refreshing network info cache for port 2f8d8a99-3185-41a0-b8a2-85b0c4d22003 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Start _get_guest_xml network_info=[{"id": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "address": "fa:16:3e:27:88:e1", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8d8a99-31", "ovs_interfaceid": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:20:23 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:23 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1294714524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1294714524',id=1,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e396316ddc243c594c29f5c434501cb',ramdisk_id='',reservation_id='r-iud0vxsh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:17Z,user_data=None,user_id='f8694c5db6e34f1e88595b55f8e5fe70',uuid=fa1dd816-9dc1-4d48-b608-aa0218f22369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "address": "fa:16:3e:27:88:e1", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8d8a99-31", "ovs_interfaceid": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converting VIF {"id": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "address": "fa:16:3e:27:88:e1", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8d8a99-31", "ovs_interfaceid": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:88:e1,bridge_name='br-int',has_traffic_filtering=True,id=2f8d8a99-3185-41a0-b8a2-85b0c4d22003,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8d8a99-31') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.objects.instance [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'pci_devices' on Instance uuid fa1dd816-9dc1-4d48-b608-aa0218f22369 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Cannot resize image /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Ensure instance console log exists: /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Successfully created port: b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:20:23 user nova-compute[74630]:   <uuid>fa1dd816-9dc1-4d48-b608-aa0218f22369</uuid>
Oct 26 03:20:23 user nova-compute[74630]:   <name>instance-00000001</name>
Oct 26 03:20:23 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:20:23 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:20:23 user nova-compute[74630]:   <metadata>
Oct 26 03:20:23 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:20:23 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:20:23 user nova-compute[74630]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1294714524</nova:name>
Oct 26 03:20:23 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:20:23</nova:creationTime>
Oct 26 03:20:23 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:20:23 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:20:23 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:20:23 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:20:23 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:20:23 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:20:23 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:20:23 user nova-compute[74630]:       <nova:owner>
Oct 26 03:20:23 user nova-compute[74630]:         <nova:user uuid="f8694c5db6e34f1e88595b55f8e5fe70">tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member</nova:user>
Oct 26 03:20:23 user nova-compute[74630]:         <nova:project uuid="1e396316ddc243c594c29f5c434501cb">tempest-ServerBootFromVolumeStableRescueTest-1296515996</nova:project>
Oct 26 03:20:23 user nova-compute[74630]:       </nova:owner>
Oct 26 03:20:23 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:20:23 user nova-compute[74630]:       <nova:ports>
Oct 26 03:20:23 user nova-compute[74630]:         <nova:port uuid="2f8d8a99-3185-41a0-b8a2-85b0c4d22003">
Oct 26 03:20:23 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 03:20:23 user nova-compute[74630]:         </nova:port>
Oct 26 03:20:23 user nova-compute[74630]:       </nova:ports>
Oct 26 03:20:23 user nova-compute[74630]:     </nova:instance>
Oct 26 03:20:23 user nova-compute[74630]:   </metadata>
Oct 26 03:20:23 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:20:23 user nova-compute[74630]:     <system>
Oct 26 03:20:23 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:20:23 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:20:23 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:20:23 user nova-compute[74630]:       <entry name="serial">fa1dd816-9dc1-4d48-b608-aa0218f22369</entry>
Oct 26 03:20:23 user nova-compute[74630]:       <entry name="uuid">fa1dd816-9dc1-4d48-b608-aa0218f22369</entry>
Oct 26 03:20:23 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:20:23 user nova-compute[74630]:     </system>
Oct 26 03:20:23 user nova-compute[74630]:   </sysinfo>
Oct 26 03:20:23 user nova-compute[74630]:   <os>
Oct 26 03:20:23 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:20:23 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:20:23 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:20:23 user nova-compute[74630]:   </os>
Oct 26 03:20:23 user nova-compute[74630]:   <features>
Oct 26 03:20:23 user nova-compute[74630]:     <acpi/>
Oct 26 03:20:23 user nova-compute[74630]:     <apic/>
Oct 26 03:20:23 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:20:23 user nova-compute[74630]:   </features>
Oct 26 03:20:23 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:20:23 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:20:23 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:20:23 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:20:23 user nova-compute[74630]:   </clock>
Oct 26 03:20:23 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:20:23 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:20:23 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:20:23 user nova-compute[74630]:   </cpu>
Oct 26 03:20:23 user nova-compute[74630]:   <devices>
Oct 26 03:20:23 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:20:23 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:20:23 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk"/>
Oct 26 03:20:23 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:20:23 user nova-compute[74630]:     </disk>
Oct 26 03:20:23 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:20:23 user nova-compute[74630]:       <mac address="fa:16:3e:27:88:e1"/>
Oct 26 03:20:23 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:23 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:20:23 user nova-compute[74630]:       <target dev="tap2f8d8a99-31"/>
Oct 26 03:20:23 user nova-compute[74630]:     </interface>
Oct 26 03:20:23 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:20:23 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/console.log" append="off"/>
Oct 26 03:20:23 user nova-compute[74630]:     </serial>
Oct 26 03:20:23 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:20:23 user nova-compute[74630]:     <video>
Oct 26 03:20:23 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:23 user nova-compute[74630]:     </video>
Oct 26 03:20:23 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:20:23 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:20:23 user nova-compute[74630]:     </rng>
Oct 26 03:20:23 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:20:23 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:20:23 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:20:23 user nova-compute[74630]:     </memballoon>
Oct 26 03:20:23 user nova-compute[74630]:   </devices>
Oct 26 03:20:23 user nova-compute[74630]: </domain>
Oct 26 03:20:23 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1294714524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1294714524',id=1,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e396316ddc243c594c29f5c434501cb',ramdisk_id='',reservation_id='r-iud0vxsh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:17Z,user_data=None,user_id='f8694c5db6e34f1e88595b55f8e5fe70',uuid=fa1dd816-9dc1-4d48-b608-aa0218f22369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "address": "fa:16:3e:27:88:e1", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8d8a99-31", "ovs_interfaceid": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converting VIF {"id": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "address": "fa:16:3e:27:88:e1", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8d8a99-31", "ovs_interfaceid": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:88:e1,bridge_name='br-int',has_traffic_filtering=True,id=2f8d8a99-3185-41a0-b8a2-85b0c4d22003,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8d8a99-31') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG os_vif [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:88:e1,bridge_name='br-int',has_traffic_filtering=True,id=2f8d8a99-3185-41a0-b8a2-85b0c4d22003,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8d8a99-31') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.network.neutron [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Successfully updated port: 2722ab74-ccfd-44dc-ba27-6a2b98375ef8 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Created schema index Interface.name {{(pid=74630) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Created schema index Port.name {{(pid=74630) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Created schema index Bridge.name {{(pid=74630) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [POLLOUT] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Acquiring lock "refresh_cache-82be4c02-7dbe-4ed7-af19-e4da1855065d" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Acquired lock "refresh_cache-82be4c02-7dbe-4ed7-af19-e4da1855065d" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.network.neutron [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '851a6935-4ecc-5468-8f60-78fc67624ea9', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.network.neutron [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Successfully created port: 853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:23 user nova-compute[74630]: INFO oslo.privsep.daemon [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpsgq_k6gm/privsep.sock']
Oct 26 03:20:23 user sudo[84007]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpsgq_k6gm/privsep.sock
Oct 26 03:20:23 user sudo[84007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-dec1f4cf-d34c-45db-aea7-7ac0142cffde req-ca0456c7-ccb6-4f74-b423-ae2da063e168 service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Received event network-changed-2722ab74-ccfd-44dc-ba27-6a2b98375ef8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-dec1f4cf-d34c-45db-aea7-7ac0142cffde req-ca0456c7-ccb6-4f74-b423-ae2da063e168 service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Refreshing instance network info cache due to event network-changed-2722ab74-ccfd-44dc-ba27-6a2b98375ef8. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dec1f4cf-d34c-45db-aea7-7ac0142cffde req-ca0456c7-ccb6-4f74-b423-ae2da063e168 service nova] Acquiring lock "refresh_cache-82be4c02-7dbe-4ed7-af19-e4da1855065d" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG nova.network.neutron [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:20:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.network.neutron [req-1981d496-f66e-458d-afcb-12dad1e39383 req-1f655224-d567-4797-b21e-d29ee7cc256e service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Updated VIF entry in instance network info cache for port 2f8d8a99-3185-41a0-b8a2-85b0c4d22003. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.network.neutron [req-1981d496-f66e-458d-afcb-12dad1e39383 req-1f655224-d567-4797-b21e-d29ee7cc256e service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Updating instance_info_cache with network_info: [{"id": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "address": "fa:16:3e:27:88:e1", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8d8a99-31", "ovs_interfaceid": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1981d496-f66e-458d-afcb-12dad1e39383 req-1f655224-d567-4797-b21e-d29ee7cc256e service nova] Releasing lock "refresh_cache-fa1dd816-9dc1-4d48-b608-aa0218f22369" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.network.neutron [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Updating instance_info_cache with network_info: [{"id": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "address": "fa:16:3e:bd:b3:80", "network": {"id": "cc606e10-c5b0-4275-b289-4bcd2eca1b85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-218412921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2d9b74567e04da0b94a1077f1b57bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2722ab74-cc", "ovs_interfaceid": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Successfully updated port: bea61e08-ab64-488a-bd39-88fd0649d434 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Releasing lock "refresh_cache-82be4c02-7dbe-4ed7-af19-e4da1855065d" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Instance network_info: |[{"id": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "address": "fa:16:3e:bd:b3:80", "network": {"id": "cc606e10-c5b0-4275-b289-4bcd2eca1b85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-218412921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2d9b74567e04da0b94a1077f1b57bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2722ab74-cc", "ovs_interfaceid": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dec1f4cf-d34c-45db-aea7-7ac0142cffde req-ca0456c7-ccb6-4f74-b423-ae2da063e168 service nova] Acquired lock "refresh_cache-82be4c02-7dbe-4ed7-af19-e4da1855065d" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.network.neutron [req-dec1f4cf-d34c-45db-aea7-7ac0142cffde req-ca0456c7-ccb6-4f74-b423-ae2da063e168 service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Refreshing network info cache for port 2722ab74-ccfd-44dc-ba27-6a2b98375ef8 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Start _get_guest_xml network_info=[{"id": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "address": "fa:16:3e:bd:b3:80", "network": {"id": "cc606e10-c5b0-4275-b289-4bcd2eca1b85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-218412921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2d9b74567e04da0b94a1077f1b57bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2722ab74-cc", "ovs_interfaceid": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:20:24 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:24 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "refresh_cache-747e596d-d9b3-4af2-be42-0fd494b6ef9a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquired lock "refresh_cache-747e596d-d9b3-4af2-be42-0fd494b6ef9a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-101769242',display_name='tempest-DeleteServersTestJSON-server-101769242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-101769242',id=2,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2d9b74567e04da0b94a1077f1b57bb8',ramdisk_id='',reservation_id='r-eah67v4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1244515193',owner_user_name='tempest-DeleteServersTestJSON-1244515193-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:18Z,user_data=None,user_id='b6a5a26bca1143e69720627d76b6e15a',uuid=82be4c02-7dbe-4ed7-af19-e4da1855065d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "address": "fa:16:3e:bd:b3:80", "network": {"id": "cc606e10-c5b0-4275-b289-4bcd2eca1b85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-218412921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2d9b74567e04da0b94a1077f1b57bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2722ab74-cc", "ovs_interfaceid": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Converting VIF {"id": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "address": "fa:16:3e:bd:b3:80", "network": {"id": "cc606e10-c5b0-4275-b289-4bcd2eca1b85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-218412921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2d9b74567e04da0b94a1077f1b57bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2722ab74-cc", "ovs_interfaceid": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b3:80,bridge_name='br-int',has_traffic_filtering=True,id=2722ab74-ccfd-44dc-ba27-6a2b98375ef8,network=Network(cc606e10-c5b0-4275-b289-4bcd2eca1b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2722ab74-cc') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lazy-loading 'pci_devices' on Instance uuid 82be4c02-7dbe-4ed7-af19-e4da1855065d {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:20:24 user nova-compute[74630]:   <uuid>82be4c02-7dbe-4ed7-af19-e4da1855065d</uuid>
Oct 26 03:20:24 user nova-compute[74630]:   <name>instance-00000002</name>
Oct 26 03:20:24 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:20:24 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:20:24 user nova-compute[74630]:   <metadata>
Oct 26 03:20:24 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:20:24 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:20:24 user nova-compute[74630]:       <nova:name>tempest-DeleteServersTestJSON-server-101769242</nova:name>
Oct 26 03:20:24 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:20:24</nova:creationTime>
Oct 26 03:20:24 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:20:24 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:20:24 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:20:24 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:20:24 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:20:24 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:20:24 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:20:24 user nova-compute[74630]:       <nova:owner>
Oct 26 03:20:24 user nova-compute[74630]:         <nova:user uuid="b6a5a26bca1143e69720627d76b6e15a">tempest-DeleteServersTestJSON-1244515193-project-member</nova:user>
Oct 26 03:20:24 user nova-compute[74630]:         <nova:project uuid="a2d9b74567e04da0b94a1077f1b57bb8">tempest-DeleteServersTestJSON-1244515193</nova:project>
Oct 26 03:20:24 user nova-compute[74630]:       </nova:owner>
Oct 26 03:20:24 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:20:24 user nova-compute[74630]:       <nova:ports>
Oct 26 03:20:24 user nova-compute[74630]:         <nova:port uuid="2722ab74-ccfd-44dc-ba27-6a2b98375ef8">
Oct 26 03:20:24 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 03:20:24 user nova-compute[74630]:         </nova:port>
Oct 26 03:20:24 user nova-compute[74630]:       </nova:ports>
Oct 26 03:20:24 user nova-compute[74630]:     </nova:instance>
Oct 26 03:20:24 user nova-compute[74630]:   </metadata>
Oct 26 03:20:24 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:20:24 user nova-compute[74630]:     <system>
Oct 26 03:20:24 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:20:24 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:20:24 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:20:24 user nova-compute[74630]:       <entry name="serial">82be4c02-7dbe-4ed7-af19-e4da1855065d</entry>
Oct 26 03:20:24 user nova-compute[74630]:       <entry name="uuid">82be4c02-7dbe-4ed7-af19-e4da1855065d</entry>
Oct 26 03:20:24 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:20:24 user nova-compute[74630]:     </system>
Oct 26 03:20:24 user nova-compute[74630]:   </sysinfo>
Oct 26 03:20:24 user nova-compute[74630]:   <os>
Oct 26 03:20:24 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:20:24 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:20:24 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:20:24 user nova-compute[74630]:   </os>
Oct 26 03:20:24 user nova-compute[74630]:   <features>
Oct 26 03:20:24 user nova-compute[74630]:     <acpi/>
Oct 26 03:20:24 user nova-compute[74630]:     <apic/>
Oct 26 03:20:24 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:20:24 user nova-compute[74630]:   </features>
Oct 26 03:20:24 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:20:24 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:20:24 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:20:24 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:20:24 user nova-compute[74630]:   </clock>
Oct 26 03:20:24 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:20:24 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:20:24 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:20:24 user nova-compute[74630]:   </cpu>
Oct 26 03:20:24 user nova-compute[74630]:   <devices>
Oct 26 03:20:24 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:20:24 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:20:24 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk"/>
Oct 26 03:20:24 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:20:24 user nova-compute[74630]:     </disk>
Oct 26 03:20:24 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:20:24 user nova-compute[74630]:       <mac address="fa:16:3e:bd:b3:80"/>
Oct 26 03:20:24 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:24 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:20:24 user nova-compute[74630]:       <target dev="tap2722ab74-cc"/>
Oct 26 03:20:24 user nova-compute[74630]:     </interface>
Oct 26 03:20:24 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:20:24 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/console.log" append="off"/>
Oct 26 03:20:24 user nova-compute[74630]:     </serial>
Oct 26 03:20:24 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:20:24 user nova-compute[74630]:     <video>
Oct 26 03:20:24 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:24 user nova-compute[74630]:     </video>
Oct 26 03:20:24 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:20:24 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:20:24 user nova-compute[74630]:     </rng>
Oct 26 03:20:24 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:20:24 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:20:24 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:20:24 user nova-compute[74630]:     </memballoon>
Oct 26 03:20:24 user nova-compute[74630]:   </devices>
Oct 26 03:20:24 user nova-compute[74630]: </domain>
Oct 26 03:20:24 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-101769242',display_name='tempest-DeleteServersTestJSON-server-101769242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-101769242',id=2,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2d9b74567e04da0b94a1077f1b57bb8',ramdisk_id='',reservation_id='r-eah67v4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1244515193',owner_user_name='tempest-DeleteServersTestJSON-1244515193-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:18Z,user_data=None,user_id='b6a5a26bca1143e69720627d76b6e15a',uuid=82be4c02-7dbe-4ed7-af19-e4da1855065d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "address": "fa:16:3e:bd:b3:80", "network": {"id": "cc606e10-c5b0-4275-b289-4bcd2eca1b85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-218412921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2d9b74567e04da0b94a1077f1b57bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2722ab74-cc", "ovs_interfaceid": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Converting VIF {"id": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "address": "fa:16:3e:bd:b3:80", "network": {"id": "cc606e10-c5b0-4275-b289-4bcd2eca1b85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-218412921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2d9b74567e04da0b94a1077f1b57bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2722ab74-cc", "ovs_interfaceid": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b3:80,bridge_name='br-int',has_traffic_filtering=True,id=2722ab74-ccfd-44dc-ba27-6a2b98375ef8,network=Network(cc606e10-c5b0-4275-b289-4bcd2eca1b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2722ab74-cc') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG os_vif [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b3:80,bridge_name='br-int',has_traffic_filtering=True,id=2722ab74-ccfd-44dc-ba27-6a2b98375ef8,network=Network(cc606e10-c5b0-4275-b289-4bcd2eca1b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2722ab74-cc') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c36b1d55-9b64-5ff1-84a6-8acf0bd02090', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:24 user sudo[84007]: pam_unix(sudo:session): session closed for user root
Oct 26 03:20:24 user nova-compute[74630]: INFO oslo.privsep.daemon [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Spawned new privsep daemon via rootwrap
Oct 26 03:20:24 user nova-compute[74630]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 03:20:24 user nova-compute[74630]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 03:20:24 user nova-compute[74630]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 26 03:20:24 user nova-compute[74630]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84010
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.compute.manager [req-f44eb565-7537-4682-be21-9a055b803e69 req-5b51b22b-bdf7-48d2-88d9-2d9738199599 service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Received event network-changed-bea61e08-ab64-488a-bd39-88fd0649d434 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG nova.compute.manager [req-f44eb565-7537-4682-be21-9a055b803e69 req-5b51b22b-bdf7-48d2-88d9-2d9738199599 service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Refreshing instance network info cache due to event network-changed-bea61e08-ab64-488a-bd39-88fd0649d434. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:20:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f44eb565-7537-4682-be21-9a055b803e69 req-5b51b22b-bdf7-48d2-88d9-2d9738199599 service nova] Acquiring lock "refresh_cache-747e596d-d9b3-4af2-be42-0fd494b6ef9a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG nova.network.neutron [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Successfully created port: 8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:20:25 user nova-compute[74630]: WARNING oslo_privsep.priv_context [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] privsep daemon already running
Oct 26 03:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2722ab74-cc, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2722ab74-cc, col_values=(('qos', UUID('57f53a74-59ab-407f-88a9-55c311511602')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2722ab74-cc, col_values=(('external_ids', {'iface-id': '2722ab74-ccfd-44dc-ba27-6a2b98375ef8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:b3:80', 'vm-uuid': '82be4c02-7dbe-4ed7-af19-e4da1855065d'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:25 user nova-compute[74630]: INFO os_vif [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b3:80,bridge_name='br-int',has_traffic_filtering=True,id=2722ab74-ccfd-44dc-ba27-6a2b98375ef8,network=Network(cc606e10-c5b0-4275-b289-4bcd2eca1b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2722ab74-cc')
Oct 26 03:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f8d8a99-31, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f8d8a99-31, col_values=(('qos', UUID('87b37f6e-a52d-4693-8a53-d7e99f63122c')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f8d8a99-31, col_values=(('external_ids', {'iface-id': '2f8d8a99-3185-41a0-b8a2-85b0c4d22003', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:88:e1', 'vm-uuid': 'fa1dd816-9dc1-4d48-b608-aa0218f22369'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG nova.network.neutron [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Successfully updated port: 13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:20:25 user nova-compute[74630]: INFO os_vif [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:88:e1,bridge_name='br-int',has_traffic_filtering=True,id=2f8d8a99-3185-41a0-b8a2-85b0c4d22003,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8d8a99-31')
Oct 26 03:20:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquired lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG nova.network.neutron [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] No VIF found with MAC fa:16:3e:bd:b3:80, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] No VIF found with MAC fa:16:3e:27:88:e1, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG nova.network.neutron [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Updating instance_info_cache with network_info: [{"id": "bea61e08-ab64-488a-bd39-88fd0649d434", "address": "fa:16:3e:01:c5:87", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea61e08-ab", "ovs_interfaceid": "bea61e08-ab64-488a-bd39-88fd0649d434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Releasing lock "refresh_cache-747e596d-d9b3-4af2-be42-0fd494b6ef9a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Instance network_info: |[{"id": "bea61e08-ab64-488a-bd39-88fd0649d434", "address": "fa:16:3e:01:c5:87", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea61e08-ab", "ovs_interfaceid": "bea61e08-ab64-488a-bd39-88fd0649d434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f44eb565-7537-4682-be21-9a055b803e69 req-5b51b22b-bdf7-48d2-88d9-2d9738199599 service nova] Acquired lock "refresh_cache-747e596d-d9b3-4af2-be42-0fd494b6ef9a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.neutron [req-f44eb565-7537-4682-be21-9a055b803e69 req-5b51b22b-bdf7-48d2-88d9-2d9738199599 service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Refreshing network info cache for port bea61e08-ab64-488a-bd39-88fd0649d434 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Start _get_guest_xml network_info=[{"id": "bea61e08-ab64-488a-bd39-88fd0649d434", "address": "fa:16:3e:01:c5:87", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea61e08-ab", "ovs_interfaceid": "bea61e08-ab64-488a-bd39-88fd0649d434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.neutron [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Successfully updated port: 853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:20:26 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:26 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "refresh_cache-7918e3bc-c44b-4be3-871d-e06eb3fd7d49" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquired lock "refresh_cache-7918e3bc-c44b-4be3-871d-e06eb3fd7d49" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.neutron [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1973172059',display_name='tempest-ServersNegativeTestJSON-server-1973172059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1973172059',id=3,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb2fa2469fb44a7ea42666b7ba4eab31',ramdisk_id='',reservation_id='r-079qbhux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-939634393',owner_user_name='tempest-ServersNegativeTestJSON-939634393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:19Z,user_data=None,user_id='e3f70e566f1b46b8bd4131758921f49a',uuid=747e596d-d9b3-4af2-be42-0fd494b6ef9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bea61e08-ab64-488a-bd39-88fd0649d434", "address": "fa:16:3e:01:c5:87", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea61e08-ab", "ovs_interfaceid": "bea61e08-ab64-488a-bd39-88fd0649d434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Converting VIF {"id": "bea61e08-ab64-488a-bd39-88fd0649d434", "address": "fa:16:3e:01:c5:87", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea61e08-ab", "ovs_interfaceid": "bea61e08-ab64-488a-bd39-88fd0649d434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:c5:87,bridge_name='br-int',has_traffic_filtering=True,id=bea61e08-ab64-488a-bd39-88fd0649d434,network=Network(0c987002-6658-42a0-afe5-c0d349e73477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbea61e08-ab') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lazy-loading 'pci_devices' on Instance uuid 747e596d-d9b3-4af2-be42-0fd494b6ef9a {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.compute.manager [req-7dd1f783-b7e4-4ea5-aa47-8219f4d9604a req-26377fdb-cf9f-4b5c-8d69-4f90bd9b28c9 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received event network-changed-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.compute.manager [req-7dd1f783-b7e4-4ea5-aa47-8219f4d9604a req-26377fdb-cf9f-4b5c-8d69-4f90bd9b28c9 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Refreshing instance network info cache due to event network-changed-853efb6c-3553-4889-a1fb-b0ede74757b7. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7dd1f783-b7e4-4ea5-aa47-8219f4d9604a req-26377fdb-cf9f-4b5c-8d69-4f90bd9b28c9 service nova] Acquiring lock "refresh_cache-7918e3bc-c44b-4be3-871d-e06eb3fd7d49" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:20:26 user nova-compute[74630]:   <uuid>747e596d-d9b3-4af2-be42-0fd494b6ef9a</uuid>
Oct 26 03:20:26 user nova-compute[74630]:   <name>instance-00000003</name>
Oct 26 03:20:26 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:20:26 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:20:26 user nova-compute[74630]:   <metadata>
Oct 26 03:20:26 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:20:26 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:20:26 user nova-compute[74630]:       <nova:name>tempest-ServersNegativeTestJSON-server-1973172059</nova:name>
Oct 26 03:20:26 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:20:26</nova:creationTime>
Oct 26 03:20:26 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:20:26 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:20:26 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:20:26 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:20:26 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:20:26 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:20:26 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:20:26 user nova-compute[74630]:       <nova:owner>
Oct 26 03:20:26 user nova-compute[74630]:         <nova:user uuid="e3f70e566f1b46b8bd4131758921f49a">tempest-ServersNegativeTestJSON-939634393-project-member</nova:user>
Oct 26 03:20:26 user nova-compute[74630]:         <nova:project uuid="cb2fa2469fb44a7ea42666b7ba4eab31">tempest-ServersNegativeTestJSON-939634393</nova:project>
Oct 26 03:20:26 user nova-compute[74630]:       </nova:owner>
Oct 26 03:20:26 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:20:26 user nova-compute[74630]:       <nova:ports>
Oct 26 03:20:26 user nova-compute[74630]:         <nova:port uuid="bea61e08-ab64-488a-bd39-88fd0649d434">
Oct 26 03:20:26 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 03:20:26 user nova-compute[74630]:         </nova:port>
Oct 26 03:20:26 user nova-compute[74630]:       </nova:ports>
Oct 26 03:20:26 user nova-compute[74630]:     </nova:instance>
Oct 26 03:20:26 user nova-compute[74630]:   </metadata>
Oct 26 03:20:26 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:20:26 user nova-compute[74630]:     <system>
Oct 26 03:20:26 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:20:26 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:20:26 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:20:26 user nova-compute[74630]:       <entry name="serial">747e596d-d9b3-4af2-be42-0fd494b6ef9a</entry>
Oct 26 03:20:26 user nova-compute[74630]:       <entry name="uuid">747e596d-d9b3-4af2-be42-0fd494b6ef9a</entry>
Oct 26 03:20:26 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:20:26 user nova-compute[74630]:     </system>
Oct 26 03:20:26 user nova-compute[74630]:   </sysinfo>
Oct 26 03:20:26 user nova-compute[74630]:   <os>
Oct 26 03:20:26 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:20:26 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:20:26 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:20:26 user nova-compute[74630]:   </os>
Oct 26 03:20:26 user nova-compute[74630]:   <features>
Oct 26 03:20:26 user nova-compute[74630]:     <acpi/>
Oct 26 03:20:26 user nova-compute[74630]:     <apic/>
Oct 26 03:20:26 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:20:26 user nova-compute[74630]:   </features>
Oct 26 03:20:26 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:20:26 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:20:26 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:20:26 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:20:26 user nova-compute[74630]:   </clock>
Oct 26 03:20:26 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:20:26 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:20:26 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:20:26 user nova-compute[74630]:   </cpu>
Oct 26 03:20:26 user nova-compute[74630]:   <devices>
Oct 26 03:20:26 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:20:26 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:20:26 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk"/>
Oct 26 03:20:26 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:20:26 user nova-compute[74630]:     </disk>
Oct 26 03:20:26 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:20:26 user nova-compute[74630]:       <mac address="fa:16:3e:01:c5:87"/>
Oct 26 03:20:26 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:26 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:20:26 user nova-compute[74630]:       <target dev="tapbea61e08-ab"/>
Oct 26 03:20:26 user nova-compute[74630]:     </interface>
Oct 26 03:20:26 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:20:26 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/console.log" append="off"/>
Oct 26 03:20:26 user nova-compute[74630]:     </serial>
Oct 26 03:20:26 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:20:26 user nova-compute[74630]:     <video>
Oct 26 03:20:26 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:26 user nova-compute[74630]:     </video>
Oct 26 03:20:26 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:20:26 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:20:26 user nova-compute[74630]:     </rng>
Oct 26 03:20:26 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:20:26 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:20:26 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:20:26 user nova-compute[74630]:     </memballoon>
Oct 26 03:20:26 user nova-compute[74630]:   </devices>
Oct 26 03:20:26 user nova-compute[74630]: </domain>
Oct 26 03:20:26 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1973172059',display_name='tempest-ServersNegativeTestJSON-server-1973172059',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1973172059',id=3,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb2fa2469fb44a7ea42666b7ba4eab31',ramdisk_id='',reservation_id='r-079qbhux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-939634393',owner_user_name='tempest-ServersNegativeTestJSON-939634393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:19Z,user_data=None,user_id='e3f70e566f1b46b8bd4131758921f49a',uuid=747e596d-d9b3-4af2-be42-0fd494b6ef9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bea61e08-ab64-488a-bd39-88fd0649d434", "address": "fa:16:3e:01:c5:87", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea61e08-ab", "ovs_interfaceid": "bea61e08-ab64-488a-bd39-88fd0649d434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Converting VIF {"id": "bea61e08-ab64-488a-bd39-88fd0649d434", "address": "fa:16:3e:01:c5:87", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea61e08-ab", "ovs_interfaceid": "bea61e08-ab64-488a-bd39-88fd0649d434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:c5:87,bridge_name='br-int',has_traffic_filtering=True,id=bea61e08-ab64-488a-bd39-88fd0649d434,network=Network(0c987002-6658-42a0-afe5-c0d349e73477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbea61e08-ab') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG os_vif [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:c5:87,bridge_name='br-int',has_traffic_filtering=True,id=bea61e08-ab64-488a-bd39-88fd0649d434,network=Network(0c987002-6658-42a0-afe5-c0d349e73477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbea61e08-ab') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7334df88-9e80-51fe-bec9-9dd445790b2e', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbea61e08-ab, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbea61e08-ab, col_values=(('qos', UUID('e513905a-9dd2-44e0-9375-76064da0f4af')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbea61e08-ab, col_values=(('external_ids', {'iface-id': 'bea61e08-ab64-488a-bd39-88fd0649d434', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:c5:87', 'vm-uuid': '747e596d-d9b3-4af2-be42-0fd494b6ef9a'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: INFO os_vif [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:c5:87,bridge_name='br-int',has_traffic_filtering=True,id=bea61e08-ab64-488a-bd39-88fd0649d434,network=Network(0c987002-6658-42a0-afe5-c0d349e73477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbea61e08-ab')
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] No VIF found with MAC fa:16:3e:01:c5:87, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.neutron [req-dec1f4cf-d34c-45db-aea7-7ac0142cffde req-ca0456c7-ccb6-4f74-b423-ae2da063e168 service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Updated VIF entry in instance network info cache for port 2722ab74-ccfd-44dc-ba27-6a2b98375ef8. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.neutron [req-dec1f4cf-d34c-45db-aea7-7ac0142cffde req-ca0456c7-ccb6-4f74-b423-ae2da063e168 service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Updating instance_info_cache with network_info: [{"id": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "address": "fa:16:3e:bd:b3:80", "network": {"id": "cc606e10-c5b0-4275-b289-4bcd2eca1b85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-218412921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2d9b74567e04da0b94a1077f1b57bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2722ab74-cc", "ovs_interfaceid": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dec1f4cf-d34c-45db-aea7-7ac0142cffde req-ca0456c7-ccb6-4f74-b423-ae2da063e168 service nova] Releasing lock "refresh_cache-82be4c02-7dbe-4ed7-af19-e4da1855065d" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.neutron [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Successfully updated port: b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquired lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.neutron [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Updating instance_info_cache with network_info: [{"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Releasing lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.compute.manager [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Instance network_info: |[{"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Start _get_guest_xml network_info=[{"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:20:26 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:26 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1719517014',display_name='tempest-ServerRescueNegativeTestJSON-server-1719517014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1719517014',id=4,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b652c6f02780451b89d51d74178bf6c7',ramdisk_id='',reservation_id='r-q4jggfxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2117587238',owner_user_name='tempest-ServerRescueNegativeTestJSON-2117587238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:19Z,user_data=None,user_id='62370747d10a420b81009d23e3ba324b',uuid=32264781-acf7-4afa-830a-5469b6a4c744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converting VIF {"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:25:1b,bridge_name='br-int',has_traffic_filtering=True,id=13707b78-ccef-402c-9d27-d6897b1eacf3,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13707b78-cc') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.objects.instance [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'pci_devices' on Instance uuid 32264781-acf7-4afa-830a-5469b6a4c744 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:20:26 user nova-compute[74630]:   <uuid>32264781-acf7-4afa-830a-5469b6a4c744</uuid>
Oct 26 03:20:26 user nova-compute[74630]:   <name>instance-00000004</name>
Oct 26 03:20:26 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:20:26 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:20:26 user nova-compute[74630]:   <metadata>
Oct 26 03:20:26 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:20:26 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:20:26 user nova-compute[74630]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1719517014</nova:name>
Oct 26 03:20:26 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:20:26</nova:creationTime>
Oct 26 03:20:26 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:20:26 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:20:26 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:20:26 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:20:26 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:20:26 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:20:26 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:20:26 user nova-compute[74630]:       <nova:owner>
Oct 26 03:20:26 user nova-compute[74630]:         <nova:user uuid="62370747d10a420b81009d23e3ba324b">tempest-ServerRescueNegativeTestJSON-2117587238-project-member</nova:user>
Oct 26 03:20:26 user nova-compute[74630]:         <nova:project uuid="b652c6f02780451b89d51d74178bf6c7">tempest-ServerRescueNegativeTestJSON-2117587238</nova:project>
Oct 26 03:20:26 user nova-compute[74630]:       </nova:owner>
Oct 26 03:20:26 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:20:26 user nova-compute[74630]:       <nova:ports>
Oct 26 03:20:26 user nova-compute[74630]:         <nova:port uuid="13707b78-ccef-402c-9d27-d6897b1eacf3">
Oct 26 03:20:26 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 03:20:26 user nova-compute[74630]:         </nova:port>
Oct 26 03:20:26 user nova-compute[74630]:       </nova:ports>
Oct 26 03:20:26 user nova-compute[74630]:     </nova:instance>
Oct 26 03:20:26 user nova-compute[74630]:   </metadata>
Oct 26 03:20:26 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:20:26 user nova-compute[74630]:     <system>
Oct 26 03:20:26 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:20:26 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:20:26 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:20:26 user nova-compute[74630]:       <entry name="serial">32264781-acf7-4afa-830a-5469b6a4c744</entry>
Oct 26 03:20:26 user nova-compute[74630]:       <entry name="uuid">32264781-acf7-4afa-830a-5469b6a4c744</entry>
Oct 26 03:20:26 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:20:26 user nova-compute[74630]:     </system>
Oct 26 03:20:26 user nova-compute[74630]:   </sysinfo>
Oct 26 03:20:26 user nova-compute[74630]:   <os>
Oct 26 03:20:26 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:20:26 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:20:26 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:20:26 user nova-compute[74630]:   </os>
Oct 26 03:20:26 user nova-compute[74630]:   <features>
Oct 26 03:20:26 user nova-compute[74630]:     <acpi/>
Oct 26 03:20:26 user nova-compute[74630]:     <apic/>
Oct 26 03:20:26 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:20:26 user nova-compute[74630]:   </features>
Oct 26 03:20:26 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:20:26 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:20:26 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:20:26 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:20:26 user nova-compute[74630]:   </clock>
Oct 26 03:20:26 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:20:26 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:20:26 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:20:26 user nova-compute[74630]:   </cpu>
Oct 26 03:20:26 user nova-compute[74630]:   <devices>
Oct 26 03:20:26 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:20:26 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:20:26 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk"/>
Oct 26 03:20:26 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:20:26 user nova-compute[74630]:     </disk>
Oct 26 03:20:26 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:20:26 user nova-compute[74630]:       <mac address="fa:16:3e:3d:25:1b"/>
Oct 26 03:20:26 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:26 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:20:26 user nova-compute[74630]:       <target dev="tap13707b78-cc"/>
Oct 26 03:20:26 user nova-compute[74630]:     </interface>
Oct 26 03:20:26 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:20:26 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/console.log" append="off"/>
Oct 26 03:20:26 user nova-compute[74630]:     </serial>
Oct 26 03:20:26 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:20:26 user nova-compute[74630]:     <video>
Oct 26 03:20:26 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:26 user nova-compute[74630]:     </video>
Oct 26 03:20:26 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:20:26 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:20:26 user nova-compute[74630]:     </rng>
Oct 26 03:20:26 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:20:26 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:20:26 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:20:26 user nova-compute[74630]:     </memballoon>
Oct 26 03:20:26 user nova-compute[74630]:   </devices>
Oct 26 03:20:26 user nova-compute[74630]: </domain>
Oct 26 03:20:26 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1719517014',display_name='tempest-ServerRescueNegativeTestJSON-server-1719517014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1719517014',id=4,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b652c6f02780451b89d51d74178bf6c7',ramdisk_id='',reservation_id='r-q4jggfxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2117587238',owner_user_name='tempest-ServerRescueNegativeTestJSON-2117587238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:19Z,user_data=None,user_id='62370747d10a420b81009d23e3ba324b',uuid=32264781-acf7-4afa-830a-5469b6a4c744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converting VIF {"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:25:1b,bridge_name='br-int',has_traffic_filtering=True,id=13707b78-ccef-402c-9d27-d6897b1eacf3,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13707b78-cc') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG os_vif [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:25:1b,bridge_name='br-int',has_traffic_filtering=True,id=13707b78-ccef-402c-9d27-d6897b1eacf3,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13707b78-cc') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '303600d6-5531-5347-aef8-aefda038a61c', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13707b78-cc, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13707b78-cc, col_values=(('qos', UUID('0441013c-9f49-407e-83a3-a0ac62d84d7a')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13707b78-cc, col_values=(('external_ids', {'iface-id': '13707b78-ccef-402c-9d27-d6897b1eacf3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:25:1b', 'vm-uuid': '32264781-acf7-4afa-830a-5469b6a4c744'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:26 user nova-compute[74630]: INFO os_vif [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:25:1b,bridge_name='br-int',has_traffic_filtering=True,id=13707b78-ccef-402c-9d27-d6897b1eacf3,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13707b78-cc')
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:20:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No VIF found with MAC fa:16:3e:3d:25:1b, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-changed-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Refreshing instance network info cache due to event network-changed-13707b78-ccef-402c-9d27-d6897b1eacf3. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] Acquiring lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] Acquired lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.network.neutron [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Refreshing network info cache for port 13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.network.neutron [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Updating instance_info_cache with network_info: [{"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Releasing lock "refresh_cache-7918e3bc-c44b-4be3-871d-e06eb3fd7d49" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Instance network_info: |[{"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updating instance_info_cache with network_info: [{"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7dd1f783-b7e4-4ea5-aa47-8219f4d9604a req-26377fdb-cf9f-4b5c-8d69-4f90bd9b28c9 service nova] Acquired lock "refresh_cache-7918e3bc-c44b-4be3-871d-e06eb3fd7d49" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.network.neutron [req-7dd1f783-b7e4-4ea5-aa47-8219f4d9604a req-26377fdb-cf9f-4b5c-8d69-4f90bd9b28c9 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Refreshing network info cache for port 853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Start _get_guest_xml network_info=[{"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Releasing lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Instance network_info: |[{"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Start _get_guest_xml network_info=[{"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:20:27 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:27 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:27 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:27 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2056490985',display_name='tempest-ServerRescueNegativeTestJSON-server-2056490985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2056490985',id=6,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b652c6f02780451b89d51d74178bf6c7',ramdisk_id='',reservation_id='r-sn0sgqx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2117587238',owner_user_name='tempest-ServerRescueNegativeTestJSON-2117587238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:21Z,user_data=None,user_id='62370747d10a420b81009d23e3ba324b',uuid=7918e3bc-c44b-4be3-871d-e06eb3fd7d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converting VIF {"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:0d:44,bridge_name='br-int',has_traffic_filtering=True,id=853efb6c-3553-4889-a1fb-b0ede74757b7,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853efb6c-35') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.objects.instance [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'pci_devices' on Instance uuid 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.network.neutron [req-f44eb565-7537-4682-be21-9a055b803e69 req-5b51b22b-bdf7-48d2-88d9-2d9738199599 service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Updated VIF entry in instance network info cache for port bea61e08-ab64-488a-bd39-88fd0649d434. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.network.neutron [req-f44eb565-7537-4682-be21-9a055b803e69 req-5b51b22b-bdf7-48d2-88d9-2d9738199599 service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Updating instance_info_cache with network_info: [{"id": "bea61e08-ab64-488a-bd39-88fd0649d434", "address": "fa:16:3e:01:c5:87", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea61e08-ab", "ovs_interfaceid": "bea61e08-ab64-488a-bd39-88fd0649d434", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:20:27 user nova-compute[74630]:   <uuid>7918e3bc-c44b-4be3-871d-e06eb3fd7d49</uuid>
Oct 26 03:20:27 user nova-compute[74630]:   <name>instance-00000006</name>
Oct 26 03:20:27 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:20:27 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:20:27 user nova-compute[74630]:   <metadata>
Oct 26 03:20:27 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:20:27 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:20:27 user nova-compute[74630]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2056490985</nova:name>
Oct 26 03:20:27 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:20:27</nova:creationTime>
Oct 26 03:20:27 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:20:27 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:20:27 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:20:27 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:20:27 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:20:27 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:20:27 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:20:27 user nova-compute[74630]:       <nova:owner>
Oct 26 03:20:27 user nova-compute[74630]:         <nova:user uuid="62370747d10a420b81009d23e3ba324b">tempest-ServerRescueNegativeTestJSON-2117587238-project-member</nova:user>
Oct 26 03:20:27 user nova-compute[74630]:         <nova:project uuid="b652c6f02780451b89d51d74178bf6c7">tempest-ServerRescueNegativeTestJSON-2117587238</nova:project>
Oct 26 03:20:27 user nova-compute[74630]:       </nova:owner>
Oct 26 03:20:27 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:20:27 user nova-compute[74630]:       <nova:ports>
Oct 26 03:20:27 user nova-compute[74630]:         <nova:port uuid="853efb6c-3553-4889-a1fb-b0ede74757b7">
Oct 26 03:20:27 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 03:20:27 user nova-compute[74630]:         </nova:port>
Oct 26 03:20:27 user nova-compute[74630]:       </nova:ports>
Oct 26 03:20:27 user nova-compute[74630]:     </nova:instance>
Oct 26 03:20:27 user nova-compute[74630]:   </metadata>
Oct 26 03:20:27 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:20:27 user nova-compute[74630]:     <system>
Oct 26 03:20:27 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:20:27 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:20:27 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:20:27 user nova-compute[74630]:       <entry name="serial">7918e3bc-c44b-4be3-871d-e06eb3fd7d49</entry>
Oct 26 03:20:27 user nova-compute[74630]:       <entry name="uuid">7918e3bc-c44b-4be3-871d-e06eb3fd7d49</entry>
Oct 26 03:20:27 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:20:27 user nova-compute[74630]:     </system>
Oct 26 03:20:27 user nova-compute[74630]:   </sysinfo>
Oct 26 03:20:27 user nova-compute[74630]:   <os>
Oct 26 03:20:27 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:20:27 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:20:27 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:20:27 user nova-compute[74630]:   </os>
Oct 26 03:20:27 user nova-compute[74630]:   <features>
Oct 26 03:20:27 user nova-compute[74630]:     <acpi/>
Oct 26 03:20:27 user nova-compute[74630]:     <apic/>
Oct 26 03:20:27 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:20:27 user nova-compute[74630]:   </features>
Oct 26 03:20:27 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:20:27 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:20:27 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:20:27 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:20:27 user nova-compute[74630]:   </clock>
Oct 26 03:20:27 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:20:27 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:20:27 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:20:27 user nova-compute[74630]:   </cpu>
Oct 26 03:20:27 user nova-compute[74630]:   <devices>
Oct 26 03:20:27 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:20:27 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:20:27 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk"/>
Oct 26 03:20:27 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:20:27 user nova-compute[74630]:     </disk>
Oct 26 03:20:27 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:20:27 user nova-compute[74630]:       <mac address="fa:16:3e:77:0d:44"/>
Oct 26 03:20:27 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:27 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:20:27 user nova-compute[74630]:       <target dev="tap853efb6c-35"/>
Oct 26 03:20:27 user nova-compute[74630]:     </interface>
Oct 26 03:20:27 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:20:27 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/console.log" append="off"/>
Oct 26 03:20:27 user nova-compute[74630]:     </serial>
Oct 26 03:20:27 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:20:27 user nova-compute[74630]:     <video>
Oct 26 03:20:27 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:27 user nova-compute[74630]:     </video>
Oct 26 03:20:27 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:20:27 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:20:27 user nova-compute[74630]:     </rng>
Oct 26 03:20:27 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:20:27 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:20:27 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:20:27 user nova-compute[74630]:     </memballoon>
Oct 26 03:20:27 user nova-compute[74630]:   </devices>
Oct 26 03:20:27 user nova-compute[74630]: </domain>
Oct 26 03:20:27 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2056490985',display_name='tempest-ServerRescueNegativeTestJSON-server-2056490985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2056490985',id=6,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b652c6f02780451b89d51d74178bf6c7',ramdisk_id='',reservation_id='r-sn0sgqx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2117587238',owner_user_name='tempest-ServerRescueNegativeTestJSON-2117587238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:21Z,user_data=None,user_id='62370747d10a420b81009d23e3ba324b',uuid=7918e3bc-c44b-4be3-871d-e06eb3fd7d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converting VIF {"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:0d:44,bridge_name='br-int',has_traffic_filtering=True,id=853efb6c-3553-4889-a1fb-b0ede74757b7,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853efb6c-35') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG os_vif [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:0d:44,bridge_name='br-int',has_traffic_filtering=True,id=853efb6c-3553-4889-a1fb-b0ede74757b7,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853efb6c-35') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1501494997',display_name='tempest-ServerActionsTestOtherB-server-1501494997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1501494997',id=5,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFIeBoj6ZVV6vjKZ5C8Qtaf45gZ5VQLu8uYxcKaMISZ7A/ITCT4P2Cxj8DgdsT8tNJFXq2qSIv9+4+e1q0xZrix9FhWGUlPhtxOjh9fvNN5qcQ+ZdFKB+/mBI3I8ldOaQ==',key_name='tempest-keypair-565299267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03fc5bdbf0b947b49f6a6c8d44630ed5',ramdisk_id='',reservation_id='r-4c005us9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-638189769',owner_user_name='tempest-ServerActionsTestOtherB-638189769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e27a2c56890d4be0a3fb46bd748fa7cf',uuid=65ff804f-8b98-406d-8c5c-3d73bb52ff18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converting VIF {"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.objects.instance [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lazy-loading 'pci_devices' on Instance uuid 65ff804f-8b98-406d-8c5c-3d73bb52ff18 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f44eb565-7537-4682-be21-9a055b803e69 req-5b51b22b-bdf7-48d2-88d9-2d9738199599 service nova] Releasing lock "refresh_cache-747e596d-d9b3-4af2-be42-0fd494b6ef9a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e90a64d-d68f-506a-bf9e-e4e55cc9a635', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:20:27 user nova-compute[74630]:   <uuid>65ff804f-8b98-406d-8c5c-3d73bb52ff18</uuid>
Oct 26 03:20:27 user nova-compute[74630]:   <name>instance-00000005</name>
Oct 26 03:20:27 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:20:27 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:20:27 user nova-compute[74630]:   <metadata>
Oct 26 03:20:27 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:20:27 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:20:27 user nova-compute[74630]:       <nova:name>tempest-ServerActionsTestOtherB-server-1501494997</nova:name>
Oct 26 03:20:27 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:20:27</nova:creationTime>
Oct 26 03:20:27 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:20:27 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:20:27 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:20:27 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:20:27 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:20:27 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:20:27 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:20:27 user nova-compute[74630]:       <nova:owner>
Oct 26 03:20:27 user nova-compute[74630]:         <nova:user uuid="e27a2c56890d4be0a3fb46bd748fa7cf">tempest-ServerActionsTestOtherB-638189769-project-member</nova:user>
Oct 26 03:20:27 user nova-compute[74630]:         <nova:project uuid="03fc5bdbf0b947b49f6a6c8d44630ed5">tempest-ServerActionsTestOtherB-638189769</nova:project>
Oct 26 03:20:27 user nova-compute[74630]:       </nova:owner>
Oct 26 03:20:27 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:20:27 user nova-compute[74630]:       <nova:ports>
Oct 26 03:20:27 user nova-compute[74630]:         <nova:port uuid="b965ee06-ed93-40fc-9732-974c808f5c36">
Oct 26 03:20:27 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 03:20:27 user nova-compute[74630]:         </nova:port>
Oct 26 03:20:27 user nova-compute[74630]:       </nova:ports>
Oct 26 03:20:27 user nova-compute[74630]:     </nova:instance>
Oct 26 03:20:27 user nova-compute[74630]:   </metadata>
Oct 26 03:20:27 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:20:27 user nova-compute[74630]:     <system>
Oct 26 03:20:27 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:20:27 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:20:27 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:20:27 user nova-compute[74630]:       <entry name="serial">65ff804f-8b98-406d-8c5c-3d73bb52ff18</entry>
Oct 26 03:20:27 user nova-compute[74630]:       <entry name="uuid">65ff804f-8b98-406d-8c5c-3d73bb52ff18</entry>
Oct 26 03:20:27 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:20:27 user nova-compute[74630]:     </system>
Oct 26 03:20:27 user nova-compute[74630]:   </sysinfo>
Oct 26 03:20:27 user nova-compute[74630]:   <os>
Oct 26 03:20:27 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:20:27 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:20:27 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:20:27 user nova-compute[74630]:   </os>
Oct 26 03:20:27 user nova-compute[74630]:   <features>
Oct 26 03:20:27 user nova-compute[74630]:     <acpi/>
Oct 26 03:20:27 user nova-compute[74630]:     <apic/>
Oct 26 03:20:27 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:20:27 user nova-compute[74630]:   </features>
Oct 26 03:20:27 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:20:27 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:20:27 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:20:27 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:20:27 user nova-compute[74630]:   </clock>
Oct 26 03:20:27 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:20:27 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:20:27 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:20:27 user nova-compute[74630]:   </cpu>
Oct 26 03:20:27 user nova-compute[74630]:   <devices>
Oct 26 03:20:27 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:20:27 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:20:27 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk"/>
Oct 26 03:20:27 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:20:27 user nova-compute[74630]:     </disk>
Oct 26 03:20:27 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:20:27 user nova-compute[74630]:       <mac address="fa:16:3e:51:30:8c"/>
Oct 26 03:20:27 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:27 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:20:27 user nova-compute[74630]:       <target dev="tapb965ee06-ed"/>
Oct 26 03:20:27 user nova-compute[74630]:     </interface>
Oct 26 03:20:27 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:20:27 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/console.log" append="off"/>
Oct 26 03:20:27 user nova-compute[74630]:     </serial>
Oct 26 03:20:27 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:20:27 user nova-compute[74630]:     <video>
Oct 26 03:20:27 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:27 user nova-compute[74630]:     </video>
Oct 26 03:20:27 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:20:27 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:20:27 user nova-compute[74630]:     </rng>
Oct 26 03:20:27 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:20:27 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:20:27 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:20:27 user nova-compute[74630]:     </memballoon>
Oct 26 03:20:27 user nova-compute[74630]:   </devices>
Oct 26 03:20:27 user nova-compute[74630]: </domain>
Oct 26 03:20:27 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1501494997',display_name='tempest-ServerActionsTestOtherB-server-1501494997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1501494997',id=5,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFIeBoj6ZVV6vjKZ5C8Qtaf45gZ5VQLu8uYxcKaMISZ7A/ITCT4P2Cxj8DgdsT8tNJFXq2qSIv9+4+e1q0xZrix9FhWGUlPhtxOjh9fvNN5qcQ+ZdFKB+/mBI3I8ldOaQ==',key_name='tempest-keypair-565299267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03fc5bdbf0b947b49f6a6c8d44630ed5',ramdisk_id='',reservation_id='r-4c005us9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-638189769',owner_user_name='tempest-ServerActionsTestOtherB-638189769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e27a2c56890d4be0a3fb46bd748fa7cf',uuid=65ff804f-8b98-406d-8c5c-3d73bb52ff18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converting VIF {"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG os_vif [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c29834d-7144-5988-a814-80e3ec70f777', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap853efb6c-35, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap853efb6c-35, col_values=(('qos', UUID('72854234-4285-46db-9b0b-9319b22261a0')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap853efb6c-35, col_values=(('external_ids', {'iface-id': '853efb6c-3553-4889-a1fb-b0ede74757b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:0d:44', 'vm-uuid': '7918e3bc-c44b-4be3-871d-e06eb3fd7d49'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:27 user nova-compute[74630]: INFO os_vif [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:0d:44,bridge_name='br-int',has_traffic_filtering=True,id=853efb6c-3553-4889-a1fb-b0ede74757b7,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853efb6c-35')
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb965ee06-ed, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb965ee06-ed, col_values=(('qos', UUID('7b03052d-f9f2-4088-85f8-03ef36f8a5ed')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb965ee06-ed, col_values=(('external_ids', {'iface-id': 'b965ee06-ed93-40fc-9732-974c808f5c36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:30:8c', 'vm-uuid': '65ff804f-8b98-406d-8c5c-3d73bb52ff18'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:28 user nova-compute[74630]: INFO os_vif [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed')
Oct 26 03:20:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No VIF found with MAC fa:16:3e:77:0d:44, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG nova.network.neutron [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Successfully updated port: 8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquired lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG nova.network.neutron [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-ec078b96-8097-4a55-8c80-bbf718e83801 req-681174b1-46ba-4c41-8495-ca6135e2bffe service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Received event network-changed-8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-ec078b96-8097-4a55-8c80-bbf718e83801 req-681174b1-46ba-4c41-8495-ca6135e2bffe service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Refreshing instance network info cache due to event network-changed-8f91f921-5357-4156-b113-a4a3b0ef6e2e. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ec078b96-8097-4a55-8c80-bbf718e83801 req-681174b1-46ba-4c41-8495-ca6135e2bffe service nova] Acquiring lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG nova.network.neutron [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG nova.network.neutron [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Updated VIF entry in instance network info cache for port 13707b78-ccef-402c-9d27-d6897b1eacf3. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG nova.network.neutron [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Updating instance_info_cache with network_info: [{"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] Releasing lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-changed-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Refreshing instance network info cache due to event network-changed-b965ee06-ed93-40fc-9732-974c808f5c36. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] Acquiring lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] Acquired lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG nova.network.neutron [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Refreshing network info cache for port b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG nova.network.neutron [req-7dd1f783-b7e4-4ea5-aa47-8219f4d9604a req-26377fdb-cf9f-4b5c-8d69-4f90bd9b28c9 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Updated VIF entry in instance network info cache for port 853efb6c-3553-4889-a1fb-b0ede74757b7. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG nova.network.neutron [req-7dd1f783-b7e4-4ea5-aa47-8219f4d9604a req-26377fdb-cf9f-4b5c-8d69-4f90bd9b28c9 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Updating instance_info_cache with network_info: [{"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7dd1f783-b7e4-4ea5-aa47-8219f4d9604a req-26377fdb-cf9f-4b5c-8d69-4f90bd9b28c9 service nova] Releasing lock "refresh_cache-7918e3bc-c44b-4be3-871d-e06eb3fd7d49" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:29 user nova-compute[74630]: DEBUG nova.network.neutron [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Updating instance_info_cache with network_info: [{"id": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "address": "fa:16:3e:1c:d5:8f", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f91f921-53", "ovs_interfaceid": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Releasing lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Instance network_info: |[{"id": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "address": "fa:16:3e:1c:d5:8f", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f91f921-53", "ovs_interfaceid": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:20:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ec078b96-8097-4a55-8c80-bbf718e83801 req-681174b1-46ba-4c41-8495-ca6135e2bffe service nova] Acquired lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:29 user nova-compute[74630]: DEBUG nova.network.neutron [req-ec078b96-8097-4a55-8c80-bbf718e83801 req-681174b1-46ba-4c41-8495-ca6135e2bffe service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Refreshing network info cache for port 8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:20:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Start _get_guest_xml network_info=[{"id": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "address": "fa:16:3e:1c:d5:8f", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f91f921-53", "ovs_interfaceid": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:20:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:29 user nova-compute[74630]: DEBUG nova.network.neutron [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updated VIF entry in instance network info cache for port b965ee06-ed93-40fc-9732-974c808f5c36. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:20:29 user nova-compute[74630]: DEBUG nova.network.neutron [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updating instance_info_cache with network_info: [{"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0b3a1e5b-5754-4b91-abf1-5c6a7ead1f7b req-2d12953d-1f89-41dc-af38-b9af079d7ba6 service nova] Releasing lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:30 user nova-compute[74630]: DEBUG nova.network.neutron [req-ec078b96-8097-4a55-8c80-bbf718e83801 req-681174b1-46ba-4c41-8495-ca6135e2bffe service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Updated VIF entry in instance network info cache for port 8f91f921-5357-4156-b113-a4a3b0ef6e2e. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:20:30 user nova-compute[74630]: DEBUG nova.network.neutron [req-ec078b96-8097-4a55-8c80-bbf718e83801 req-681174b1-46ba-4c41-8495-ca6135e2bffe service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Updating instance_info_cache with network_info: [{"id": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "address": "fa:16:3e:1c:d5:8f", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f91f921-53", "ovs_interfaceid": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ec078b96-8097-4a55-8c80-bbf718e83801 req-681174b1-46ba-4c41-8495-ca6135e2bffe service nova] Releasing lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:34 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:20:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:20:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:20:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] No VIF found with MAC fa:16:3e:51:30:8c, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:20:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:20:36 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Instance spawned successfully.
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:20:36 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:36 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:36 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Instance spawned successfully.
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1042598755',display_name='tempest-ServerActionsTestOtherA-server-1042598755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1042598755',id=7,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwoLYfCM8lwvIIEciV36xGOUw+XalItY+5dZPbHAKn3DqpiwNygwALzSy5pOoP4seOCkowdcCG1fNBC8K731mmxBiQFtvBIY61aup2H6JCAGn52TG97PQD1ZIY1c0HtiA==',key_name='tempest-keypair-1565174322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51542ffdf7a84ac5a61f14e124eb2087',ramdisk_id='',reservation_id='r-y0p22zy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-41539930',owner_user_name='tempest-ServerActionsTestOtherA-41539930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a419737713f4797ab27db62d5aa746c',uuid=f9890dde-e678-41d4-8447-24bf626c2983,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "address": "fa:16:3e:1c:d5:8f", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f91f921-53", "ovs_interfaceid": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converting VIF {"id": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "address": "fa:16:3e:1c:d5:8f", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f91f921-53", "ovs_interfaceid": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:d5:8f,bridge_name='br-int',has_traffic_filtering=True,id=8f91f921-5357-4156-b113-a4a3b0ef6e2e,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f91f921-53') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.objects.instance [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lazy-loading 'pci_devices' on Instance uuid f9890dde-e678-41d4-8447-24bf626c2983 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:20:36 user nova-compute[74630]:   <uuid>f9890dde-e678-41d4-8447-24bf626c2983</uuid>
Oct 26 03:20:36 user nova-compute[74630]:   <name>instance-00000007</name>
Oct 26 03:20:36 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:20:36 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:20:36 user nova-compute[74630]:   <metadata>
Oct 26 03:20:36 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:20:36 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:20:36 user nova-compute[74630]:       <nova:name>tempest-ServerActionsTestOtherA-server-1042598755</nova:name>
Oct 26 03:20:36 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:20:36</nova:creationTime>
Oct 26 03:20:36 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:20:36 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:20:36 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:20:36 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:20:36 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:20:36 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:20:36 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:20:36 user nova-compute[74630]:       <nova:owner>
Oct 26 03:20:36 user nova-compute[74630]:         <nova:user uuid="7a419737713f4797ab27db62d5aa746c">tempest-ServerActionsTestOtherA-41539930-project-member</nova:user>
Oct 26 03:20:36 user nova-compute[74630]:         <nova:project uuid="51542ffdf7a84ac5a61f14e124eb2087">tempest-ServerActionsTestOtherA-41539930</nova:project>
Oct 26 03:20:36 user nova-compute[74630]:       </nova:owner>
Oct 26 03:20:36 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:20:36 user nova-compute[74630]:       <nova:ports>
Oct 26 03:20:36 user nova-compute[74630]:         <nova:port uuid="8f91f921-5357-4156-b113-a4a3b0ef6e2e">
Oct 26 03:20:36 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 03:20:36 user nova-compute[74630]:         </nova:port>
Oct 26 03:20:36 user nova-compute[74630]:       </nova:ports>
Oct 26 03:20:36 user nova-compute[74630]:     </nova:instance>
Oct 26 03:20:36 user nova-compute[74630]:   </metadata>
Oct 26 03:20:36 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:20:36 user nova-compute[74630]:     <system>
Oct 26 03:20:36 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:20:36 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:20:36 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:20:36 user nova-compute[74630]:       <entry name="serial">f9890dde-e678-41d4-8447-24bf626c2983</entry>
Oct 26 03:20:36 user nova-compute[74630]:       <entry name="uuid">f9890dde-e678-41d4-8447-24bf626c2983</entry>
Oct 26 03:20:36 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:20:36 user nova-compute[74630]:     </system>
Oct 26 03:20:36 user nova-compute[74630]:   </sysinfo>
Oct 26 03:20:36 user nova-compute[74630]:   <os>
Oct 26 03:20:36 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:20:36 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:20:36 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:20:36 user nova-compute[74630]:   </os>
Oct 26 03:20:36 user nova-compute[74630]:   <features>
Oct 26 03:20:36 user nova-compute[74630]:     <acpi/>
Oct 26 03:20:36 user nova-compute[74630]:     <apic/>
Oct 26 03:20:36 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:20:36 user nova-compute[74630]:   </features>
Oct 26 03:20:36 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:20:36 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:20:36 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:20:36 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:20:36 user nova-compute[74630]:   </clock>
Oct 26 03:20:36 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:20:36 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:20:36 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:20:36 user nova-compute[74630]:   </cpu>
Oct 26 03:20:36 user nova-compute[74630]:   <devices>
Oct 26 03:20:36 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:20:36 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:20:36 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk"/>
Oct 26 03:20:36 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:20:36 user nova-compute[74630]:     </disk>
Oct 26 03:20:36 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:20:36 user nova-compute[74630]:       <mac address="fa:16:3e:1c:d5:8f"/>
Oct 26 03:20:36 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:36 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:20:36 user nova-compute[74630]:       <target dev="tap8f91f921-53"/>
Oct 26 03:20:36 user nova-compute[74630]:     </interface>
Oct 26 03:20:36 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:20:36 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/console.log" append="off"/>
Oct 26 03:20:36 user nova-compute[74630]:     </serial>
Oct 26 03:20:36 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:20:36 user nova-compute[74630]:     <video>
Oct 26 03:20:36 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:36 user nova-compute[74630]:     </video>
Oct 26 03:20:36 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:20:36 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:20:36 user nova-compute[74630]:     </rng>
Oct 26 03:20:36 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:20:36 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:20:36 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:20:36 user nova-compute[74630]:     </memballoon>
Oct 26 03:20:36 user nova-compute[74630]:   </devices>
Oct 26 03:20:36 user nova-compute[74630]: </domain>
Oct 26 03:20:36 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1042598755',display_name='tempest-ServerActionsTestOtherA-server-1042598755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1042598755',id=7,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwoLYfCM8lwvIIEciV36xGOUw+XalItY+5dZPbHAKn3DqpiwNygwALzSy5pOoP4seOCkowdcCG1fNBC8K731mmxBiQFtvBIY61aup2H6JCAGn52TG97PQD1ZIY1c0HtiA==',key_name='tempest-keypair-1565174322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51542ffdf7a84ac5a61f14e124eb2087',ramdisk_id='',reservation_id='r-y0p22zy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-41539930',owner_user_name='tempest-ServerActionsTestOtherA-41539930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a419737713f4797ab27db62d5aa746c',uuid=f9890dde-e678-41d4-8447-24bf626c2983,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "address": "fa:16:3e:1c:d5:8f", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f91f921-53", "ovs_interfaceid": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converting VIF {"id": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "address": "fa:16:3e:1c:d5:8f", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f91f921-53", "ovs_interfaceid": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:d5:8f,bridge_name='br-int',has_traffic_filtering=True,id=8f91f921-5357-4156-b113-a4a3b0ef6e2e,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f91f921-53') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG os_vif [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:d5:8f,bridge_name='br-int',has_traffic_filtering=True,id=8f91f921-5357-4156-b113-a4a3b0ef6e2e,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f91f921-53') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83d091be-e2fb-56d2-89a8-66388f93c281', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f91f921-53, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f91f921-53, col_values=(('qos', UUID('deba95fd-6945-4ebd-880c-7ee81124fc07')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f91f921-53, col_values=(('external_ids', {'iface-id': '8f91f921-5357-4156-b113-a4a3b0ef6e2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:d5:8f', 'vm-uuid': 'f9890dde-e678-41d4-8447-24bf626c2983'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:36 user nova-compute[74630]: INFO os_vif [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:d5:8f,bridge_name='br-int',has_traffic_filtering=True,id=8f91f921-5357-4156-b113-a4a3b0ef6e2e,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f91f921-53')
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:20:36 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Instance spawned successfully.
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:20:36 user nova-compute[74630]: INFO nova.compute.manager [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Took 18.08 seconds to spawn the instance on the hypervisor.
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: INFO nova.compute.manager [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Took 19.75 seconds to spawn the instance on the hypervisor.
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] No VIF found with MAC fa:16:3e:1c:d5:8f, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:20:36 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Instance spawned successfully.
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:20:36 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Instance spawned successfully.
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: INFO nova.compute.manager [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Took 18.01 seconds to spawn the instance on the hypervisor.
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:20:36 user nova-compute[74630]: INFO nova.compute.manager [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Took 19.26 seconds to build instance.
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c86e1362-a708-4c37-abaf-3f7509cfdd43 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.470s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:36 user nova-compute[74630]: INFO nova.compute.manager [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Took 19.42 seconds to build instance.
Oct 26 03:20:37 user nova-compute[74630]: INFO nova.compute.manager [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Took 20.95 seconds to build instance.
Oct 26 03:20:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b426d29c-2e9e-4b26-96b2-b46df8fab8f3 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.707s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:37 user nova-compute[74630]: INFO nova.compute.manager [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Took 17.67 seconds to spawn the instance on the hypervisor.
Oct 26 03:20:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:20:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-96190621-f55f-4f19-bcbe-75c13fa03173 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.328s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:37 user nova-compute[74630]: INFO nova.compute.manager [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Took 16.40 seconds to spawn the instance on the hypervisor.
Oct 26 03:20:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:20:37 user nova-compute[74630]: INFO nova.compute.manager [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Took 19.31 seconds to build instance.
Oct 26 03:20:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-db3c298e-799c-4c7d-8291-bcdeaea54c96 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "32264781-acf7-4afa-830a-5469b6a4c744" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.557s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:37 user nova-compute[74630]: INFO nova.compute.manager [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Took 17.78 seconds to build instance.
Oct 26 03:20:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f127a795-f184-49d1-9eae-e34a6612390d tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.964s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-e634ae17-efbd-416d-8c83-04d3253dc493 req-042acecf-ffb1-465a-9ea5-7182913dd39b service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Received event network-vif-plugged-bea61e08-ab64-488a-bd39-88fd0649d434 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e634ae17-efbd-416d-8c83-04d3253dc493 req-042acecf-ffb1-465a-9ea5-7182913dd39b service nova] Acquiring lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e634ae17-efbd-416d-8c83-04d3253dc493 req-042acecf-ffb1-465a-9ea5-7182913dd39b service nova] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e634ae17-efbd-416d-8c83-04d3253dc493 req-042acecf-ffb1-465a-9ea5-7182913dd39b service nova] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-e634ae17-efbd-416d-8c83-04d3253dc493 req-042acecf-ffb1-465a-9ea5-7182913dd39b service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] No waiting events found dispatching network-vif-plugged-bea61e08-ab64-488a-bd39-88fd0649d434 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:20:38 user nova-compute[74630]: WARNING nova.compute.manager [req-e634ae17-efbd-416d-8c83-04d3253dc493 req-042acecf-ffb1-465a-9ea5-7182913dd39b service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Received unexpected event network-vif-plugged-bea61e08-ab64-488a-bd39-88fd0649d434 for instance with vm_state active and task_state None.
Oct 26 03:20:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:39 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:20:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:20:39 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Instance spawned successfully.
Oct 26 03:20:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:20:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:40 user nova-compute[74630]: INFO nova.compute.manager [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Took 20.10 seconds to spawn the instance on the hypervisor.
Oct 26 03:20:40 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:20:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-9020880e-7cc4-4b97-ac1d-2bf3eb294661 req-a3f91048-496e-46ea-9dec-426f0744674d service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Received event network-vif-plugged-bea61e08-ab64-488a-bd39-88fd0649d434 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9020880e-7cc4-4b97-ac1d-2bf3eb294661 req-a3f91048-496e-46ea-9dec-426f0744674d service nova] Acquiring lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9020880e-7cc4-4b97-ac1d-2bf3eb294661 req-a3f91048-496e-46ea-9dec-426f0744674d service nova] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9020880e-7cc4-4b97-ac1d-2bf3eb294661 req-a3f91048-496e-46ea-9dec-426f0744674d service nova] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-9020880e-7cc4-4b97-ac1d-2bf3eb294661 req-a3f91048-496e-46ea-9dec-426f0744674d service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] No waiting events found dispatching network-vif-plugged-bea61e08-ab64-488a-bd39-88fd0649d434 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:20:40 user nova-compute[74630]: WARNING nova.compute.manager [req-9020880e-7cc4-4b97-ac1d-2bf3eb294661 req-a3f91048-496e-46ea-9dec-426f0744674d service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Received unexpected event network-vif-plugged-bea61e08-ab64-488a-bd39-88fd0649d434 for instance with vm_state active and task_state None.
Oct 26 03:20:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-9020880e-7cc4-4b97-ac1d-2bf3eb294661 req-a3f91048-496e-46ea-9dec-426f0744674d service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9020880e-7cc4-4b97-ac1d-2bf3eb294661 req-a3f91048-496e-46ea-9dec-426f0744674d service nova] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9020880e-7cc4-4b97-ac1d-2bf3eb294661 req-a3f91048-496e-46ea-9dec-426f0744674d service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9020880e-7cc4-4b97-ac1d-2bf3eb294661 req-a3f91048-496e-46ea-9dec-426f0744674d service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-9020880e-7cc4-4b97-ac1d-2bf3eb294661 req-a3f91048-496e-46ea-9dec-426f0744674d service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] No waiting events found dispatching network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:20:40 user nova-compute[74630]: WARNING nova.compute.manager [req-9020880e-7cc4-4b97-ac1d-2bf3eb294661 req-a3f91048-496e-46ea-9dec-426f0744674d service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received unexpected event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 for instance with vm_state active and task_state None.
Oct 26 03:20:40 user nova-compute[74630]: INFO nova.compute.manager [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Took 21.90 seconds to build instance.
Oct 26 03:20:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2f44346-036a-440e-8797-594ed3c642e7 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.041s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "d1591088-0892-4aa5-b7ea-3addb083bc69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:40 user nova-compute[74630]: DEBUG nova.compute.manager [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:20:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:41 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:20:41 user nova-compute[74630]: INFO nova.compute.claims [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Claim successful on node user
Oct 26 03:20:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:42 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:20:42 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:20:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.219s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:20:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-995a50c6-8a10-4610-9e8b-587118bbf979 req-77d23b4f-b958-47ee-bc6e-809b1a31b011 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-995a50c6-8a10-4610-9e8b-587118bbf979 req-77d23b4f-b958-47ee-bc6e-809b1a31b011 service nova] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-995a50c6-8a10-4610-9e8b-587118bbf979 req-77d23b4f-b958-47ee-bc6e-809b1a31b011 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-995a50c6-8a10-4610-9e8b-587118bbf979 req-77d23b4f-b958-47ee-bc6e-809b1a31b011 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-995a50c6-8a10-4610-9e8b-587118bbf979 req-77d23b4f-b958-47ee-bc6e-809b1a31b011 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] No waiting events found dispatching network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:20:42 user nova-compute[74630]: WARNING nova.compute.manager [req-995a50c6-8a10-4610-9e8b-587118bbf979 req-77d23b4f-b958-47ee-bc6e-809b1a31b011 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received unexpected event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 for instance with vm_state active and task_state None.
Oct 26 03:20:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:20:42 user nova-compute[74630]: DEBUG nova.network.neutron [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:20:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:20:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:20:42 user nova-compute[74630]: DEBUG nova.policy [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'accb78f69ef64c9bacb02969887c3aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd4345949848cba29e4c991b6cb3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG nova.compute.manager [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:20:43 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Creating image(s)
Oct 26 03:20:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "/opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "/opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG nova.compute.manager [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:20:43 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Instance spawned successfully.
Oct 26 03:20:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.333s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.236s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:43 user nova-compute[74630]: INFO nova.compute.manager [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Took 21.39 seconds to spawn the instance on the hypervisor.
Oct 26 03:20:43 user nova-compute[74630]: DEBUG nova.compute.manager [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk 1073741824" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.435s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:44 user nova-compute[74630]: INFO nova.compute.manager [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Took 22.97 seconds to build instance.
Oct 26 03:20:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.297s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:44 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:20:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-544f0f82-905a-493d-bb1d-8e4b6104c830 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f9890dde-e678-41d4-8447-24bf626c2983" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.178s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.337s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:44 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Cannot resize image /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:20:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:20:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Ensure instance console log exists: /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:20:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:44 user nova-compute[74630]: DEBUG nova.network.neutron [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Successfully created port: eb33c5f5-8500-42cc-997d-94069fc454a6 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:20:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:46 user nova-compute[74630]: DEBUG nova.compute.manager [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:20:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:47 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:20:47 user nova-compute[74630]: INFO nova.compute.claims [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Claim successful on node user
Oct 26 03:20:47 user nova-compute[74630]: DEBUG nova.network.neutron [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Successfully updated port: eb33c5f5-8500-42cc-997d-94069fc454a6 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:20:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "refresh_cache-d1591088-0892-4aa5-b7ea-3addb083bc69" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquired lock "refresh_cache-d1591088-0892-4aa5-b7ea-3addb083bc69" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:47 user nova-compute[74630]: DEBUG nova.network.neutron [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:20:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-3535b8a0-1275-4638-a7c8-946f0daa8d10 req-47ae65c5-5c45-46d9-8501-dab9e5dd8357 service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Received event network-changed-eb33c5f5-8500-42cc-997d-94069fc454a6 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-3535b8a0-1275-4638-a7c8-946f0daa8d10 req-47ae65c5-5c45-46d9-8501-dab9e5dd8357 service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Refreshing instance network info cache due to event network-changed-eb33c5f5-8500-42cc-997d-94069fc454a6. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:20:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3535b8a0-1275-4638-a7c8-946f0daa8d10 req-47ae65c5-5c45-46d9-8501-dab9e5dd8357 service nova] Acquiring lock "refresh_cache-d1591088-0892-4aa5-b7ea-3addb083bc69" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:47 user nova-compute[74630]: DEBUG nova.network.neutron [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.040s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG nova.compute.manager [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG nova.compute.manager [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG nova.network.neutron [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:20:48 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 26 03:20:48 user nova-compute[74630]: DEBUG nova.compute.manager [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG nova.network.neutron [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Updating instance_info_cache with network_info: [{"id": "eb33c5f5-8500-42cc-997d-94069fc454a6", "address": "fa:16:3e:eb:7c:ee", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33c5f5-85", "ovs_interfaceid": "eb33c5f5-8500-42cc-997d-94069fc454a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Releasing lock "refresh_cache-d1591088-0892-4aa5-b7ea-3addb083bc69" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG nova.compute.manager [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Instance network_info: |[{"id": "eb33c5f5-8500-42cc-997d-94069fc454a6", "address": "fa:16:3e:eb:7c:ee", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33c5f5-85", "ovs_interfaceid": "eb33c5f5-8500-42cc-997d-94069fc454a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3535b8a0-1275-4638-a7c8-946f0daa8d10 req-47ae65c5-5c45-46d9-8501-dab9e5dd8357 service nova] Acquired lock "refresh_cache-d1591088-0892-4aa5-b7ea-3addb083bc69" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG nova.network.neutron [req-3535b8a0-1275-4638-a7c8-946f0daa8d10 req-47ae65c5-5c45-46d9-8501-dab9e5dd8357 service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Refreshing network info cache for port eb33c5f5-8500-42cc-997d-94069fc454a6 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Start _get_guest_xml network_info=[{"id": "eb33c5f5-8500-42cc-997d-94069fc454a6", "address": "fa:16:3e:eb:7c:ee", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33c5f5-85", "ovs_interfaceid": "eb33c5f5-8500-42cc-997d-94069fc454a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG nova.compute.manager [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:20:48 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Creating image(s)
Oct 26 03:20:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "/opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "/opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "8b373f3ef722f1eed9bbf28190fadd2b95c81a9e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "8b373f3ef722f1eed9bbf28190fadd2b95c81a9e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:49 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:49 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-8264532',display_name='tempest-VolumesAdminNegativeTest-server-8264532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-8264532',id=8,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMMrmN6anav/GY0c8u6UNeNMLH6oEhOquvZrRIkRn8UNcNk0VjiPbmXDgYedJL47/S+BCzo5XYBm37hIfQzW4IKhvF7lta8wARD8RV9ERqB1l02lsqF9piw1vzQCWPscw==',key_name='tempest-keypair-643861528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eccd4345949848cba29e4c991b6cb3b6',ramdisk_id='',reservation_id='r-tl68zqfz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-741862100',owner_user_name='tempest-VolumesAdminNegativeTest-741862100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='accb78f69ef64c9bacb02969887c3aa2',uuid=d1591088-0892-4aa5-b7ea-3addb083bc69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb33c5f5-8500-42cc-997d-94069fc454a6", "address": "fa:16:3e:eb:7c:ee", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33c5f5-85", "ovs_interfaceid": "eb33c5f5-8500-42cc-997d-94069fc454a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Converting VIF {"id": "eb33c5f5-8500-42cc-997d-94069fc454a6", "address": "fa:16:3e:eb:7c:ee", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33c5f5-85", "ovs_interfaceid": "eb33c5f5-8500-42cc-997d-94069fc454a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:7c:ee,bridge_name='br-int',has_traffic_filtering=True,id=eb33c5f5-8500-42cc-997d-94069fc454a6,network=Network(2ebb9b88-a9a3-4efd-a6e3-be76353d6be5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb33c5f5-85') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.objects.instance [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lazy-loading 'pci_devices' on Instance uuid d1591088-0892-4aa5-b7ea-3addb083bc69 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.policy [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcf784e61b0b4817a21c59028aa3ac66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7adc62ff197348a19e8870850be33852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:20:49 user nova-compute[74630]:   <uuid>d1591088-0892-4aa5-b7ea-3addb083bc69</uuid>
Oct 26 03:20:49 user nova-compute[74630]:   <name>instance-00000008</name>
Oct 26 03:20:49 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:20:49 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:20:49 user nova-compute[74630]:   <metadata>
Oct 26 03:20:49 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:20:49 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:20:49 user nova-compute[74630]:       <nova:name>tempest-VolumesAdminNegativeTest-server-8264532</nova:name>
Oct 26 03:20:49 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:20:49</nova:creationTime>
Oct 26 03:20:49 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:20:49 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:20:49 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:20:49 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:20:49 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:20:49 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:20:49 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:20:49 user nova-compute[74630]:       <nova:owner>
Oct 26 03:20:49 user nova-compute[74630]:         <nova:user uuid="accb78f69ef64c9bacb02969887c3aa2">tempest-VolumesAdminNegativeTest-741862100-project-member</nova:user>
Oct 26 03:20:49 user nova-compute[74630]:         <nova:project uuid="eccd4345949848cba29e4c991b6cb3b6">tempest-VolumesAdminNegativeTest-741862100</nova:project>
Oct 26 03:20:49 user nova-compute[74630]:       </nova:owner>
Oct 26 03:20:49 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:20:49 user nova-compute[74630]:       <nova:ports>
Oct 26 03:20:49 user nova-compute[74630]:         <nova:port uuid="eb33c5f5-8500-42cc-997d-94069fc454a6">
Oct 26 03:20:49 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 03:20:49 user nova-compute[74630]:         </nova:port>
Oct 26 03:20:49 user nova-compute[74630]:       </nova:ports>
Oct 26 03:20:49 user nova-compute[74630]:     </nova:instance>
Oct 26 03:20:49 user nova-compute[74630]:   </metadata>
Oct 26 03:20:49 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:20:49 user nova-compute[74630]:     <system>
Oct 26 03:20:49 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:20:49 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:20:49 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:20:49 user nova-compute[74630]:       <entry name="serial">d1591088-0892-4aa5-b7ea-3addb083bc69</entry>
Oct 26 03:20:49 user nova-compute[74630]:       <entry name="uuid">d1591088-0892-4aa5-b7ea-3addb083bc69</entry>
Oct 26 03:20:49 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:20:49 user nova-compute[74630]:     </system>
Oct 26 03:20:49 user nova-compute[74630]:   </sysinfo>
Oct 26 03:20:49 user nova-compute[74630]:   <os>
Oct 26 03:20:49 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:20:49 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:20:49 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:20:49 user nova-compute[74630]:   </os>
Oct 26 03:20:49 user nova-compute[74630]:   <features>
Oct 26 03:20:49 user nova-compute[74630]:     <acpi/>
Oct 26 03:20:49 user nova-compute[74630]:     <apic/>
Oct 26 03:20:49 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:20:49 user nova-compute[74630]:   </features>
Oct 26 03:20:49 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:20:49 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:20:49 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:20:49 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:20:49 user nova-compute[74630]:   </clock>
Oct 26 03:20:49 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:20:49 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:20:49 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:20:49 user nova-compute[74630]:   </cpu>
Oct 26 03:20:49 user nova-compute[74630]:   <devices>
Oct 26 03:20:49 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:20:49 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:20:49 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk"/>
Oct 26 03:20:49 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:20:49 user nova-compute[74630]:     </disk>
Oct 26 03:20:49 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:20:49 user nova-compute[74630]:       <mac address="fa:16:3e:eb:7c:ee"/>
Oct 26 03:20:49 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:49 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:20:49 user nova-compute[74630]:       <target dev="tapeb33c5f5-85"/>
Oct 26 03:20:49 user nova-compute[74630]:     </interface>
Oct 26 03:20:49 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:20:49 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/console.log" append="off"/>
Oct 26 03:20:49 user nova-compute[74630]:     </serial>
Oct 26 03:20:49 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:20:49 user nova-compute[74630]:     <video>
Oct 26 03:20:49 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:49 user nova-compute[74630]:     </video>
Oct 26 03:20:49 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:20:49 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:20:49 user nova-compute[74630]:     </rng>
Oct 26 03:20:49 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:20:49 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:20:49 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:20:49 user nova-compute[74630]:     </memballoon>
Oct 26 03:20:49 user nova-compute[74630]:   </devices>
Oct 26 03:20:49 user nova-compute[74630]: </domain>
Oct 26 03:20:49 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-8264532',display_name='tempest-VolumesAdminNegativeTest-server-8264532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-8264532',id=8,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMMrmN6anav/GY0c8u6UNeNMLH6oEhOquvZrRIkRn8UNcNk0VjiPbmXDgYedJL47/S+BCzo5XYBm37hIfQzW4IKhvF7lta8wARD8RV9ERqB1l02lsqF9piw1vzQCWPscw==',key_name='tempest-keypair-643861528',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eccd4345949848cba29e4c991b6cb3b6',ramdisk_id='',reservation_id='r-tl68zqfz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-741862100',owner_user_name='tempest-VolumesAdminNegativeTest-741862100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='accb78f69ef64c9bacb02969887c3aa2',uuid=d1591088-0892-4aa5-b7ea-3addb083bc69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb33c5f5-8500-42cc-997d-94069fc454a6", "address": "fa:16:3e:eb:7c:ee", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33c5f5-85", "ovs_interfaceid": "eb33c5f5-8500-42cc-997d-94069fc454a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Converting VIF {"id": "eb33c5f5-8500-42cc-997d-94069fc454a6", "address": "fa:16:3e:eb:7c:ee", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33c5f5-85", "ovs_interfaceid": "eb33c5f5-8500-42cc-997d-94069fc454a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:7c:ee,bridge_name='br-int',has_traffic_filtering=True,id=eb33c5f5-8500-42cc-997d-94069fc454a6,network=Network(2ebb9b88-a9a3-4efd-a6e3-be76353d6be5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb33c5f5-85') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:49 user nova-compute[74630]: DEBUG os_vif [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:7c:ee,bridge_name='br-int',has_traffic_filtering=True,id=eb33c5f5-8500-42cc-997d-94069fc454a6,network=Network(2ebb9b88-a9a3-4efd-a6e3-be76353d6be5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb33c5f5-85') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e.part --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-0ef14435-c5c8-4574-b074-c1026c440ca4 req-d730973f-1ffc-4cc0-893b-f1496013d842 service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Received event network-vif-plugged-2722ab74-ccfd-44dc-ba27-6a2b98375ef8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0ef14435-c5c8-4574-b074-c1026c440ca4 req-d730973f-1ffc-4cc0-893b-f1496013d842 service nova] Acquiring lock "82be4c02-7dbe-4ed7-af19-e4da1855065d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0ef14435-c5c8-4574-b074-c1026c440ca4 req-d730973f-1ffc-4cc0-893b-f1496013d842 service nova] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0ef14435-c5c8-4574-b074-c1026c440ca4 req-d730973f-1ffc-4cc0-893b-f1496013d842 service nova] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-0ef14435-c5c8-4574-b074-c1026c440ca4 req-d730973f-1ffc-4cc0-893b-f1496013d842 service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] No waiting events found dispatching network-vif-plugged-2722ab74-ccfd-44dc-ba27-6a2b98375ef8 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:20:50 user nova-compute[74630]: WARNING nova.compute.manager [req-0ef14435-c5c8-4574-b074-c1026c440ca4 req-d730973f-1ffc-4cc0-893b-f1496013d842 service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Received unexpected event network-vif-plugged-2722ab74-ccfd-44dc-ba27-6a2b98375ef8 for instance with vm_state active and task_state None.
Oct 26 03:20:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'acfcf73c-4930-560e-bcf1-65e227c65652', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb33c5f5-85, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb33c5f5-85, col_values=(('qos', UUID('0aea5820-abf6-493c-984e-a772898164ee')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb33c5f5-85, col_values=(('external_ids', {'iface-id': 'eb33c5f5-8500-42cc-997d-94069fc454a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:7c:ee', 'vm-uuid': 'd1591088-0892-4aa5-b7ea-3addb083bc69'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:50 user nova-compute[74630]: INFO os_vif [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:7c:ee,bridge_name='br-int',has_traffic_filtering=True,id=eb33c5f5-8500-42cc-997d-94069fc454a6,network=Network(2ebb9b88-a9a3-4efd-a6e3-be76353d6be5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb33c5f5-85')
Oct 26 03:20:50 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] No VIF found with MAC fa:16:3e:eb:7c:ee, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e.part --force-share --output=json" returned: 0 in 0.571s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG nova.virt.images [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] 32cb998b-d4bd-4b65-9e8d-9e901f3bbe2f was qcow2, converting to raw {{(pid=74630) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:20:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e.part /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e.converted {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:51 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:20:51 user nova-compute[74630]: INFO nova.compute.claims [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Claim successful on node user
Oct 26 03:20:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e.part /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e.converted" returned: 0 in 0.667s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e.converted --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:51 user nova-compute[74630]: DEBUG nova.network.neutron [req-3535b8a0-1275-4638-a7c8-946f0daa8d10 req-47ae65c5-5c45-46d9-8501-dab9e5dd8357 service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Updated VIF entry in instance network info cache for port eb33c5f5-8500-42cc-997d-94069fc454a6. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:20:51 user nova-compute[74630]: DEBUG nova.network.neutron [req-3535b8a0-1275-4638-a7c8-946f0daa8d10 req-47ae65c5-5c45-46d9-8501-dab9e5dd8357 service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Updating instance_info_cache with network_info: [{"id": "eb33c5f5-8500-42cc-997d-94069fc454a6", "address": "fa:16:3e:eb:7c:ee", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33c5f5-85", "ovs_interfaceid": "eb33c5f5-8500-42cc-997d-94069fc454a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3535b8a0-1275-4638-a7c8-946f0daa8d10 req-47ae65c5-5c45-46d9-8501-dab9e5dd8357 service nova] Releasing lock "refresh_cache-d1591088-0892-4aa5-b7ea-3addb083bc69" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG nova.network.neutron [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Successfully created port: 94f2d964-4b95-4a4c-a7cb-94bd34132f52 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e.converted --force-share --output=json" returned: 0 in 0.519s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "8b373f3ef722f1eed9bbf28190fadd2b95c81a9e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.064s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e --force-share --output=json" returned: 0 in 0.409s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "8b373f3ef722f1eed9bbf28190fadd2b95c81a9e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "8b373f3ef722f1eed9bbf28190fadd2b95c81a9e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.026s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Received event network-vif-plugged-2722ab74-ccfd-44dc-ba27-6a2b98375ef8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] Acquiring lock "82be4c02-7dbe-4ed7-af19-e4da1855065d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] No waiting events found dispatching network-vif-plugged-2722ab74-ccfd-44dc-ba27-6a2b98375ef8 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:20:52 user nova-compute[74630]: WARNING nova.compute.manager [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Received unexpected event network-vif-plugged-2722ab74-ccfd-44dc-ba27-6a2b98375ef8 for instance with vm_state active and task_state None.
Oct 26 03:20:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Received event network-vif-plugged-2f8d8a99-3185-41a0-b8a2-85b0c4d22003 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] Acquiring lock "fa1dd816-9dc1-4d48-b608-aa0218f22369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] No waiting events found dispatching network-vif-plugged-2f8d8a99-3185-41a0-b8a2-85b0c4d22003 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:20:52 user nova-compute[74630]: WARNING nova.compute.manager [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Received unexpected event network-vif-plugged-2f8d8a99-3185-41a0-b8a2-85b0c4d22003 for instance with vm_state active and task_state None.
Oct 26 03:20:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Received event network-vif-plugged-2f8d8a99-3185-41a0-b8a2-85b0c4d22003 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] Acquiring lock "fa1dd816-9dc1-4d48-b608-aa0218f22369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] No waiting events found dispatching network-vif-plugged-2f8d8a99-3185-41a0-b8a2-85b0c4d22003 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:20:52 user nova-compute[74630]: WARNING nova.compute.manager [req-493c57ee-cfe4-4b95-8fa4-0fcd515d9e80 req-3b91d98b-2b69-4d13-8638-875cbac92a5b service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Received unexpected event network-vif-plugged-2f8d8a99-3185-41a0-b8a2-85b0c4d22003 for instance with vm_state active and task_state None.
Oct 26 03:20:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e --force-share --output=json" returned: 0 in 0.477s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e,backing_fmt=raw /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e,backing_fmt=raw /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk 1073741824" returned: 0 in 0.193s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "8b373f3ef722f1eed9bbf28190fadd2b95c81a9e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.678s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:53 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:20:53 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:20:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.297s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:20:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e --force-share --output=json" returned: 0 in 0.750s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:53 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:20:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:20:54 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:20:54 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG nova.network.neutron [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Successfully updated port: 94f2d964-4b95-4a4c-a7cb-94bd34132f52 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "refresh_cache-bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquired lock "refresh_cache-bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG nova.network.neutron [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk --force-share --output=json" returned: 0 in 0.484s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Cannot resize image /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Ensure instance console log exists: /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG nova.policy [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad908828808542d88bf198ad10a67ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee5c011c90e43d7be5ae38812de10e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG nova.compute.manager [req-2f8c0e97-fae0-46b0-892d-7acf6893e19f req-834af42f-5f0d-4510-b815-dd818d95b099 service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Received event network-changed-94f2d964-4b95-4a4c-a7cb-94bd34132f52 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG nova.compute.manager [req-2f8c0e97-fae0-46b0-892d-7acf6893e19f req-834af42f-5f0d-4510-b815-dd818d95b099 service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Refreshing instance network info cache due to event network-changed-94f2d964-4b95-4a4c-a7cb-94bd34132f52. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2f8c0e97-fae0-46b0-892d-7acf6893e19f req-834af42f-5f0d-4510-b815-dd818d95b099 service nova] Acquiring lock "refresh_cache-bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:20:54 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Creating image(s)
Oct 26 03:20:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "/opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "/opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG nova.network.neutron [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.351s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.336s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk 1073741824" returned: 0 in 0.103s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.449s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Updating instance_info_cache with network_info: [{"id": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "address": "fa:16:3e:33:fc:53", "network": {"id": "aa89e219-e3f2-4813-a9f8-d8d983c69cc9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1154204399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7adc62ff197348a19e8870850be33852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f2d964-4b", "ovs_interfaceid": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Releasing lock "refresh_cache-bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.compute.manager [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Instance network_info: |[{"id": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "address": "fa:16:3e:33:fc:53", "network": {"id": "aa89e219-e3f2-4813-a9f8-d8d983c69cc9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1154204399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7adc62ff197348a19e8870850be33852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f2d964-4b", "ovs_interfaceid": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2f8c0e97-fae0-46b0-892d-7acf6893e19f req-834af42f-5f0d-4510-b815-dd818d95b099 service nova] Acquired lock "refresh_cache-bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.network.neutron [req-2f8c0e97-fae0-46b0-892d-7acf6893e19f req-834af42f-5f0d-4510-b815-dd818d95b099 service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Refreshing network info cache for port 94f2d964-4b95-4a4c-a7cb-94bd34132f52 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Start _get_guest_xml network_info=[{"id": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "address": "fa:16:3e:33:fc:53", "network": {"id": "aa89e219-e3f2-4813-a9f8-d8d983c69cc9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1154204399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7adc62ff197348a19e8870850be33852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f2d964-4b", "ovs_interfaceid": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:20:35Z,direct_url=<?>,disk_format='qcow2',id=32cb998b-d4bd-4b65-9e8d-9e901f3bbe2f,min_disk=0,min_ram=0,name='',owner='9195d42a35e14d6ea4538111c8d270ad',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:20:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'encrypted': False, 'image_id': '32cb998b-d4bd-4b65-9e8d-9e901f3bbe2f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:20:55 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:55 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:20:35Z,direct_url=<?>,disk_format='qcow2',id=32cb998b-d4bd-4b65-9e8d-9e901f3bbe2f,min_disk=0,min_ram=0,name='',owner='9195d42a35e14d6ea4538111c8d270ad',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:20:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1330254384',display_name='tempest-AttachSCSIVolumeTestJSON-server-1330254384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1330254384',id=9,image_ref='32cb998b-d4bd-4b65-9e8d-9e901f3bbe2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZ2xOIGLzjX1FvphLBbMCFCZ3J6zR7Tafod2krG7wOHFkG4/w5lYXWROX6sNi+TClJG9Jr4iSZR8nZfTh0qt1J706GzmWtQSDhEfMAX+bJdkBkP7Fv8OAYCBFJ9QbJH0Q==',key_name='tempest-keypair-291388067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7adc62ff197348a19e8870850be33852',ramdisk_id='',reservation_id='r-ywt50wef',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='32cb998b-d4bd-4b65-9e8d-9e901f3bbe2f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2142747077',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2142747077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcf784e61b0b4817a21c59028aa3ac66',uuid=bb93fd61-5432-44d2-86c4-b4cdccc0e1c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "address": "fa:16:3e:33:fc:53", "network": {"id": "aa89e219-e3f2-4813-a9f8-d8d983c69cc9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1154204399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7adc62ff197348a19e8870850be33852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f2d964-4b", "ovs_interfaceid": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Converting VIF {"id": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "address": "fa:16:3e:33:fc:53", "network": {"id": "aa89e219-e3f2-4813-a9f8-d8d983c69cc9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1154204399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7adc62ff197348a19e8870850be33852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f2d964-4b", "ovs_interfaceid": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:fc:53,bridge_name='br-int',has_traffic_filtering=True,id=94f2d964-4b95-4a4c-a7cb-94bd34132f52,network=Network(aa89e219-e3f2-4813-a9f8-d8d983c69cc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f2d964-4b') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.objects.instance [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lazy-loading 'pci_devices' on Instance uuid bb93fd61-5432-44d2-86c4-b4cdccc0e1c5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.327s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:20:55 user nova-compute[74630]:   <uuid>bb93fd61-5432-44d2-86c4-b4cdccc0e1c5</uuid>
Oct 26 03:20:55 user nova-compute[74630]:   <name>instance-00000009</name>
Oct 26 03:20:55 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:20:55 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:20:55 user nova-compute[74630]:   <metadata>
Oct 26 03:20:55 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:20:55 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:20:55 user nova-compute[74630]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1330254384</nova:name>
Oct 26 03:20:55 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:20:55</nova:creationTime>
Oct 26 03:20:55 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:20:55 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:20:55 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:20:55 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:20:55 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:20:55 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:20:55 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:20:55 user nova-compute[74630]:       <nova:owner>
Oct 26 03:20:55 user nova-compute[74630]:         <nova:user uuid="bcf784e61b0b4817a21c59028aa3ac66">tempest-AttachSCSIVolumeTestJSON-2142747077-project-member</nova:user>
Oct 26 03:20:55 user nova-compute[74630]:         <nova:project uuid="7adc62ff197348a19e8870850be33852">tempest-AttachSCSIVolumeTestJSON-2142747077</nova:project>
Oct 26 03:20:55 user nova-compute[74630]:       </nova:owner>
Oct 26 03:20:55 user nova-compute[74630]:       <nova:root type="image" uuid="32cb998b-d4bd-4b65-9e8d-9e901f3bbe2f"/>
Oct 26 03:20:55 user nova-compute[74630]:       <nova:ports>
Oct 26 03:20:55 user nova-compute[74630]:         <nova:port uuid="94f2d964-4b95-4a4c-a7cb-94bd34132f52">
Oct 26 03:20:55 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 03:20:55 user nova-compute[74630]:         </nova:port>
Oct 26 03:20:55 user nova-compute[74630]:       </nova:ports>
Oct 26 03:20:55 user nova-compute[74630]:     </nova:instance>
Oct 26 03:20:55 user nova-compute[74630]:   </metadata>
Oct 26 03:20:55 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:20:55 user nova-compute[74630]:     <system>
Oct 26 03:20:55 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:20:55 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:20:55 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:20:55 user nova-compute[74630]:       <entry name="serial">bb93fd61-5432-44d2-86c4-b4cdccc0e1c5</entry>
Oct 26 03:20:55 user nova-compute[74630]:       <entry name="uuid">bb93fd61-5432-44d2-86c4-b4cdccc0e1c5</entry>
Oct 26 03:20:55 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:20:55 user nova-compute[74630]:     </system>
Oct 26 03:20:55 user nova-compute[74630]:   </sysinfo>
Oct 26 03:20:55 user nova-compute[74630]:   <os>
Oct 26 03:20:55 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:20:55 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:20:55 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:20:55 user nova-compute[74630]:   </os>
Oct 26 03:20:55 user nova-compute[74630]:   <features>
Oct 26 03:20:55 user nova-compute[74630]:     <acpi/>
Oct 26 03:20:55 user nova-compute[74630]:     <apic/>
Oct 26 03:20:55 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:20:55 user nova-compute[74630]:   </features>
Oct 26 03:20:55 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:20:55 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:20:55 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:20:55 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:20:55 user nova-compute[74630]:   </clock>
Oct 26 03:20:55 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:20:55 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:20:55 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:20:55 user nova-compute[74630]:   </cpu>
Oct 26 03:20:55 user nova-compute[74630]:   <devices>
Oct 26 03:20:55 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:20:55 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:20:55 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk"/>
Oct 26 03:20:55 user nova-compute[74630]:       <target dev="sda" bus="scsi"/>
Oct 26 03:20:55 user nova-compute[74630]:       <address type="drive" controller="0" unit="0"/>
Oct 26 03:20:55 user nova-compute[74630]:     </disk>
Oct 26 03:20:55 user nova-compute[74630]:     <disk type="file" device="cdrom">
Oct 26 03:20:55 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 03:20:55 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk.config"/>
Oct 26 03:20:55 user nova-compute[74630]:       <target dev="sdb" bus="scsi"/>
Oct 26 03:20:55 user nova-compute[74630]:       <address type="drive" controller="0" unit="1"/>
Oct 26 03:20:55 user nova-compute[74630]:     </disk>
Oct 26 03:20:55 user nova-compute[74630]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 26 03:20:55 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:20:55 user nova-compute[74630]:       <mac address="fa:16:3e:33:fc:53"/>
Oct 26 03:20:55 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:55 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:20:55 user nova-compute[74630]:       <target dev="tap94f2d964-4b"/>
Oct 26 03:20:55 user nova-compute[74630]:     </interface>
Oct 26 03:20:55 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:20:55 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/console.log" append="off"/>
Oct 26 03:20:55 user nova-compute[74630]:     </serial>
Oct 26 03:20:55 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:20:55 user nova-compute[74630]:     <video>
Oct 26 03:20:55 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:55 user nova-compute[74630]:     </video>
Oct 26 03:20:55 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:20:55 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:20:55 user nova-compute[74630]:     </rng>
Oct 26 03:20:55 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:20:55 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:20:55 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:20:55 user nova-compute[74630]:     </memballoon>
Oct 26 03:20:55 user nova-compute[74630]:   </devices>
Oct 26 03:20:55 user nova-compute[74630]: </domain>
Oct 26 03:20:55 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1330254384',display_name='tempest-AttachSCSIVolumeTestJSON-server-1330254384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1330254384',id=9,image_ref='32cb998b-d4bd-4b65-9e8d-9e901f3bbe2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZ2xOIGLzjX1FvphLBbMCFCZ3J6zR7Tafod2krG7wOHFkG4/w5lYXWROX6sNi+TClJG9Jr4iSZR8nZfTh0qt1J706GzmWtQSDhEfMAX+bJdkBkP7Fv8OAYCBFJ9QbJH0Q==',key_name='tempest-keypair-291388067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7adc62ff197348a19e8870850be33852',ramdisk_id='',reservation_id='r-ywt50wef',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='32cb998b-d4bd-4b65-9e8d-9e901f3bbe2f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2142747077',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2142747077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcf784e61b0b4817a21c59028aa3ac66',uuid=bb93fd61-5432-44d2-86c4-b4cdccc0e1c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "address": "fa:16:3e:33:fc:53", "network": {"id": "aa89e219-e3f2-4813-a9f8-d8d983c69cc9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1154204399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7adc62ff197348a19e8870850be33852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f2d964-4b", "ovs_interfaceid": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Converting VIF {"id": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "address": "fa:16:3e:33:fc:53", "network": {"id": "aa89e219-e3f2-4813-a9f8-d8d983c69cc9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1154204399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7adc62ff197348a19e8870850be33852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f2d964-4b", "ovs_interfaceid": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:fc:53,bridge_name='br-int',has_traffic_filtering=True,id=94f2d964-4b95-4a4c-a7cb-94bd34132f52,network=Network(aa89e219-e3f2-4813-a9f8-d8d983c69cc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f2d964-4b') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG os_vif [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:fc:53,bridge_name='br-int',has_traffic_filtering=True,id=94f2d964-4b95-4a4c-a7cb-94bd34132f52,network=Network(aa89e219-e3f2-4813-a9f8-d8d983c69cc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f2d964-4b') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ead322a-e09c-5d36-9bf4-6c37cbe806c9', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94f2d964-4b, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94f2d964-4b, col_values=(('qos', UUID('b7a7f057-11a9-4322-aa5d-1b7afbd556f4')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94f2d964-4b, col_values=(('external_ids', {'iface-id': '94f2d964-4b95-4a4c-a7cb-94bd34132f52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:fc:53', 'vm-uuid': 'bb93fd61-5432-44d2-86c4-b4cdccc0e1c5'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:55 user nova-compute[74630]: INFO os_vif [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:fc:53,bridge_name='br-int',has_traffic_filtering=True,id=94f2d964-4b95-4a4c-a7cb-94bd34132f52,network=Network(aa89e219-e3f2-4813-a9f8-d8d983c69cc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f2d964-4b')
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] No BDM found with device name sda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] No VIF found with MAC fa:16:3e:33:fc:53, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:20:56 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Using config drive
Oct 26 03:20:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json" returned: 0 in 0.405s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Cannot resize image /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Ensure instance console log exists: /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Successfully created port: 4fb62476-5cff-4ebe-a5fe-4990895d991d {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:20:56 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Instance spawned successfully.
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.network.neutron [req-2f8c0e97-fae0-46b0-892d-7acf6893e19f req-834af42f-5f0d-4510-b815-dd818d95b099 service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Updated VIF entry in instance network info cache for port 94f2d964-4b95-4a4c-a7cb-94bd34132f52. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.network.neutron [req-2f8c0e97-fae0-46b0-892d-7acf6893e19f req-834af42f-5f0d-4510-b815-dd818d95b099 service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Updating instance_info_cache with network_info: [{"id": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "address": "fa:16:3e:33:fc:53", "network": {"id": "aa89e219-e3f2-4813-a9f8-d8d983c69cc9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1154204399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7adc62ff197348a19e8870850be33852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f2d964-4b", "ovs_interfaceid": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:20:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2f8c0e97-fae0-46b0-892d-7acf6893e19f req-834af42f-5f0d-4510-b815-dd818d95b099 service nova] Releasing lock "refresh_cache-bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:56 user nova-compute[74630]: INFO nova.compute.manager [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Took 13.86 seconds to spawn the instance on the hypervisor.
Oct 26 03:20:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:20:57 user nova-compute[74630]: INFO nova.compute.manager [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Took 16.10 seconds to build instance.
Oct 26 03:20:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-761d3d73-f73b-41ef-a1b8-8f4c8471c270 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.384s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:20:57 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Creating config drive at /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk.config
Oct 26 03:20:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfhgpwoce {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfhgpwoce" returned: 0 in 0.092s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:20:57 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Successfully updated port: 4fb62476-5cff-4ebe-a5fe-4990895d991d {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:20:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquired lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:57 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-e7f64588-bcde-4da9-b86c-0517690b2cba req-baee3044-2b2f-49f2-acab-96aacd58b63d service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received event network-changed-4fb62476-5cff-4ebe-a5fe-4990895d991d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-e7f64588-bcde-4da9-b86c-0517690b2cba req-baee3044-2b2f-49f2-acab-96aacd58b63d service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Refreshing instance network info cache due to event network-changed-4fb62476-5cff-4ebe-a5fe-4990895d991d. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e7f64588-bcde-4da9-b86c-0517690b2cba req-baee3044-2b2f-49f2-acab-96aacd58b63d service nova] Acquiring lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Updating instance_info_cache with network_info: [{"id": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "address": "fa:16:3e:0e:14:6d", "network": {"id": "efa0bf4a-3164-4b5e-8a28-cb55a80bf10b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1237751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb62476-5c", "ovs_interfaceid": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Releasing lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Instance network_info: |[{"id": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "address": "fa:16:3e:0e:14:6d", "network": {"id": "efa0bf4a-3164-4b5e-8a28-cb55a80bf10b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1237751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb62476-5c", "ovs_interfaceid": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e7f64588-bcde-4da9-b86c-0517690b2cba req-baee3044-2b2f-49f2-acab-96aacd58b63d service nova] Acquired lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.network.neutron [req-e7f64588-bcde-4da9-b86c-0517690b2cba req-baee3044-2b2f-49f2-acab-96aacd58b63d service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Refreshing network info cache for port 4fb62476-5cff-4ebe-a5fe-4990895d991d {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Start _get_guest_xml network_info=[{"id": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "address": "fa:16:3e:0e:14:6d", "network": {"id": "efa0bf4a-3164-4b5e-8a28-cb55a80bf10b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1237751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb62476-5c", "ovs_interfaceid": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:20:58 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:58 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1573607150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1573607150',id=10,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZvVt6JBJwjHuYv5rzAu6BfJiTRPT7gKst00ewuSImGcEAgmFYYyJpfkfMTPoD2yUtdQjdpC1u2VHivVP4deD3aeXnWol8rB/ye8SYwl6D/y52fGTUBa9use//IRHEP+g==',key_name='tempest-keypair-1967708874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ee5c011c90e43d7be5ae38812de10e0',ramdisk_id='',reservation_id='r-48ob7np6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-162967180',owner_user_name='tempest-TaggedAttachmentsTest-162967180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad908828808542d88bf198ad10a67ce8',uuid=5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "address": "fa:16:3e:0e:14:6d", "network": {"id": "efa0bf4a-3164-4b5e-8a28-cb55a80bf10b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1237751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb62476-5c", "ovs_interfaceid": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Converting VIF {"id": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "address": "fa:16:3e:0e:14:6d", "network": {"id": "efa0bf4a-3164-4b5e-8a28-cb55a80bf10b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1237751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb62476-5c", "ovs_interfaceid": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:14:6d,bridge_name='br-int',has_traffic_filtering=True,id=4fb62476-5cff-4ebe-a5fe-4990895d991d,network=Network(efa0bf4a-3164-4b5e-8a28-cb55a80bf10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb62476-5c') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:20:58 user nova-compute[74630]:   <uuid>5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b</uuid>
Oct 26 03:20:58 user nova-compute[74630]:   <name>instance-0000000a</name>
Oct 26 03:20:58 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:20:58 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:20:58 user nova-compute[74630]:   <metadata>
Oct 26 03:20:58 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:20:58 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:20:58 user nova-compute[74630]:       <nova:name>tempest-device-tagging-server-1573607150</nova:name>
Oct 26 03:20:58 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:20:58</nova:creationTime>
Oct 26 03:20:58 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:20:58 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:20:58 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:20:58 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:20:58 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:20:58 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:20:58 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:20:58 user nova-compute[74630]:       <nova:owner>
Oct 26 03:20:58 user nova-compute[74630]:         <nova:user uuid="ad908828808542d88bf198ad10a67ce8">tempest-TaggedAttachmentsTest-162967180-project-member</nova:user>
Oct 26 03:20:58 user nova-compute[74630]:         <nova:project uuid="7ee5c011c90e43d7be5ae38812de10e0">tempest-TaggedAttachmentsTest-162967180</nova:project>
Oct 26 03:20:58 user nova-compute[74630]:       </nova:owner>
Oct 26 03:20:58 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:20:58 user nova-compute[74630]:       <nova:ports>
Oct 26 03:20:58 user nova-compute[74630]:         <nova:port uuid="4fb62476-5cff-4ebe-a5fe-4990895d991d">
Oct 26 03:20:58 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 03:20:58 user nova-compute[74630]:         </nova:port>
Oct 26 03:20:58 user nova-compute[74630]:       </nova:ports>
Oct 26 03:20:58 user nova-compute[74630]:     </nova:instance>
Oct 26 03:20:58 user nova-compute[74630]:   </metadata>
Oct 26 03:20:58 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:20:58 user nova-compute[74630]:     <system>
Oct 26 03:20:58 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:20:58 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:20:58 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:20:58 user nova-compute[74630]:       <entry name="serial">5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b</entry>
Oct 26 03:20:58 user nova-compute[74630]:       <entry name="uuid">5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b</entry>
Oct 26 03:20:58 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:20:58 user nova-compute[74630]:     </system>
Oct 26 03:20:58 user nova-compute[74630]:   </sysinfo>
Oct 26 03:20:58 user nova-compute[74630]:   <os>
Oct 26 03:20:58 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:20:58 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:20:58 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:20:58 user nova-compute[74630]:   </os>
Oct 26 03:20:58 user nova-compute[74630]:   <features>
Oct 26 03:20:58 user nova-compute[74630]:     <acpi/>
Oct 26 03:20:58 user nova-compute[74630]:     <apic/>
Oct 26 03:20:58 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:20:58 user nova-compute[74630]:   </features>
Oct 26 03:20:58 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:20:58 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:20:58 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:20:58 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:20:58 user nova-compute[74630]:   </clock>
Oct 26 03:20:58 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:20:58 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:20:58 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:20:58 user nova-compute[74630]:   </cpu>
Oct 26 03:20:58 user nova-compute[74630]:   <devices>
Oct 26 03:20:58 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:20:58 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:20:58 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk"/>
Oct 26 03:20:58 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:20:58 user nova-compute[74630]:     </disk>
Oct 26 03:20:58 user nova-compute[74630]:     <disk type="file" device="cdrom">
Oct 26 03:20:58 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 03:20:58 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk.config"/>
Oct 26 03:20:58 user nova-compute[74630]:       <target dev="hda" bus="ide"/>
Oct 26 03:20:58 user nova-compute[74630]:     </disk>
Oct 26 03:20:58 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:20:58 user nova-compute[74630]:       <mac address="fa:16:3e:0e:14:6d"/>
Oct 26 03:20:58 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:58 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:20:58 user nova-compute[74630]:       <target dev="tap4fb62476-5c"/>
Oct 26 03:20:58 user nova-compute[74630]:     </interface>
Oct 26 03:20:58 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:20:58 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/console.log" append="off"/>
Oct 26 03:20:58 user nova-compute[74630]:     </serial>
Oct 26 03:20:58 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:20:58 user nova-compute[74630]:     <video>
Oct 26 03:20:58 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:20:58 user nova-compute[74630]:     </video>
Oct 26 03:20:58 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:20:58 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:20:58 user nova-compute[74630]:     </rng>
Oct 26 03:20:58 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:20:58 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:20:58 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:20:58 user nova-compute[74630]:     </memballoon>
Oct 26 03:20:58 user nova-compute[74630]:   </devices>
Oct 26 03:20:58 user nova-compute[74630]: </domain>
Oct 26 03:20:58 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1573607150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1573607150',id=10,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZvVt6JBJwjHuYv5rzAu6BfJiTRPT7gKst00ewuSImGcEAgmFYYyJpfkfMTPoD2yUtdQjdpC1u2VHivVP4deD3aeXnWol8rB/ye8SYwl6D/y52fGTUBa9use//IRHEP+g==',key_name='tempest-keypair-1967708874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ee5c011c90e43d7be5ae38812de10e0',ramdisk_id='',reservation_id='r-48ob7np6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-162967180',owner_user_name='tempest-TaggedAttachmentsTest-162967180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad908828808542d88bf198ad10a67ce8',uuid=5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "address": "fa:16:3e:0e:14:6d", "network": {"id": "efa0bf4a-3164-4b5e-8a28-cb55a80bf10b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1237751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb62476-5c", "ovs_interfaceid": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Converting VIF {"id": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "address": "fa:16:3e:0e:14:6d", "network": {"id": "efa0bf4a-3164-4b5e-8a28-cb55a80bf10b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1237751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb62476-5c", "ovs_interfaceid": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:14:6d,bridge_name='br-int',has_traffic_filtering=True,id=4fb62476-5cff-4ebe-a5fe-4990895d991d,network=Network(efa0bf4a-3164-4b5e-8a28-cb55a80bf10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb62476-5c') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG os_vif [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:14:6d,bridge_name='br-int',has_traffic_filtering=True,id=4fb62476-5cff-4ebe-a5fe-4990895d991d,network=Network(efa0bf4a-3164-4b5e-8a28-cb55a80bf10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb62476-5c') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b29c7f11-d79c-57ca-87dd-0fcda9cd75fd', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fb62476-5c, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4fb62476-5c, col_values=(('qos', UUID('91662f59-85fa-4172-9f14-d99e0aa850d6')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4fb62476-5c, col_values=(('external_ids', {'iface-id': '4fb62476-5cff-4ebe-a5fe-4990895d991d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:14:6d', 'vm-uuid': '5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:20:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:58 user nova-compute[74630]: INFO os_vif [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:14:6d,bridge_name='br-int',has_traffic_filtering=True,id=4fb62476-5cff-4ebe-a5fe-4990895d991d,network=Network(efa0bf4a-3164-4b5e-8a28-cb55a80bf10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb62476-5c')
Oct 26 03:20:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:20:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] No BDM found with device name hda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:20:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] No VIF found with MAC fa:16:3e:0e:14:6d, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:20:59 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Using config drive
Oct 26 03:20:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:20:59 user nova-compute[74630]: DEBUG nova.network.neutron [req-e7f64588-bcde-4da9-b86c-0517690b2cba req-baee3044-2b2f-49f2-acab-96aacd58b63d service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Updated VIF entry in instance network info cache for port 4fb62476-5cff-4ebe-a5fe-4990895d991d. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:20:59 user nova-compute[74630]: DEBUG nova.network.neutron [req-e7f64588-bcde-4da9-b86c-0517690b2cba req-baee3044-2b2f-49f2-acab-96aacd58b63d service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Updating instance_info_cache with network_info: [{"id": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "address": "fa:16:3e:0e:14:6d", "network": {"id": "efa0bf4a-3164-4b5e-8a28-cb55a80bf10b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1237751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb62476-5c", "ovs_interfaceid": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:20:59 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Creating config drive at /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk.config
Oct 26 03:20:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmss7468i {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:20:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e7f64588-bcde-4da9-b86c-0517690b2cba req-baee3044-2b2f-49f2-acab-96aacd58b63d service nova] Releasing lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:20:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmss7468i" returned: 0 in 0.057s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Acquiring lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:21:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:01 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:21:01 user nova-compute[74630]: INFO nova.compute.claims [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Claim successful on node user
Oct 26 03:21:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:01 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:21:01 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:21:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.712s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG nova.compute.manager [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:21:02 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:21:02 user nova-compute[74630]: DEBUG nova.compute.manager [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG nova.policy [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf85228071034c539eb8107fa7215a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5438cb807444ca791de9c7070430b88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG nova.compute.manager [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:21:02 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Creating image(s)
Oct 26 03:21:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Acquiring lock "/opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "/opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "/opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.232s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.229s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk 1073741824" returned: 0 in 0.063s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.233s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Checking if we can resize image /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG nova.network.neutron [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Successfully created port: f59f8d04-3231-40d4-8e2f-f40517ed0d09 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG nova.compute.manager [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:21:03 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Instance spawned successfully.
Oct 26 03:21:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Cannot resize image /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Ensure instance console log exists: /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:03 user nova-compute[74630]: INFO nova.compute.manager [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Took 14.58 seconds to spawn the instance on the hypervisor.
Oct 26 03:21:03 user nova-compute[74630]: DEBUG nova.compute.manager [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:21:03 user nova-compute[74630]: INFO nova.compute.manager [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Took 16.45 seconds to build instance.
Oct 26 03:21:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-24893dae-5306-4efe-b308-0138f757c6a5 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.995s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.network.neutron [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Successfully updated port: f59f8d04-3231-40d4-8e2f-f40517ed0d09 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Acquiring lock "refresh_cache-933f84b6-a3bb-47d7-b82e-f80ec5c15c43" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Acquired lock "refresh_cache-933f84b6-a3bb-47d7-b82e-f80ec5c15c43" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.network.neutron [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-b6ab6e5d-071e-4678-b8ad-b7be792e8ba4 req-d902415e-1156-41ae-a6c1-31590df6ed13 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Received event network-changed-f59f8d04-3231-40d4-8e2f-f40517ed0d09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-b6ab6e5d-071e-4678-b8ad-b7be792e8ba4 req-d902415e-1156-41ae-a6c1-31590df6ed13 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Refreshing instance network info cache due to event network-changed-f59f8d04-3231-40d4-8e2f-f40517ed0d09. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b6ab6e5d-071e-4678-b8ad-b7be792e8ba4 req-d902415e-1156-41ae-a6c1-31590df6ed13 service nova] Acquiring lock "refresh_cache-933f84b6-a3bb-47d7-b82e-f80ec5c15c43" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.network.neutron [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:21:04 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Instance spawned successfully.
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:04 user nova-compute[74630]: INFO nova.compute.manager [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Took 10.14 seconds to spawn the instance on the hypervisor.
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.network.neutron [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Updating instance_info_cache with network_info: [{"id": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "address": "fa:16:3e:1f:1b:29", "network": {"id": "fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1042679542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5438cb807444ca791de9c7070430b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59f8d04-32", "ovs_interfaceid": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Releasing lock "refresh_cache-933f84b6-a3bb-47d7-b82e-f80ec5c15c43" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.compute.manager [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Instance network_info: |[{"id": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "address": "fa:16:3e:1f:1b:29", "network": {"id": "fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1042679542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5438cb807444ca791de9c7070430b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59f8d04-32", "ovs_interfaceid": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b6ab6e5d-071e-4678-b8ad-b7be792e8ba4 req-d902415e-1156-41ae-a6c1-31590df6ed13 service nova] Acquired lock "refresh_cache-933f84b6-a3bb-47d7-b82e-f80ec5c15c43" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-b6ab6e5d-071e-4678-b8ad-b7be792e8ba4 req-d902415e-1156-41ae-a6c1-31590df6ed13 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Refreshing network info cache for port f59f8d04-3231-40d4-8e2f-f40517ed0d09 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Start _get_guest_xml network_info=[{"id": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "address": "fa:16:3e:1f:1b:29", "network": {"id": "fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1042679542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5438cb807444ca791de9c7070430b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59f8d04-32", "ovs_interfaceid": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:21:04 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:21:04 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:21:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-376306411',display_name='tempest-VolumesAssistedSnapshotsTest-server-376306411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-376306411',id=11,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI35lIo7EuEGghCIgN4nejA7atOtkw1+W2ar2Mh261vl6es40QctNNIBYzTQ91yPdFvNXyQD7hJjtLJK9iE1ayr59cbjZ2OUw76nQlNG3qO29D2qu6XZabr6naUs3ePtaQ==',key_name='tempest-keypair-1965963470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5438cb807444ca791de9c7070430b88',ramdisk_id='',reservation_id='r-050xu4nd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-784835547',owner_user_name='tempest-VolumesAssistedSnapshotsTest-784835547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf85228071034c539eb8107fa7215a28',uuid=933f84b6-a3bb-47d7-b82e-f80ec5c15c43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "address": "fa:16:3e:1f:1b:29", "network": {"id": "fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1042679542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5438cb807444ca791de9c7070430b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59f8d04-32", "ovs_interfaceid": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Converting VIF {"id": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "address": "fa:16:3e:1f:1b:29", "network": {"id": "fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1042679542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5438cb807444ca791de9c7070430b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59f8d04-32", "ovs_interfaceid": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:1b:29,bridge_name='br-int',has_traffic_filtering=True,id=f59f8d04-3231-40d4-8e2f-f40517ed0d09,network=Network(fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59f8d04-32') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.objects.instance [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lazy-loading 'pci_devices' on Instance uuid 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:21:04 user nova-compute[74630]: INFO nova.compute.manager [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Took 13.87 seconds to build instance.
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:21:04 user nova-compute[74630]:   <uuid>933f84b6-a3bb-47d7-b82e-f80ec5c15c43</uuid>
Oct 26 03:21:04 user nova-compute[74630]:   <name>instance-0000000b</name>
Oct 26 03:21:04 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:21:04 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:21:04 user nova-compute[74630]:   <metadata>
Oct 26 03:21:04 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:21:04 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:21:04 user nova-compute[74630]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-376306411</nova:name>
Oct 26 03:21:04 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:21:04</nova:creationTime>
Oct 26 03:21:04 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:21:04 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:21:04 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:21:04 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:21:04 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:21:04 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:21:04 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:21:04 user nova-compute[74630]:       <nova:owner>
Oct 26 03:21:04 user nova-compute[74630]:         <nova:user uuid="bf85228071034c539eb8107fa7215a28">tempest-VolumesAssistedSnapshotsTest-784835547-project-member</nova:user>
Oct 26 03:21:04 user nova-compute[74630]:         <nova:project uuid="d5438cb807444ca791de9c7070430b88">tempest-VolumesAssistedSnapshotsTest-784835547</nova:project>
Oct 26 03:21:04 user nova-compute[74630]:       </nova:owner>
Oct 26 03:21:04 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:21:04 user nova-compute[74630]:       <nova:ports>
Oct 26 03:21:04 user nova-compute[74630]:         <nova:port uuid="f59f8d04-3231-40d4-8e2f-f40517ed0d09">
Oct 26 03:21:04 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 03:21:04 user nova-compute[74630]:         </nova:port>
Oct 26 03:21:04 user nova-compute[74630]:       </nova:ports>
Oct 26 03:21:04 user nova-compute[74630]:     </nova:instance>
Oct 26 03:21:04 user nova-compute[74630]:   </metadata>
Oct 26 03:21:04 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:21:04 user nova-compute[74630]:     <system>
Oct 26 03:21:04 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:21:04 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:21:04 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:21:04 user nova-compute[74630]:       <entry name="serial">933f84b6-a3bb-47d7-b82e-f80ec5c15c43</entry>
Oct 26 03:21:04 user nova-compute[74630]:       <entry name="uuid">933f84b6-a3bb-47d7-b82e-f80ec5c15c43</entry>
Oct 26 03:21:04 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:21:04 user nova-compute[74630]:     </system>
Oct 26 03:21:04 user nova-compute[74630]:   </sysinfo>
Oct 26 03:21:04 user nova-compute[74630]:   <os>
Oct 26 03:21:04 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:21:04 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:21:04 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:21:04 user nova-compute[74630]:   </os>
Oct 26 03:21:04 user nova-compute[74630]:   <features>
Oct 26 03:21:04 user nova-compute[74630]:     <acpi/>
Oct 26 03:21:04 user nova-compute[74630]:     <apic/>
Oct 26 03:21:04 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:21:04 user nova-compute[74630]:   </features>
Oct 26 03:21:04 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:21:04 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:21:04 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:21:04 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:21:04 user nova-compute[74630]:   </clock>
Oct 26 03:21:04 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:21:04 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:21:04 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:21:04 user nova-compute[74630]:   </cpu>
Oct 26 03:21:04 user nova-compute[74630]:   <devices>
Oct 26 03:21:04 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:21:04 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:21:04 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk"/>
Oct 26 03:21:04 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:21:04 user nova-compute[74630]:     </disk>
Oct 26 03:21:04 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:21:04 user nova-compute[74630]:       <mac address="fa:16:3e:1f:1b:29"/>
Oct 26 03:21:04 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:21:04 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:21:04 user nova-compute[74630]:       <target dev="tapf59f8d04-32"/>
Oct 26 03:21:04 user nova-compute[74630]:     </interface>
Oct 26 03:21:04 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:21:04 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/console.log" append="off"/>
Oct 26 03:21:04 user nova-compute[74630]:     </serial>
Oct 26 03:21:04 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:21:04 user nova-compute[74630]:     <video>
Oct 26 03:21:04 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:21:04 user nova-compute[74630]:     </video>
Oct 26 03:21:04 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:21:04 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:21:04 user nova-compute[74630]:     </rng>
Oct 26 03:21:04 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:21:04 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:21:04 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:21:04 user nova-compute[74630]:     </memballoon>
Oct 26 03:21:04 user nova-compute[74630]:   </devices>
Oct 26 03:21:04 user nova-compute[74630]: </domain>
Oct 26 03:21:04 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:21:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-376306411',display_name='tempest-VolumesAssistedSnapshotsTest-server-376306411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-376306411',id=11,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI35lIo7EuEGghCIgN4nejA7atOtkw1+W2ar2Mh261vl6es40QctNNIBYzTQ91yPdFvNXyQD7hJjtLJK9iE1ayr59cbjZ2OUw76nQlNG3qO29D2qu6XZabr6naUs3ePtaQ==',key_name='tempest-keypair-1965963470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5438cb807444ca791de9c7070430b88',ramdisk_id='',reservation_id='r-050xu4nd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-784835547',owner_user_name='tempest-VolumesAssistedSnapshotsTest-784835547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf85228071034c539eb8107fa7215a28',uuid=933f84b6-a3bb-47d7-b82e-f80ec5c15c43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "address": "fa:16:3e:1f:1b:29", "network": {"id": "fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1042679542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5438cb807444ca791de9c7070430b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59f8d04-32", "ovs_interfaceid": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Converting VIF {"id": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "address": "fa:16:3e:1f:1b:29", "network": {"id": "fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1042679542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5438cb807444ca791de9c7070430b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59f8d04-32", "ovs_interfaceid": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:1b:29,bridge_name='br-int',has_traffic_filtering=True,id=f59f8d04-3231-40d4-8e2f-f40517ed0d09,network=Network(fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59f8d04-32') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG os_vif [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:1b:29,bridge_name='br-int',has_traffic_filtering=True,id=f59f8d04-3231-40d4-8e2f-f40517ed0d09,network=Network(fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59f8d04-32') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40f907be-9850-5a66-90a9-6c5308482446', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf59f8d04-32, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf59f8d04-32, col_values=(('qos', UUID('9060e5bf-e021-4feb-81a1-cc7d2bbd2e22')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf59f8d04-32, col_values=(('external_ids', {'iface-id': 'f59f8d04-3231-40d4-8e2f-f40517ed0d09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:1b:29', 'vm-uuid': '933f84b6-a3bb-47d7-b82e-f80ec5c15c43'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b64d4414-2f6a-451a-9a0c-cbb780f82166 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.406s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:21:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:04 user nova-compute[74630]: INFO os_vif [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:1b:29,bridge_name='br-int',has_traffic_filtering=True,id=f59f8d04-3231-40d4-8e2f-f40517ed0d09,network=Network(fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59f8d04-32')
Oct 26 03:21:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:21:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] No VIF found with MAC fa:16:3e:1f:1b:29, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:21:05 user nova-compute[74630]: DEBUG nova.network.neutron [req-b6ab6e5d-071e-4678-b8ad-b7be792e8ba4 req-d902415e-1156-41ae-a6c1-31590df6ed13 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Updated VIF entry in instance network info cache for port f59f8d04-3231-40d4-8e2f-f40517ed0d09. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:21:05 user nova-compute[74630]: DEBUG nova.network.neutron [req-b6ab6e5d-071e-4678-b8ad-b7be792e8ba4 req-d902415e-1156-41ae-a6c1-31590df6ed13 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Updating instance_info_cache with network_info: [{"id": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "address": "fa:16:3e:1f:1b:29", "network": {"id": "fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1042679542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5438cb807444ca791de9c7070430b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59f8d04-32", "ovs_interfaceid": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:21:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b6ab6e5d-071e-4678-b8ad-b7be792e8ba4 req-d902415e-1156-41ae-a6c1-31590df6ed13 service nova] Releasing lock "refresh_cache-933f84b6-a3bb-47d7-b82e-f80ec5c15c43" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:21:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:21:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 03:21:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] There are 0 instances to clean {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 03:21:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:21:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74630) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 03:21:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:21:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-6b5a2dca-971b-40c0-a3fc-b9ce5f35478d req-6ead662b-748b-40c4-a629-c7e0ff188024 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Received event network-vif-plugged-f59f8d04-3231-40d4-8e2f-f40517ed0d09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6b5a2dca-971b-40c0-a3fc-b9ce5f35478d req-6ead662b-748b-40c4-a629-c7e0ff188024 service nova] Acquiring lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6b5a2dca-971b-40c0-a3fc-b9ce5f35478d req-6ead662b-748b-40c4-a629-c7e0ff188024 service nova] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6b5a2dca-971b-40c0-a3fc-b9ce5f35478d req-6ead662b-748b-40c4-a629-c7e0ff188024 service nova] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-6b5a2dca-971b-40c0-a3fc-b9ce5f35478d req-6ead662b-748b-40c4-a629-c7e0ff188024 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] No waiting events found dispatching network-vif-plugged-f59f8d04-3231-40d4-8e2f-f40517ed0d09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:21:07 user nova-compute[74630]: WARNING nova.compute.manager [req-6b5a2dca-971b-40c0-a3fc-b9ce5f35478d req-6ead662b-748b-40c4-a629-c7e0ff188024 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Received unexpected event network-vif-plugged-f59f8d04-3231-40d4-8e2f-f40517ed0d09 for instance with vm_state building and task_state spawning.
Oct 26 03:21:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:21:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:21:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-5fc9d5a4-5843-49a4-a812-ec2f22d72f15 req-2d89ba8a-505f-448c-a5b8-a1fc70a94fff service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Received event network-vif-plugged-f59f8d04-3231-40d4-8e2f-f40517ed0d09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5fc9d5a4-5843-49a4-a812-ec2f22d72f15 req-2d89ba8a-505f-448c-a5b8-a1fc70a94fff service nova] Acquiring lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5fc9d5a4-5843-49a4-a812-ec2f22d72f15 req-2d89ba8a-505f-448c-a5b8-a1fc70a94fff service nova] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5fc9d5a4-5843-49a4-a812-ec2f22d72f15 req-2d89ba8a-505f-448c-a5b8-a1fc70a94fff service nova] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-5fc9d5a4-5843-49a4-a812-ec2f22d72f15 req-2d89ba8a-505f-448c-a5b8-a1fc70a94fff service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] No waiting events found dispatching network-vif-plugged-f59f8d04-3231-40d4-8e2f-f40517ed0d09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:21:09 user nova-compute[74630]: WARNING nova.compute.manager [req-5fc9d5a4-5843-49a4-a812-ec2f22d72f15 req-2d89ba8a-505f-448c-a5b8-a1fc70a94fff service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Received unexpected event network-vif-plugged-f59f8d04-3231-40d4-8e2f-f40517ed0d09 for instance with vm_state building and task_state spawning.
Oct 26 03:21:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:21:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:21:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Instance spawned successfully.
Oct 26 03:21:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:21:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:21:09 user nova-compute[74630]: INFO nova.compute.manager [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Took 7.42 seconds to spawn the instance on the hypervisor.
Oct 26 03:21:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:21:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:09 user nova-compute[74630]: INFO nova.compute.manager [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Took 8.75 seconds to build instance.
Oct 26 03:21:10 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:21:10 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:21:10 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:21:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29ef7b7b-280d-4a86-9263-9b56820fed15 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.968s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-fa1dd816-9dc1-4d48-b608-aa0218f22369" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:21:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-fa1dd816-9dc1-4d48-b608-aa0218f22369" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:21:10 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:21:10 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid fa1dd816-9dc1-4d48-b608-aa0218f22369 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:21:11 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Updating instance_info_cache with network_info: [{"id": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "address": "fa:16:3e:27:88:e1", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8d8a99-31", "ovs_interfaceid": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:21:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-fa1dd816-9dc1-4d48-b608-aa0218f22369" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:21:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:21:11 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:21:11 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:21:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:11 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:21:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.336s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:16 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:21:16 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:21:16 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=7239MB free_disk=25.498687744140625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 82be4c02-7dbe-4ed7-af19-e4da1855065d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 747e596d-d9b3-4af2-be42-0fd494b6ef9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 65ff804f-8b98-406d-8c5c-3d73bb52ff18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d1591088-0892-4aa5-b7ea-3addb083bc69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance bb93fd61-5432-44d2-86c4-b4cdccc0e1c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing inventories for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating ProviderTree inventory for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating inventory in ProviderTree for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing aggregate associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, aggregates: None {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing trait associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, traits: HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.manager [req-2a6dbcd7-e26f-4ff1-85f0-a046ccd667a3 req-f5930150-f320-4795-81ca-1e3bed1b4eab service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2a6dbcd7-e26f-4ff1-85f0-a046ccd667a3 req-f5930150-f320-4795-81ca-1e3bed1b4eab service nova] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2a6dbcd7-e26f-4ff1-85f0-a046ccd667a3 req-f5930150-f320-4795-81ca-1e3bed1b4eab service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2a6dbcd7-e26f-4ff1-85f0-a046ccd667a3 req-f5930150-f320-4795-81ca-1e3bed1b4eab service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.manager [req-2a6dbcd7-e26f-4ff1-85f0-a046ccd667a3 req-f5930150-f320-4795-81ca-1e3bed1b4eab service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] No waiting events found dispatching network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:21:17 user nova-compute[74630]: WARNING nova.compute.manager [req-2a6dbcd7-e26f-4ff1-85f0-a046ccd667a3 req-f5930150-f320-4795-81ca-1e3bed1b4eab service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received unexpected event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 for instance with vm_state active and task_state None.
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:21:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.906s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:18 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:21:18 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:21:18 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:21:18 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:21:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] No waiting events found dispatching network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:21:19 user nova-compute[74630]: WARNING nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received unexpected event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 for instance with vm_state active and task_state None.
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] No waiting events found dispatching network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:21:19 user nova-compute[74630]: WARNING nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received unexpected event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 for instance with vm_state active and task_state None.
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] No waiting events found dispatching network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:21:19 user nova-compute[74630]: WARNING nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received unexpected event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 for instance with vm_state active and task_state None.
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Received event network-vif-plugged-8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Acquiring lock "f9890dde-e678-41d4-8447-24bf626c2983-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "f9890dde-e678-41d4-8447-24bf626c2983-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "f9890dde-e678-41d4-8447-24bf626c2983-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] No waiting events found dispatching network-vif-plugged-8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:21:19 user nova-compute[74630]: WARNING nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Received unexpected event network-vif-plugged-8f91f921-5357-4156-b113-a4a3b0ef6e2e for instance with vm_state active and task_state None.
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Received event network-vif-plugged-8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Acquiring lock "f9890dde-e678-41d4-8447-24bf626c2983-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "f9890dde-e678-41d4-8447-24bf626c2983-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "f9890dde-e678-41d4-8447-24bf626c2983-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] No waiting events found dispatching network-vif-plugged-8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:21:19 user nova-compute[74630]: WARNING nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Received unexpected event network-vif-plugged-8f91f921-5357-4156-b113-a4a3b0ef6e2e for instance with vm_state active and task_state None.
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Received event network-vif-plugged-eb33c5f5-8500-42cc-997d-94069fc454a6 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Acquiring lock "d1591088-0892-4aa5-b7ea-3addb083bc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] No waiting events found dispatching network-vif-plugged-eb33c5f5-8500-42cc-997d-94069fc454a6 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:21:19 user nova-compute[74630]: WARNING nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Received unexpected event network-vif-plugged-eb33c5f5-8500-42cc-997d-94069fc454a6 for instance with vm_state active and task_state None.
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Received event network-vif-plugged-eb33c5f5-8500-42cc-997d-94069fc454a6 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Acquiring lock "d1591088-0892-4aa5-b7ea-3addb083bc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] No waiting events found dispatching network-vif-plugged-eb33c5f5-8500-42cc-997d-94069fc454a6 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:21:19 user nova-compute[74630]: WARNING nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Received unexpected event network-vif-plugged-eb33c5f5-8500-42cc-997d-94069fc454a6 for instance with vm_state active and task_state None.
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Received event network-vif-plugged-94f2d964-4b95-4a4c-a7cb-94bd34132f52 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Acquiring lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] No waiting events found dispatching network-vif-plugged-94f2d964-4b95-4a4c-a7cb-94bd34132f52 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:21:19 user nova-compute[74630]: WARNING nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Received unexpected event network-vif-plugged-94f2d964-4b95-4a4c-a7cb-94bd34132f52 for instance with vm_state active and task_state None.
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Received event network-vif-plugged-94f2d964-4b95-4a4c-a7cb-94bd34132f52 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Acquiring lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] No waiting events found dispatching network-vif-plugged-94f2d964-4b95-4a4c-a7cb-94bd34132f52 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:21:19 user nova-compute[74630]: WARNING nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Received unexpected event network-vif-plugged-94f2d964-4b95-4a4c-a7cb-94bd34132f52 for instance with vm_state active and task_state None.
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received event network-vif-plugged-4fb62476-5cff-4ebe-a5fe-4990895d991d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Acquiring lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] No waiting events found dispatching network-vif-plugged-4fb62476-5cff-4ebe-a5fe-4990895d991d {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:21:19 user nova-compute[74630]: WARNING nova.compute.manager [req-eb52f154-c924-4a78-98de-e6bac09fcfa8 req-37988861-092c-4fcb-9fe0-64830d67034b service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received unexpected event network-vif-plugged-4fb62476-5cff-4ebe-a5fe-4990895d991d for instance with vm_state active and task_state None.
Oct 26 03:21:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:21 user nova-compute[74630]: DEBUG nova.compute.manager [req-19070448-5044-4554-af0c-57d175f38da9 req-ac35055a-92c2-4592-bb0e-10b25dab185a service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received event network-vif-plugged-4fb62476-5cff-4ebe-a5fe-4990895d991d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-19070448-5044-4554-af0c-57d175f38da9 req-ac35055a-92c2-4592-bb0e-10b25dab185a service nova] Acquiring lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-19070448-5044-4554-af0c-57d175f38da9 req-ac35055a-92c2-4592-bb0e-10b25dab185a service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-19070448-5044-4554-af0c-57d175f38da9 req-ac35055a-92c2-4592-bb0e-10b25dab185a service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:21 user nova-compute[74630]: DEBUG nova.compute.manager [req-19070448-5044-4554-af0c-57d175f38da9 req-ac35055a-92c2-4592-bb0e-10b25dab185a service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] No waiting events found dispatching network-vif-plugged-4fb62476-5cff-4ebe-a5fe-4990895d991d {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:21:21 user nova-compute[74630]: WARNING nova.compute.manager [req-19070448-5044-4554-af0c-57d175f38da9 req-ac35055a-92c2-4592-bb0e-10b25dab185a service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received unexpected event network-vif-plugged-4fb62476-5cff-4ebe-a5fe-4990895d991d for instance with vm_state active and task_state None.
Oct 26 03:21:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:21:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:21:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:21:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:21:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:54 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:21:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:21:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:21:54 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:21:54 user nova-compute[74630]: INFO nova.compute.claims [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Claim successful on node user
Oct 26 03:21:54 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:21:54 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:21:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:21:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:21:55 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:21:55 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:21:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:21:55 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:21:55 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:21:55 user nova-compute[74630]: INFO nova.virt.block_device [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Booting with volume 66fc789f-3bdc-4f37-925a-5e1e646e2550 at /dev/vda
Oct 26 03:21:55 user nova-compute[74630]: DEBUG nova.policy [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32312445505b4992826f937b5c080395', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9f996fcad8409981bf1093a0a48c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:21:55 user nova-compute[74630]: DEBUG os_brick.utils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:21:55 user nova-compute[74630]: INFO oslo.privsep.daemon [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpdn3n6ab2/privsep.sock']
Oct 26 03:21:55 user sudo[86243]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpdn3n6ab2/privsep.sock
Oct 26 03:21:55 user sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 03:21:56 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Successfully created port: bf5f9227-19d4-480f-bdda-d8d839b63030 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:21:56 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Successfully created port: d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:21:56 user sudo[86243]: pam_unix(sudo:session): session closed for user root
Oct 26 03:21:57 user nova-compute[74630]: INFO oslo.privsep.daemon [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Spawned new privsep daemon via rootwrap
Oct 26 03:21:57 user nova-compute[74630]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 03:21:57 user nova-compute[74630]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 03:21:57 user nova-compute[74630]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 26 03:21:57 user nova-compute[74630]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86251
Oct 26 03:21:57 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Successfully created port: 07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[72555d1d-c589-4737-abc7-ca08131249cf]: (2,) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71c7ed4-5831-4775-9b35-38f5d0779a5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:21:57 user nova-compute[74630]: WARNING os_brick.initiator.connectors.nvmeof [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f9bb52-f6b4-4dcc-bf42-d0f46d2fa76e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fce8d8-ffe5-4595-80f0-4806444fab5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce25e7d-1e6c-457e-9126-59b5f975c0b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:21:57 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:21:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2257a1e3-154c-4108-93ef-3af50c046a73]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG os_brick.utils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] <== get_connector_properties: return (1869ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updating existing volume attachment record: 43947fca-d4fb-4ae0-8586-38a69049bb34 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:21:57 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Successfully created port: d6756804-11a1-42a7-a432-bd0829d6dea0 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:21:58 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Successfully created port: ff80c83f-f62c-4f70-a9ca-add8c4a366fd {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:21:58 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Successfully updated port: bf5f9227-19d4-480f-bdda-d8d839b63030 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:21:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-8e1387c1-cfb8-4f06-9224-d9679be88da9 req-bcde9411-3369-49b2-92da-cf62036c50c5 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-changed-bf5f9227-19d4-480f-bdda-d8d839b63030 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:21:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-8e1387c1-cfb8-4f06-9224-d9679be88da9 req-bcde9411-3369-49b2-92da-cf62036c50c5 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing instance network info cache due to event network-changed-bf5f9227-19d4-480f-bdda-d8d839b63030. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:21:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8e1387c1-cfb8-4f06-9224-d9679be88da9 req-bcde9411-3369-49b2-92da-cf62036c50c5 service nova] Acquiring lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:21:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8e1387c1-cfb8-4f06-9224-d9679be88da9 req-bcde9411-3369-49b2-92da-cf62036c50c5 service nova] Acquired lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:21:58 user nova-compute[74630]: DEBUG nova.network.neutron [req-8e1387c1-cfb8-4f06-9224-d9679be88da9 req-bcde9411-3369-49b2-92da-cf62036c50c5 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing network info cache for port bf5f9227-19d4-480f-bdda-d8d839b63030 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:21:58 user nova-compute[74630]: DEBUG nova.network.neutron [req-8e1387c1-cfb8-4f06-9224-d9679be88da9 req-bcde9411-3369-49b2-92da-cf62036c50c5 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:21:58 user nova-compute[74630]: DEBUG nova.network.neutron [req-8e1387c1-cfb8-4f06-9224-d9679be88da9 req-bcde9411-3369-49b2-92da-cf62036c50c5 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:21:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8e1387c1-cfb8-4f06-9224-d9679be88da9 req-bcde9411-3369-49b2-92da-cf62036c50c5 service nova] Releasing lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:21:59 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Successfully updated port: 209ed9aa-b6ea-4103-8231-7f6380f5d187 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:21:59 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Successfully updated port: 812b7cf9-199e-458a-93f5-3a73dfe4a05a {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Successfully updated port: d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-changed-209ed9aa-b6ea-4103-8231-7f6380f5d187 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing instance network info cache due to event network-changed-209ed9aa-b6ea-4103-8231-7f6380f5d187. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] Acquiring lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] Acquired lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG nova.network.neutron [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing network info cache for port 209ed9aa-b6ea-4103-8231-7f6380f5d187 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG nova.network.neutron [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Successfully updated port: 07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG nova.network.neutron [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] Releasing lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-changed-812b7cf9-199e-458a-93f5-3a73dfe4a05a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing instance network info cache due to event network-changed-812b7cf9-199e-458a-93f5-3a73dfe4a05a. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] Acquiring lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] Acquired lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:00 user nova-compute[74630]: DEBUG nova.network.neutron [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing network info cache for port 812b7cf9-199e-458a-93f5-3a73dfe4a05a {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:22:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:22:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] Releasing lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-changed-d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing instance network info cache due to event network-changed-d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:22:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] Acquiring lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] Acquired lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing network info cache for port d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:22:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:22:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-36423c8e-d2dc-4264-89d0-28ef66c85818 req-5b2b78f9-d416-42da-a64e-011709b6898e service nova] Releasing lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:01 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Successfully updated port: d6756804-11a1-42a7-a432-bd0829d6dea0 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:22:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Successfully updated port: ff80c83f-f62c-4f70-a9ca-add8c4a366fd {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:22:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquired lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:22:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:22:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-changed-07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing instance network info cache due to event network-changed-07b88a64-c3ce-41e1-a8c5-9a394f06f0a6. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:22:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] Acquiring lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:03 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updating instance_info_cache with network_info: [{"id": "bf5f9227-19d4-480f-bdda-d8d839b63030", "address": "fa:16:3e:99:96:bd", "network": {"id": "dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1333134059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5f9227-19", "ovs_interfaceid": "bf5f9227-19d4-480f-bdda-d8d839b63030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "address": "fa:16:3e:b0:a9:f6", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ed9aa-b6", "ovs_interfaceid": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "address": "fa:16:3e:ad:f4:1d", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap812b7cf9-19", "ovs_interfaceid": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "address": "fa:16:3e:94:57:f1", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03b6f6f-4e", "ovs_interfaceid": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "address": "fa:16:3e:b9:da:9b", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b88a64-c3", "ovs_interfaceid": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6756804-11a1-42a7-a432-bd0829d6dea0", "address": "fa:16:3e:0a:93:81", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6756804-11", "ovs_interfaceid": "d6756804-11a1-42a7-a432-bd0829d6dea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "address": "fa:16:3e:cb:c8:46", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff80c83f-f6", "ovs_interfaceid": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Releasing lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:03 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Instance network_info: |[{"id": "bf5f9227-19d4-480f-bdda-d8d839b63030", "address": "fa:16:3e:99:96:bd", "network": {"id": "dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1333134059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5f9227-19", "ovs_interfaceid": "bf5f9227-19d4-480f-bdda-d8d839b63030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "address": "fa:16:3e:b0:a9:f6", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ed9aa-b6", "ovs_interfaceid": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "address": "fa:16:3e:ad:f4:1d", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap812b7cf9-19", "ovs_interfaceid": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "address": "fa:16:3e:94:57:f1", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03b6f6f-4e", "ovs_interfaceid": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "address": "fa:16:3e:b9:da:9b", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b88a64-c3", "ovs_interfaceid": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6756804-11a1-42a7-a432-bd0829d6dea0", "address": "fa:16:3e:0a:93:81", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6756804-11", "ovs_interfaceid": "d6756804-11a1-42a7-a432-bd0829d6dea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "address": "fa:16:3e:cb:c8:46", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff80c83f-f6", "ovs_interfaceid": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:22:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] Acquired lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:03 user nova-compute[74630]: DEBUG nova.network.neutron [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing network info cache for port 07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updated VIF entry in instance network info cache for port 07b88a64-c3ce-41e1-a8c5-9a394f06f0a6. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updating instance_info_cache with network_info: [{"id": "bf5f9227-19d4-480f-bdda-d8d839b63030", "address": "fa:16:3e:99:96:bd", "network": {"id": "dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1333134059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5f9227-19", "ovs_interfaceid": "bf5f9227-19d4-480f-bdda-d8d839b63030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "address": "fa:16:3e:b0:a9:f6", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ed9aa-b6", "ovs_interfaceid": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "address": "fa:16:3e:ad:f4:1d", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap812b7cf9-19", "ovs_interfaceid": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "address": "fa:16:3e:94:57:f1", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03b6f6f-4e", "ovs_interfaceid": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "address": "fa:16:3e:b9:da:9b", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b88a64-c3", "ovs_interfaceid": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6756804-11a1-42a7-a432-bd0829d6dea0", "address": "fa:16:3e:0a:93:81", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6756804-11", "ovs_interfaceid": "d6756804-11a1-42a7-a432-bd0829d6dea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "address": "fa:16:3e:cb:c8:46", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff80c83f-f6", "ovs_interfaceid": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] Releasing lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-changed-d6756804-11a1-42a7-a432-bd0829d6dea0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing instance network info cache due to event network-changed-d6756804-11a1-42a7-a432-bd0829d6dea0. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] Acquiring lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] Acquired lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing network info cache for port d6756804-11a1-42a7-a432-bd0829d6dea0 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updated VIF entry in instance network info cache for port d6756804-11a1-42a7-a432-bd0829d6dea0. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updating instance_info_cache with network_info: [{"id": "bf5f9227-19d4-480f-bdda-d8d839b63030", "address": "fa:16:3e:99:96:bd", "network": {"id": "dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1333134059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5f9227-19", "ovs_interfaceid": "bf5f9227-19d4-480f-bdda-d8d839b63030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "address": "fa:16:3e:b0:a9:f6", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ed9aa-b6", "ovs_interfaceid": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "address": "fa:16:3e:ad:f4:1d", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap812b7cf9-19", "ovs_interfaceid": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "address": "fa:16:3e:94:57:f1", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03b6f6f-4e", "ovs_interfaceid": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "address": "fa:16:3e:b9:da:9b", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b88a64-c3", "ovs_interfaceid": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6756804-11a1-42a7-a432-bd0829d6dea0", "address": "fa:16:3e:0a:93:81", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6756804-11", "ovs_interfaceid": "d6756804-11a1-42a7-a432-bd0829d6dea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "address": "fa:16:3e:cb:c8:46", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff80c83f-f6", "ovs_interfaceid": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] Releasing lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-changed-ff80c83f-f62c-4f70-a9ca-add8c4a366fd {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing instance network info cache due to event network-changed-ff80c83f-f62c-4f70-a9ca-add8c4a366fd. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] Acquiring lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] Acquired lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing network info cache for port ff80c83f-f62c-4f70-a9ca-add8c4a366fd {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updated VIF entry in instance network info cache for port ff80c83f-f62c-4f70-a9ca-add8c4a366fd. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updating instance_info_cache with network_info: [{"id": "bf5f9227-19d4-480f-bdda-d8d839b63030", "address": "fa:16:3e:99:96:bd", "network": {"id": "dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1333134059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5f9227-19", "ovs_interfaceid": "bf5f9227-19d4-480f-bdda-d8d839b63030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "address": "fa:16:3e:b0:a9:f6", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ed9aa-b6", "ovs_interfaceid": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "address": "fa:16:3e:ad:f4:1d", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap812b7cf9-19", "ovs_interfaceid": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "address": "fa:16:3e:94:57:f1", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03b6f6f-4e", "ovs_interfaceid": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "address": "fa:16:3e:b9:da:9b", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b88a64-c3", "ovs_interfaceid": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6756804-11a1-42a7-a432-bd0829d6dea0", "address": "fa:16:3e:0a:93:81", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6756804-11", "ovs_interfaceid": "d6756804-11a1-42a7-a432-bd0829d6dea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "address": "fa:16:3e:cb:c8:46", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff80c83f-f6", "ovs_interfaceid": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b4940eda-99fc-4767-be1c-f91a8f2011a8 req-17a413da-2dec-450a-837a-1f71be6008b7 service nova] Releasing lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:22:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:22:07 user nova-compute[74630]: INFO nova.compute.manager [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] instance snapshotting
Oct 26 03:22:07 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Beginning live snapshot process
Oct 26 03:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json -f qcow2 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json -f qcow2" returned: 0 in 0.253s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json -f qcow2 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "b4b703bf-de53-4f1f-b94e-2c3048577d52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "b4b703bf-de53-4f1f-b94e-2c3048577d52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzx4fq78f/2241d00f4f7b4cc29abe3574126f10d4.delta 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzx4fq78f/2241d00f4f7b4cc29abe3574126f10d4.delta 1073741824" returned: 0 in 0.057s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:08 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 03:22:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74630) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 26 03:22:08 user nova-compute[74630]: INFO nova.virt.libvirt.host [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] UEFI support detected
Oct 26 03:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:08 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:22:08 user nova-compute[74630]: INFO nova.compute.claims [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Claim successful on node user
Oct 26 03:22:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG nova.network.neutron [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:22:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:22:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG nova.policy [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3f70e566f1b46b8bd4131758921f49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2fa2469fb44a7ea42666b7ba4eab31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-70256c09-5ba5-41c4-a7fb-36d3ae045883 req-d0c65eb6-89e0-4b53-a5d6-03c33d2328f6 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-changed-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-70256c09-5ba5-41c4-a7fb-36d3ae045883 req-d0c65eb6-89e0-4b53-a5d6-03c33d2328f6 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Refreshing instance network info cache due to event network-changed-b965ee06-ed93-40fc-9732-974c808f5c36. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-70256c09-5ba5-41c4-a7fb-36d3ae045883 req-d0c65eb6-89e0-4b53-a5d6-03c33d2328f6 service nova] Acquiring lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-70256c09-5ba5-41c4-a7fb-36d3ae045883 req-d0c65eb6-89e0-4b53-a5d6-03c33d2328f6 service nova] Acquired lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG nova.network.neutron [req-70256c09-5ba5-41c4-a7fb-36d3ae045883 req-d0c65eb6-89e0-4b53-a5d6-03c33d2328f6 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Refreshing network info cache for port b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:22:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Creating image(s)
Oct 26 03:22:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "/opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "/opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.184s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.238s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk 1073741824" returned: 0 in 0.085s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] COPY block job progress, current cursor: 22216704 final cursor: 75563008 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG nova.network.neutron [req-70256c09-5ba5-41c4-a7fb-36d3ae045883 req-d0c65eb6-89e0-4b53-a5d6-03c33d2328f6 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updated VIF entry in instance network info cache for port b965ee06-ed93-40fc-9732-974c808f5c36. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG nova.network.neutron [req-70256c09-5ba5-41c4-a7fb-36d3ae045883 req-d0c65eb6-89e0-4b53-a5d6-03c33d2328f6 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updating instance_info_cache with network_info: [{"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG nova.network.neutron [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Successfully created port: 441ac47b-e3f0-462e-b4f6-8752b0e98b5c {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-70256c09-5ba5-41c4-a7fb-36d3ae045883 req-d0c65eb6-89e0-4b53-a5d6-03c33d2328f6 service nova] Releasing lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Cannot resize image /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Ensure instance console log exists: /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:10 user nova-compute[74630]: INFO nova.compute.manager [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Rescuing
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "refresh_cache-7918e3bc-c44b-4be3-871d-e06eb3fd7d49" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquired lock "refresh_cache-7918e3bc-c44b-4be3-871d-e06eb3fd7d49" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG nova.network.neutron [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:22:10 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 03:22:10 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzx4fq78f/2241d00f4f7b4cc29abe3574126f10d4.delta /opt/stack/data/nova/instances/snapshots/tmpzx4fq78f/2241d00f4f7b4cc29abe3574126f10d4 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG nova.network.neutron [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Successfully updated port: 441ac47b-e3f0-462e-b4f6-8752b0e98b5c {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "refresh_cache-b4b703bf-de53-4f1f-b94e-2c3048577d52" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquired lock "refresh_cache-b4b703bf-de53-4f1f-b94e-2c3048577d52" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG nova.network.neutron [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG nova.network.neutron [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG nova.network.neutron [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Updating instance_info_cache with network_info: [{"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Releasing lock "refresh_cache-7918e3bc-c44b-4be3-871d-e06eb3fd7d49" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-65f56407-635d-4890-9470-119ffe4b8e40 req-c6824164-f74a-4755-9b46-8e76123bc64e service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Received event network-changed-441ac47b-e3f0-462e-b4f6-8752b0e98b5c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-65f56407-635d-4890-9470-119ffe4b8e40 req-c6824164-f74a-4755-9b46-8e76123bc64e service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Refreshing instance network info cache due to event network-changed-441ac47b-e3f0-462e-b4f6-8752b0e98b5c. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-65f56407-635d-4890-9470-119ffe4b8e40 req-c6824164-f74a-4755-9b46-8e76123bc64e service nova] Acquiring lock "refresh_cache-b4b703bf-de53-4f1f-b94e-2c3048577d52" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzx4fq78f/2241d00f4f7b4cc29abe3574126f10d4.delta /opt/stack/data/nova/instances/snapshots/tmpzx4fq78f/2241d00f4f7b4cc29abe3574126f10d4" returned: 0 in 0.890s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:11 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Snapshot extracted, beginning image upload
Oct 26 03:22:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG nova.network.neutron [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Updating instance_info_cache with network_info: [{"id": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "address": "fa:16:3e:d4:c9:3f", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441ac47b-e3", "ovs_interfaceid": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Releasing lock "refresh_cache-b4b703bf-de53-4f1f-b94e-2c3048577d52" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Instance network_info: |[{"id": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "address": "fa:16:3e:d4:c9:3f", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441ac47b-e3", "ovs_interfaceid": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-65f56407-635d-4890-9470-119ffe4b8e40 req-c6824164-f74a-4755-9b46-8e76123bc64e service nova] Acquired lock "refresh_cache-b4b703bf-de53-4f1f-b94e-2c3048577d52" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG nova.network.neutron [req-65f56407-635d-4890-9470-119ffe4b8e40 req-c6824164-f74a-4755-9b46-8e76123bc64e service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Refreshing network info cache for port 441ac47b-e3f0-462e-b4f6-8752b0e98b5c {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:22:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Start _get_guest_xml network_info=[{"id": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "address": "fa:16:3e:d4:c9:3f", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441ac47b-e3", "ovs_interfaceid": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:22:11 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:22:12 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:22:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1727955185',display_name='tempest-ServersNegativeTestJSON-server-1727955185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1727955185',id=13,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb2fa2469fb44a7ea42666b7ba4eab31',ramdisk_id='',reservation_id='r-x07lf6v5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-939634393',owner_user_name='tempest-ServersNegativeTestJSON-939634393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:22:10Z,user_data=None,user_id='e3f70e566f1b46b8bd4131758921f49a',uuid=b4b703bf-de53-4f1f-b94e-2c3048577d52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "address": "fa:16:3e:d4:c9:3f", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441ac47b-e3", "ovs_interfaceid": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Converting VIF {"id": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "address": "fa:16:3e:d4:c9:3f", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441ac47b-e3", "ovs_interfaceid": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c9:3f,bridge_name='br-int',has_traffic_filtering=True,id=441ac47b-e3f0-462e-b4f6-8752b0e98b5c,network=Network(0c987002-6658-42a0-afe5-c0d349e73477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441ac47b-e3') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.objects.instance [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lazy-loading 'pci_devices' on Instance uuid b4b703bf-de53-4f1f-b94e-2c3048577d52 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:22:12 user nova-compute[74630]:   <uuid>b4b703bf-de53-4f1f-b94e-2c3048577d52</uuid>
Oct 26 03:22:12 user nova-compute[74630]:   <name>instance-0000000d</name>
Oct 26 03:22:12 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:22:12 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:22:12 user nova-compute[74630]:   <metadata>
Oct 26 03:22:12 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:22:12 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:22:12 user nova-compute[74630]:       <nova:name>tempest-ServersNegativeTestJSON-server-1727955185</nova:name>
Oct 26 03:22:12 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:22:12</nova:creationTime>
Oct 26 03:22:12 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:22:12 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:22:12 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:22:12 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:22:12 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:22:12 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:22:12 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:22:12 user nova-compute[74630]:       <nova:owner>
Oct 26 03:22:12 user nova-compute[74630]:         <nova:user uuid="e3f70e566f1b46b8bd4131758921f49a">tempest-ServersNegativeTestJSON-939634393-project-member</nova:user>
Oct 26 03:22:12 user nova-compute[74630]:         <nova:project uuid="cb2fa2469fb44a7ea42666b7ba4eab31">tempest-ServersNegativeTestJSON-939634393</nova:project>
Oct 26 03:22:12 user nova-compute[74630]:       </nova:owner>
Oct 26 03:22:12 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:22:12 user nova-compute[74630]:       <nova:ports>
Oct 26 03:22:12 user nova-compute[74630]:         <nova:port uuid="441ac47b-e3f0-462e-b4f6-8752b0e98b5c">
Oct 26 03:22:12 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 03:22:12 user nova-compute[74630]:         </nova:port>
Oct 26 03:22:12 user nova-compute[74630]:       </nova:ports>
Oct 26 03:22:12 user nova-compute[74630]:     </nova:instance>
Oct 26 03:22:12 user nova-compute[74630]:   </metadata>
Oct 26 03:22:12 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:22:12 user nova-compute[74630]:     <system>
Oct 26 03:22:12 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:22:12 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:22:12 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:22:12 user nova-compute[74630]:       <entry name="serial">b4b703bf-de53-4f1f-b94e-2c3048577d52</entry>
Oct 26 03:22:12 user nova-compute[74630]:       <entry name="uuid">b4b703bf-de53-4f1f-b94e-2c3048577d52</entry>
Oct 26 03:22:12 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:22:12 user nova-compute[74630]:     </system>
Oct 26 03:22:12 user nova-compute[74630]:   </sysinfo>
Oct 26 03:22:12 user nova-compute[74630]:   <os>
Oct 26 03:22:12 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:22:12 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:22:12 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:22:12 user nova-compute[74630]:   </os>
Oct 26 03:22:12 user nova-compute[74630]:   <features>
Oct 26 03:22:12 user nova-compute[74630]:     <acpi/>
Oct 26 03:22:12 user nova-compute[74630]:     <apic/>
Oct 26 03:22:12 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:22:12 user nova-compute[74630]:   </features>
Oct 26 03:22:12 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:22:12 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:22:12 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:22:12 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:22:12 user nova-compute[74630]:   </clock>
Oct 26 03:22:12 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:22:12 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:22:12 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:22:12 user nova-compute[74630]:   </cpu>
Oct 26 03:22:12 user nova-compute[74630]:   <devices>
Oct 26 03:22:12 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:22:12 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:22:12 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk"/>
Oct 26 03:22:12 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:22:12 user nova-compute[74630]:     </disk>
Oct 26 03:22:12 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:22:12 user nova-compute[74630]:       <mac address="fa:16:3e:d4:c9:3f"/>
Oct 26 03:22:12 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:22:12 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:22:12 user nova-compute[74630]:       <target dev="tap441ac47b-e3"/>
Oct 26 03:22:12 user nova-compute[74630]:     </interface>
Oct 26 03:22:12 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:22:12 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/console.log" append="off"/>
Oct 26 03:22:12 user nova-compute[74630]:     </serial>
Oct 26 03:22:12 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:22:12 user nova-compute[74630]:     <video>
Oct 26 03:22:12 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:22:12 user nova-compute[74630]:     </video>
Oct 26 03:22:12 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:22:12 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:22:12 user nova-compute[74630]:     </rng>
Oct 26 03:22:12 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:22:12 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:22:12 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:22:12 user nova-compute[74630]:     </memballoon>
Oct 26 03:22:12 user nova-compute[74630]:   </devices>
Oct 26 03:22:12 user nova-compute[74630]: </domain>
Oct 26 03:22:12 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:22:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1727955185',display_name='tempest-ServersNegativeTestJSON-server-1727955185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1727955185',id=13,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb2fa2469fb44a7ea42666b7ba4eab31',ramdisk_id='',reservation_id='r-x07lf6v5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-939634393',owner_user_name='tempest-ServersNegativeTestJSON-939634393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:22:10Z,user_data=None,user_id='e3f70e566f1b46b8bd4131758921f49a',uuid=b4b703bf-de53-4f1f-b94e-2c3048577d52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "address": "fa:16:3e:d4:c9:3f", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441ac47b-e3", "ovs_interfaceid": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Converting VIF {"id": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "address": "fa:16:3e:d4:c9:3f", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441ac47b-e3", "ovs_interfaceid": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c9:3f,bridge_name='br-int',has_traffic_filtering=True,id=441ac47b-e3f0-462e-b4f6-8752b0e98b5c,network=Network(0c987002-6658-42a0-afe5-c0d349e73477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441ac47b-e3') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG os_vif [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c9:3f,bridge_name='br-int',has_traffic_filtering=True,id=441ac47b-e3f0-462e-b4f6-8752b0e98b5c,network=Network(0c987002-6658-42a0-afe5-c0d349e73477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441ac47b-e3') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d8f5d20-0fef-5496-a9c8-490240304de0', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap441ac47b-e3, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap441ac47b-e3, col_values=(('qos', UUID('1fb70fff-bfb1-4fee-b7bd-e0dd105b2c11')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap441ac47b-e3, col_values=(('external_ids', {'iface-id': '441ac47b-e3f0-462e-b4f6-8752b0e98b5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:c9:3f', 'vm-uuid': 'b4b703bf-de53-4f1f-b94e-2c3048577d52'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:12 user nova-compute[74630]: INFO os_vif [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c9:3f,bridge_name='br-int',has_traffic_filtering=True,id=441ac47b-e3f0-462e-b4f6-8752b0e98b5c,network=Network(0c987002-6658-42a0-afe5-c0d349e73477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441ac47b-e3')
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] No VIF found with MAC fa:16:3e:d4:c9:3f, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.compute.manager [req-0bfc1921-8cef-4dcd-9089-d1885caacc4c req-19e79236-c3c7-4c55-9273-8fee22a6ebb2 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received event network-vif-unplugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0bfc1921-8cef-4dcd-9089-d1885caacc4c req-19e79236-c3c7-4c55-9273-8fee22a6ebb2 service nova] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0bfc1921-8cef-4dcd-9089-d1885caacc4c req-19e79236-c3c7-4c55-9273-8fee22a6ebb2 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0bfc1921-8cef-4dcd-9089-d1885caacc4c req-19e79236-c3c7-4c55-9273-8fee22a6ebb2 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.compute.manager [req-0bfc1921-8cef-4dcd-9089-d1885caacc4c req-19e79236-c3c7-4c55-9273-8fee22a6ebb2 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] No waiting events found dispatching network-vif-unplugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:22:12 user nova-compute[74630]: WARNING nova.compute.manager [req-0bfc1921-8cef-4dcd-9089-d1885caacc4c req-19e79236-c3c7-4c55-9273-8fee22a6ebb2 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received unexpected event network-vif-unplugged-853efb6c-3553-4889-a1fb-b0ede74757b7 for instance with vm_state active and task_state rescuing.
Oct 26 03:22:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-82be4c02-7dbe-4ed7-af19-e4da1855065d" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-82be4c02-7dbe-4ed7-af19-e4da1855065d" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.network.neutron [req-65f56407-635d-4890-9470-119ffe4b8e40 req-c6824164-f74a-4755-9b46-8e76123bc64e service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Updated VIF entry in instance network info cache for port 441ac47b-e3f0-462e-b4f6-8752b0e98b5c. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.network.neutron [req-65f56407-635d-4890-9470-119ffe4b8e40 req-c6824164-f74a-4755-9b46-8e76123bc64e service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Updating instance_info_cache with network_info: [{"id": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "address": "fa:16:3e:d4:c9:3f", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441ac47b-e3", "ovs_interfaceid": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-65f56407-635d-4890-9470-119ffe4b8e40 req-c6824164-f74a-4755-9b46-8e76123bc64e service nova] Releasing lock "refresh_cache-b4b703bf-de53-4f1f-b94e-2c3048577d52" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:12 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Instance destroyed successfully.
Oct 26 03:22:12 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Attempting rescue
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74630) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Instance directory exists: not creating {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 03:22:12 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Creating image(s)
Oct 26 03:22:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "/opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "/opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "/opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG nova.objects.instance [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.272s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue" returned: 0 in 0.047s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'migration_context' on Instance uuid 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.objects.base [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Object Instance<7918e3bc-c44b-4be3-871d-e06eb3fd7d49> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Start _get_guest_xml network_info=[{"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "vif_mac": "fa:16:3e:77:0d:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'resources' on Instance uuid 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.objects.base [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Object Instance<7918e3bc-c44b-4be3-871d-e06eb3fd7d49> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'numa_topology' on Instance uuid 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.objects.base [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Object Instance<7918e3bc-c44b-4be3-871d-e06eb3fd7d49> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:22:13 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:22:13 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.objects.base [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Object Instance<7918e3bc-c44b-4be3-871d-e06eb3fd7d49> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2056490985',display_name='tempest-ServerRescueNegativeTestJSON-server-2056490985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2056490985',id=6,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:20:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b652c6f02780451b89d51d74178bf6c7',ramdisk_id='',reservation_id='r-sn0sgqx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2117587238',owner_user_name='tempest-ServerRescueNegativeTestJSON-2117587238-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:38Z,user_data=None,user_id='62370747d10a420b81009d23e3ba324b',uuid=7918e3bc-c44b-4be3-871d-e06eb3fd7d49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "vif_mac": "fa:16:3e:77:0d:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converting VIF {"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "vif_mac": "fa:16:3e:77:0d:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:0d:44,bridge_name='br-int',has_traffic_filtering=True,id=853efb6c-3553-4889-a1fb-b0ede74757b7,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853efb6c-35') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'pci_devices' on Instance uuid 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.objects.base [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Object Instance<7918e3bc-c44b-4be3-871d-e06eb3fd7d49> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:22:13 user nova-compute[74630]:   <uuid>7918e3bc-c44b-4be3-871d-e06eb3fd7d49</uuid>
Oct 26 03:22:13 user nova-compute[74630]:   <name>instance-00000006</name>
Oct 26 03:22:13 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:22:13 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:22:13 user nova-compute[74630]:   <metadata>
Oct 26 03:22:13 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:22:13 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:22:13 user nova-compute[74630]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2056490985</nova:name>
Oct 26 03:22:13 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:22:13</nova:creationTime>
Oct 26 03:22:13 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:22:13 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:22:13 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:22:13 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:22:13 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:22:13 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:22:13 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:22:13 user nova-compute[74630]:       <nova:owner>
Oct 26 03:22:13 user nova-compute[74630]:         <nova:user uuid="62370747d10a420b81009d23e3ba324b">tempest-ServerRescueNegativeTestJSON-2117587238-project-member</nova:user>
Oct 26 03:22:13 user nova-compute[74630]:         <nova:project uuid="b652c6f02780451b89d51d74178bf6c7">tempest-ServerRescueNegativeTestJSON-2117587238</nova:project>
Oct 26 03:22:13 user nova-compute[74630]:       </nova:owner>
Oct 26 03:22:13 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:22:13 user nova-compute[74630]:       <nova:ports>
Oct 26 03:22:13 user nova-compute[74630]:         <nova:port uuid="853efb6c-3553-4889-a1fb-b0ede74757b7">
Oct 26 03:22:13 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 03:22:13 user nova-compute[74630]:         </nova:port>
Oct 26 03:22:13 user nova-compute[74630]:       </nova:ports>
Oct 26 03:22:13 user nova-compute[74630]:     </nova:instance>
Oct 26 03:22:13 user nova-compute[74630]:   </metadata>
Oct 26 03:22:13 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:22:13 user nova-compute[74630]:     <system>
Oct 26 03:22:13 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:22:13 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:22:13 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:22:13 user nova-compute[74630]:       <entry name="serial">7918e3bc-c44b-4be3-871d-e06eb3fd7d49</entry>
Oct 26 03:22:13 user nova-compute[74630]:       <entry name="uuid">7918e3bc-c44b-4be3-871d-e06eb3fd7d49</entry>
Oct 26 03:22:13 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:22:13 user nova-compute[74630]:     </system>
Oct 26 03:22:13 user nova-compute[74630]:   </sysinfo>
Oct 26 03:22:13 user nova-compute[74630]:   <os>
Oct 26 03:22:13 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:22:13 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:22:13 user nova-compute[74630]:   </os>
Oct 26 03:22:13 user nova-compute[74630]:   <features>
Oct 26 03:22:13 user nova-compute[74630]:     <acpi/>
Oct 26 03:22:13 user nova-compute[74630]:     <apic/>
Oct 26 03:22:13 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:22:13 user nova-compute[74630]:   </features>
Oct 26 03:22:13 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:22:13 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:22:13 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:22:13 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:22:13 user nova-compute[74630]:   </clock>
Oct 26 03:22:13 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:22:13 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:22:13 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:22:13 user nova-compute[74630]:   </cpu>
Oct 26 03:22:13 user nova-compute[74630]:   <devices>
Oct 26 03:22:13 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:22:13 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:22:13 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue"/>
Oct 26 03:22:13 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:22:13 user nova-compute[74630]:     </disk>
Oct 26 03:22:13 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:22:13 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:22:13 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk"/>
Oct 26 03:22:13 user nova-compute[74630]:       <target dev="vdb" bus="virtio"/>
Oct 26 03:22:13 user nova-compute[74630]:     </disk>
Oct 26 03:22:13 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:22:13 user nova-compute[74630]:       <mac address="fa:16:3e:77:0d:44"/>
Oct 26 03:22:13 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:22:13 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:22:13 user nova-compute[74630]:       <target dev="tap853efb6c-35"/>
Oct 26 03:22:13 user nova-compute[74630]:     </interface>
Oct 26 03:22:13 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:22:13 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/console.log" append="off"/>
Oct 26 03:22:13 user nova-compute[74630]:     </serial>
Oct 26 03:22:13 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:22:13 user nova-compute[74630]:     <video>
Oct 26 03:22:13 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:22:13 user nova-compute[74630]:     </video>
Oct 26 03:22:13 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:22:13 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:22:13 user nova-compute[74630]:     </rng>
Oct 26 03:22:13 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:22:13 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:22:13 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:22:13 user nova-compute[74630]:     </memballoon>
Oct 26 03:22:13 user nova-compute[74630]:   </devices>
Oct 26 03:22:13 user nova-compute[74630]: </domain>
Oct 26 03:22:13 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:22:13 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Instance destroyed successfully.
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No VIF found with MAC fa:16:3e:77:0d:44, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Updating instance_info_cache with network_info: [{"id": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "address": "fa:16:3e:bd:b3:80", "network": {"id": "cc606e10-c5b0-4275-b289-4bcd2eca1b85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-218412921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2d9b74567e04da0b94a1077f1b57bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2722ab74-cc", "ovs_interfaceid": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-82be4c02-7dbe-4ed7-af19-e4da1855065d" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:13 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:22:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:14 user nova-compute[74630]: DEBUG nova.compute.manager [req-6d341d8c-88d7-432c-9a60-40fcf556eb67 req-a90b84f5-71c1-4ffa-9c34-ed156132d869 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6d341d8c-88d7-432c-9a60-40fcf556eb67 req-a90b84f5-71c1-4ffa-9c34-ed156132d869 service nova] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6d341d8c-88d7-432c-9a60-40fcf556eb67 req-a90b84f5-71c1-4ffa-9c34-ed156132d869 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6d341d8c-88d7-432c-9a60-40fcf556eb67 req-a90b84f5-71c1-4ffa-9c34-ed156132d869 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:14 user nova-compute[74630]: DEBUG nova.compute.manager [req-6d341d8c-88d7-432c-9a60-40fcf556eb67 req-a90b84f5-71c1-4ffa-9c34-ed156132d869 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] No waiting events found dispatching network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:22:14 user nova-compute[74630]: WARNING nova.compute.manager [req-6d341d8c-88d7-432c-9a60-40fcf556eb67 req-a90b84f5-71c1-4ffa-9c34-ed156132d869 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received unexpected event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 for instance with vm_state active and task_state rescuing.
Oct 26 03:22:14 user nova-compute[74630]: DEBUG nova.compute.manager [req-6d341d8c-88d7-432c-9a60-40fcf556eb67 req-a90b84f5-71c1-4ffa-9c34-ed156132d869 service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Received event network-changed-8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:14 user nova-compute[74630]: DEBUG nova.compute.manager [req-6d341d8c-88d7-432c-9a60-40fcf556eb67 req-a90b84f5-71c1-4ffa-9c34-ed156132d869 service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Refreshing instance network info cache due to event network-changed-8f91f921-5357-4156-b113-a4a3b0ef6e2e. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:22:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6d341d8c-88d7-432c-9a60-40fcf556eb67 req-a90b84f5-71c1-4ffa-9c34-ed156132d869 service nova] Acquiring lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6d341d8c-88d7-432c-9a60-40fcf556eb67 req-a90b84f5-71c1-4ffa-9c34-ed156132d869 service nova] Acquired lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:14 user nova-compute[74630]: DEBUG nova.network.neutron [req-6d341d8c-88d7-432c-9a60-40fcf556eb67 req-a90b84f5-71c1-4ffa-9c34-ed156132d869 service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Refreshing network info cache for port 8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:22:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:14 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Snapshot image upload complete
Oct 26 03:22:14 user nova-compute[74630]: INFO nova.compute.manager [None req-801c94bb-aa64-4901-91de-e76ba3c1df59 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Took 7.04 seconds to snapshot the instance on the hypervisor.
Oct 26 03:22:15 user nova-compute[74630]: DEBUG nova.network.neutron [req-6d341d8c-88d7-432c-9a60-40fcf556eb67 req-a90b84f5-71c1-4ffa-9c34-ed156132d869 service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Updated VIF entry in instance network info cache for port 8f91f921-5357-4156-b113-a4a3b0ef6e2e. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:22:15 user nova-compute[74630]: DEBUG nova.network.neutron [req-6d341d8c-88d7-432c-9a60-40fcf556eb67 req-a90b84f5-71c1-4ffa-9c34-ed156132d869 service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Updating instance_info_cache with network_info: [{"id": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "address": "fa:16:3e:1c:d5:8f", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f91f921-53", "ovs_interfaceid": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6d341d8c-88d7-432c-9a60-40fcf556eb67 req-a90b84f5-71c1-4ffa-9c34-ed156132d869 service nova] Releasing lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Received event network-vif-plugged-441ac47b-e3f0-462e-b4f6-8752b0e98b5c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] Acquiring lock "b4b703bf-de53-4f1f-b94e-2c3048577d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] Lock "b4b703bf-de53-4f1f-b94e-2c3048577d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] Lock "b4b703bf-de53-4f1f-b94e-2c3048577d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] No waiting events found dispatching network-vif-plugged-441ac47b-e3f0-462e-b4f6-8752b0e98b5c {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:22:16 user nova-compute[74630]: WARNING nova.compute.manager [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Received unexpected event network-vif-plugged-441ac47b-e3f0-462e-b4f6-8752b0e98b5c for instance with vm_state building and task_state spawning.
Oct 26 03:22:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Received event network-vif-plugged-441ac47b-e3f0-462e-b4f6-8752b0e98b5c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] Acquiring lock "b4b703bf-de53-4f1f-b94e-2c3048577d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] Lock "b4b703bf-de53-4f1f-b94e-2c3048577d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] Lock "b4b703bf-de53-4f1f-b94e-2c3048577d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] No waiting events found dispatching network-vif-plugged-441ac47b-e3f0-462e-b4f6-8752b0e98b5c {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:22:16 user nova-compute[74630]: WARNING nova.compute.manager [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Received unexpected event network-vif-plugged-441ac47b-e3f0-462e-b4f6-8752b0e98b5c for instance with vm_state building and task_state spawning.
Oct 26 03:22:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] No waiting events found dispatching network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:22:16 user nova-compute[74630]: WARNING nova.compute.manager [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received unexpected event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 for instance with vm_state active and task_state rescuing.
Oct 26 03:22:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] No waiting events found dispatching network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:22:16 user nova-compute[74630]: WARNING nova.compute.manager [req-e19a6bf9-158b-4fdd-b62e-ee228785a815 req-c107a143-8014-440e-b68a-01290c8c91f2 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received unexpected event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 for instance with vm_state active and task_state rescuing.
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:17 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Instance spawned successfully.
Oct 26 03:22:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-35c397d8-f56a-4269-a1cd-98050733e3c4 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:22:17 user nova-compute[74630]: INFO nova.compute.manager [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Took 8.25 seconds to spawn the instance on the hypervisor.
Oct 26 03:22:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:18 user nova-compute[74630]: INFO nova.compute.manager [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Took 9.21 seconds to build instance.
Oct 26 03:22:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-608e30ee-4c37-47d1-a529-1ddfa3b0f239 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "b4b703bf-de53-4f1f-b94e-2c3048577d52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.352s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:20 user nova-compute[74630]: INFO nova.virt.block_device [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Booting with volume b40ba2fd-80b5-4121-88a1-27603fb56fea at /dev/vdb
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG os_brick.utils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[71234157-6666-4850-bae3-5a33e190664d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0bf2a9-8cc8-4336-9cd1-aa2211783b10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b75342-8d96-4cc3-b50f-514293a173a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6356250-b0c9-4204-a597-d126b0ea3a17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:22:20 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f1a19a-45a5-4e66-91dd-8ac89394107e]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG os_brick.utils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updating existing volume attachment record: 35a71926-7298-4b89-b8d3-443016f3edcf {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Acquiring lock "82be4c02-7dbe-4ed7-af19-e4da1855065d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lazy-loading 'flavor' on Instance uuid 82be4c02-7dbe-4ed7-af19-e4da1855065d {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.471s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Acquiring lock "82be4c02-7dbe-4ed7-af19-e4da1855065d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:21 user nova-compute[74630]: INFO nova.compute.manager [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Attaching volume 434454f0-6437-4e59-8d02-7ece4b19fc45 to /dev/vdb
Oct 26 03:22:21 user nova-compute[74630]: DEBUG os_brick.utils [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[155964aa-c844-474f-92a8-07bf00e97666]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c4ada3-3c79-43f8-9d29-1bfa0ae578d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0f4144-0bc6-4237-a180-6240a08b2648]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b064aed3-ec48-415f-be43-e1e18562f1d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:22:21 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c009186d-e35b-4fef-a05b-efe10ef31f69]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG os_brick.utils [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Updating existing volume attachment record: fdf5d614-5b4f-4f7e-a910-76b87dcd5401 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:22:22 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:22:22 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=6902MB free_disk=25.348072052001953GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 82be4c02-7dbe-4ed7-af19-e4da1855065d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 747e596d-d9b3-4af2-be42-0fd494b6ef9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 65ff804f-8b98-406d-8c5c-3d73bb52ff18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d1591088-0892-4aa5-b7ea-3addb083bc69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance bb93fd61-5432-44d2-86c4-b4cdccc0e1c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 2d851c9c-c56c-4be0-ac59-ea59ea9304c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance b4b703bf-de53-4f1f-b94e-2c3048577d52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:22:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:22:23 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:22:23 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:22:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:22:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.680s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:24 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:22:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-100bd4f3-c394-47d8-b17d-2e8af99ffd2c req-1461bbea-3249-410c-b52f-2415cd0f2acd service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Received event network-changed-eb33c5f5-8500-42cc-997d-94069fc454a6 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-100bd4f3-c394-47d8-b17d-2e8af99ffd2c req-1461bbea-3249-410c-b52f-2415cd0f2acd service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Refreshing instance network info cache due to event network-changed-eb33c5f5-8500-42cc-997d-94069fc454a6. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:22:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-100bd4f3-c394-47d8-b17d-2e8af99ffd2c req-1461bbea-3249-410c-b52f-2415cd0f2acd service nova] Acquiring lock "refresh_cache-d1591088-0892-4aa5-b7ea-3addb083bc69" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-100bd4f3-c394-47d8-b17d-2e8af99ffd2c req-1461bbea-3249-410c-b52f-2415cd0f2acd service nova] Acquired lock "refresh_cache-d1591088-0892-4aa5-b7ea-3addb083bc69" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:31 user nova-compute[74630]: DEBUG nova.network.neutron [req-100bd4f3-c394-47d8-b17d-2e8af99ffd2c req-1461bbea-3249-410c-b52f-2415cd0f2acd service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Refreshing network info cache for port eb33c5f5-8500-42cc-997d-94069fc454a6 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:22:31 user nova-compute[74630]: DEBUG nova.network.neutron [req-100bd4f3-c394-47d8-b17d-2e8af99ffd2c req-1461bbea-3249-410c-b52f-2415cd0f2acd service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Updated VIF entry in instance network info cache for port eb33c5f5-8500-42cc-997d-94069fc454a6. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:22:31 user nova-compute[74630]: DEBUG nova.network.neutron [req-100bd4f3-c394-47d8-b17d-2e8af99ffd2c req-1461bbea-3249-410c-b52f-2415cd0f2acd service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Updating instance_info_cache with network_info: [{"id": "eb33c5f5-8500-42cc-997d-94069fc454a6", "address": "fa:16:3e:eb:7c:ee", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33c5f5-85", "ovs_interfaceid": "eb33c5f5-8500-42cc-997d-94069fc454a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-100bd4f3-c394-47d8-b17d-2e8af99ffd2c req-1461bbea-3249-410c-b52f-2415cd0f2acd service nova] Releasing lock "refresh_cache-d1591088-0892-4aa5-b7ea-3addb083bc69" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "d1591088-0892-4aa5-b7ea-3addb083bc69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG nova.objects.instance [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lazy-loading 'flavor' on Instance uuid d1591088-0892-4aa5-b7ea-3addb083bc69 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "d1591088-0892-4aa5-b7ea-3addb083bc69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:37 user nova-compute[74630]: INFO nova.compute.manager [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Attaching volume 22f70573-4b88-457a-b930-ee2f7247e6d8 to /dev/vdb
Oct 26 03:22:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG os_brick.utils [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e5f435-6512-4c71-b97d-1b4312f47feb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f0be2b-8e41-4602-9de0-1b0cf3ace20a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[430a017f-ab57-4b71-8fed-10746bbd7820]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[40505d37-2371-44dd-aa16-2c6d238fb828]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:22:37 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c36481e-1b3c-4c5e-bdd7-fa3fad62dcb3]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG os_brick.utils [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Updating existing volume attachment record: 6a788340-5661-4142-90c5-86b3308bed7c {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-8f9f4b46-ef17-4759-ba4a-65e53017c959 req-852b710f-5c59-47da-828e-4312e5032576 service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Received event network-changed-94f2d964-4b95-4a4c-a7cb-94bd34132f52 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-8f9f4b46-ef17-4759-ba4a-65e53017c959 req-852b710f-5c59-47da-828e-4312e5032576 service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Refreshing instance network info cache due to event network-changed-94f2d964-4b95-4a4c-a7cb-94bd34132f52. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8f9f4b46-ef17-4759-ba4a-65e53017c959 req-852b710f-5c59-47da-828e-4312e5032576 service nova] Acquiring lock "refresh_cache-bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8f9f4b46-ef17-4759-ba4a-65e53017c959 req-852b710f-5c59-47da-828e-4312e5032576 service nova] Acquired lock "refresh_cache-bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:37 user nova-compute[74630]: DEBUG nova.network.neutron [req-8f9f4b46-ef17-4759-ba4a-65e53017c959 req-852b710f-5c59-47da-828e-4312e5032576 service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Refreshing network info cache for port 94f2d964-4b95-4a4c-a7cb-94bd34132f52 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:22:38 user nova-compute[74630]: DEBUG nova.network.neutron [req-8f9f4b46-ef17-4759-ba4a-65e53017c959 req-852b710f-5c59-47da-828e-4312e5032576 service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Updated VIF entry in instance network info cache for port 94f2d964-4b95-4a4c-a7cb-94bd34132f52. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:22:38 user nova-compute[74630]: DEBUG nova.network.neutron [req-8f9f4b46-ef17-4759-ba4a-65e53017c959 req-852b710f-5c59-47da-828e-4312e5032576 service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Updating instance_info_cache with network_info: [{"id": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "address": "fa:16:3e:33:fc:53", "network": {"id": "aa89e219-e3f2-4813-a9f8-d8d983c69cc9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1154204399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7adc62ff197348a19e8870850be33852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f2d964-4b", "ovs_interfaceid": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8f9f4b46-ef17-4759-ba4a-65e53017c959 req-852b710f-5c59-47da-828e-4312e5032576 service nova] Releasing lock "refresh_cache-bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-fc06c7d8-db4f-4bcb-8051-c0ba969818fb req-f263c31b-7166-4ccf-9c52-702306b5a905 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received event network-changed-4fb62476-5cff-4ebe-a5fe-4990895d991d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-fc06c7d8-db4f-4bcb-8051-c0ba969818fb req-f263c31b-7166-4ccf-9c52-702306b5a905 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Refreshing instance network info cache due to event network-changed-4fb62476-5cff-4ebe-a5fe-4990895d991d. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:22:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-fc06c7d8-db4f-4bcb-8051-c0ba969818fb req-f263c31b-7166-4ccf-9c52-702306b5a905 service nova] Acquiring lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-fc06c7d8-db4f-4bcb-8051-c0ba969818fb req-f263c31b-7166-4ccf-9c52-702306b5a905 service nova] Acquired lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:40 user nova-compute[74630]: DEBUG nova.network.neutron [req-fc06c7d8-db4f-4bcb-8051-c0ba969818fb req-f263c31b-7166-4ccf-9c52-702306b5a905 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Refreshing network info cache for port 4fb62476-5cff-4ebe-a5fe-4990895d991d {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:22:41 user nova-compute[74630]: DEBUG nova.network.neutron [req-fc06c7d8-db4f-4bcb-8051-c0ba969818fb req-f263c31b-7166-4ccf-9c52-702306b5a905 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Updated VIF entry in instance network info cache for port 4fb62476-5cff-4ebe-a5fe-4990895d991d. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:22:41 user nova-compute[74630]: DEBUG nova.network.neutron [req-fc06c7d8-db4f-4bcb-8051-c0ba969818fb req-f263c31b-7166-4ccf-9c52-702306b5a905 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Updating instance_info_cache with network_info: [{"id": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "address": "fa:16:3e:0e:14:6d", "network": {"id": "efa0bf4a-3164-4b5e-8a28-cb55a80bf10b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1237751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb62476-5c", "ovs_interfaceid": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-fc06c7d8-db4f-4bcb-8051-c0ba969818fb req-f263c31b-7166-4ccf-9c52-702306b5a905 service nova] Releasing lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "interface-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "interface-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:41 user nova-compute[74630]: DEBUG nova.objects.instance [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lazy-loading 'flavor' on Instance uuid 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:22:41 user nova-compute[74630]: DEBUG nova.objects.instance [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lazy-loading 'pci_requests' on Instance uuid 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:22:41 user nova-compute[74630]: DEBUG nova.objects.base [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Object Instance<5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b> lazy-loaded attributes: flavor,pci_requests {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:22:41 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:22:41 user nova-compute[74630]: DEBUG nova.policy [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad908828808542d88bf198ad10a67ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee5c011c90e43d7be5ae38812de10e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:22:42 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Successfully created port: 95c62802-d8c8-467d-a4c5-4a4192f1b1b1 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:22:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:42 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Successfully updated port: 95c62802-d8c8-467d-a4c5-4a4192f1b1b1 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:22:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquired lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:42 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:22:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-765dc84e-9034-46a0-9191-12700bc9dc98 req-2172fcdb-a34c-4e24-bf5b-81f993f74b14 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received event network-changed-95c62802-d8c8-467d-a4c5-4a4192f1b1b1 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-765dc84e-9034-46a0-9191-12700bc9dc98 req-2172fcdb-a34c-4e24-bf5b-81f993f74b14 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Refreshing instance network info cache due to event network-changed-95c62802-d8c8-467d-a4c5-4a4192f1b1b1. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:22:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-765dc84e-9034-46a0-9191-12700bc9dc98 req-2172fcdb-a34c-4e24-bf5b-81f993f74b14 service nova] Acquiring lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Updating instance_info_cache with network_info: [{"id": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "address": "fa:16:3e:0e:14:6d", "network": {"id": "efa0bf4a-3164-4b5e-8a28-cb55a80bf10b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1237751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb62476-5c", "ovs_interfaceid": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "address": "fa:16:3e:50:b9:f9", "network": {"id": "3609f436-64b7-4afa-b29f-6d35afcdc1be", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1237555728", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c62802-d8", "ovs_interfaceid": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Releasing lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-765dc84e-9034-46a0-9191-12700bc9dc98 req-2172fcdb-a34c-4e24-bf5b-81f993f74b14 service nova] Acquired lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG nova.network.neutron [req-765dc84e-9034-46a0-9191-12700bc9dc98 req-2172fcdb-a34c-4e24-bf5b-81f993f74b14 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Refreshing network info cache for port 95c62802-d8c8-467d-a4c5-4a4192f1b1b1 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1573607150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1573607150',id=10,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZvVt6JBJwjHuYv5rzAu6BfJiTRPT7gKst00ewuSImGcEAgmFYYyJpfkfMTPoD2yUtdQjdpC1u2VHivVP4deD3aeXnWol8rB/ye8SYwl6D/y52fGTUBa9use//IRHEP+g==',key_name='tempest-keypair-1967708874',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:21:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ee5c011c90e43d7be5ae38812de10e0',ramdisk_id='',reservation_id='r-48ob7np6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-162967180',owner_user_name='tempest-TaggedAttachmentsTest-162967180-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad908828808542d88bf198ad10a67ce8',uuid=5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "address": "fa:16:3e:50:b9:f9", "network": {"id": "3609f436-64b7-4afa-b29f-6d35afcdc1be", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1237555728", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c62802-d8", "ovs_interfaceid": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Converting VIF {"id": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "address": "fa:16:3e:50:b9:f9", "network": {"id": "3609f436-64b7-4afa-b29f-6d35afcdc1be", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1237555728", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c62802-d8", "ovs_interfaceid": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:b9:f9,bridge_name='br-int',has_traffic_filtering=True,id=95c62802-d8c8-467d-a4c5-4a4192f1b1b1,network=Network(3609f436-64b7-4afa-b29f-6d35afcdc1be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c62802-d8') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG os_vif [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:b9:f9,bridge_name='br-int',has_traffic_filtering=True,id=95c62802-d8c8-467d-a4c5-4a4192f1b1b1,network=Network(3609f436-64b7-4afa-b29f-6d35afcdc1be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c62802-d8') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63a77aa8-638c-5a5b-a2af-9e385bcb1c83', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95c62802-d8, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95c62802-d8, col_values=(('qos', UUID('a6b4a310-5830-4d2a-b3cd-033a25b7a965')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95c62802-d8, col_values=(('external_ids', {'iface-id': '95c62802-d8c8-467d-a4c5-4a4192f1b1b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:b9:f9', 'vm-uuid': '5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:43 user nova-compute[74630]: INFO os_vif [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:b9:f9,bridge_name='br-int',has_traffic_filtering=True,id=95c62802-d8c8-467d-a4c5-4a4192f1b1b1,network=Network(3609f436-64b7-4afa-b29f-6d35afcdc1be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c62802-d8')
Oct 26 03:22:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1573607150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1573607150',id=10,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZvVt6JBJwjHuYv5rzAu6BfJiTRPT7gKst00ewuSImGcEAgmFYYyJpfkfMTPoD2yUtdQjdpC1u2VHivVP4deD3aeXnWol8rB/ye8SYwl6D/y52fGTUBa9use//IRHEP+g==',key_name='tempest-keypair-1967708874',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:21:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ee5c011c90e43d7be5ae38812de10e0',ramdisk_id='',reservation_id='r-48ob7np6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-162967180',owner_user_name='tempest-TaggedAttachmentsTest-162967180-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad908828808542d88bf198ad10a67ce8',uuid=5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "address": "fa:16:3e:50:b9:f9", "network": {"id": "3609f436-64b7-4afa-b29f-6d35afcdc1be", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1237555728", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c62802-d8", "ovs_interfaceid": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Converting VIF {"id": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "address": "fa:16:3e:50:b9:f9", "network": {"id": "3609f436-64b7-4afa-b29f-6d35afcdc1be", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1237555728", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c62802-d8", "ovs_interfaceid": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:b9:f9,bridge_name='br-int',has_traffic_filtering=True,id=95c62802-d8c8-467d-a4c5-4a4192f1b1b1,network=Network(3609f436-64b7-4afa-b29f-6d35afcdc1be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c62802-d8') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] attach device xml: <interface type="ethernet">
Oct 26 03:22:43 user nova-compute[74630]:   <mac address="fa:16:3e:50:b9:f9"/>
Oct 26 03:22:43 user nova-compute[74630]:   <model type="virtio"/>
Oct 26 03:22:43 user nova-compute[74630]:   <mtu size="1442"/>
Oct 26 03:22:43 user nova-compute[74630]:   <target dev="tap95c62802-d8"/>
Oct 26 03:22:43 user nova-compute[74630]: </interface>
Oct 26 03:22:43 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-16a64db2-8cc5-4871-a5dc-129f7e361461 req-725a573f-8009-4947-9814-19052e2e3789 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received event network-vif-plugged-95c62802-d8c8-467d-a4c5-4a4192f1b1b1 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-16a64db2-8cc5-4871-a5dc-129f7e361461 req-725a573f-8009-4947-9814-19052e2e3789 service nova] Acquiring lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-16a64db2-8cc5-4871-a5dc-129f7e361461 req-725a573f-8009-4947-9814-19052e2e3789 service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-16a64db2-8cc5-4871-a5dc-129f7e361461 req-725a573f-8009-4947-9814-19052e2e3789 service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-16a64db2-8cc5-4871-a5dc-129f7e361461 req-725a573f-8009-4947-9814-19052e2e3789 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] No waiting events found dispatching network-vif-plugged-95c62802-d8c8-467d-a4c5-4a4192f1b1b1 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:22:43 user nova-compute[74630]: WARNING nova.compute.manager [req-16a64db2-8cc5-4871-a5dc-129f7e361461 req-725a573f-8009-4947-9814-19052e2e3789 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received unexpected event network-vif-plugged-95c62802-d8c8-467d-a4c5-4a4192f1b1b1 for instance with vm_state active and task_state None.
Oct 26 03:22:44 user nova-compute[74630]: DEBUG nova.network.neutron [req-765dc84e-9034-46a0-9191-12700bc9dc98 req-2172fcdb-a34c-4e24-bf5b-81f993f74b14 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Updated VIF entry in instance network info cache for port 95c62802-d8c8-467d-a4c5-4a4192f1b1b1. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:22:44 user nova-compute[74630]: DEBUG nova.network.neutron [req-765dc84e-9034-46a0-9191-12700bc9dc98 req-2172fcdb-a34c-4e24-bf5b-81f993f74b14 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Updating instance_info_cache with network_info: [{"id": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "address": "fa:16:3e:0e:14:6d", "network": {"id": "efa0bf4a-3164-4b5e-8a28-cb55a80bf10b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1237751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb62476-5c", "ovs_interfaceid": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "address": "fa:16:3e:50:b9:f9", "network": {"id": "3609f436-64b7-4afa-b29f-6d35afcdc1be", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1237555728", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c62802-d8", "ovs_interfaceid": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-765dc84e-9034-46a0-9191-12700bc9dc98 req-2172fcdb-a34c-4e24-bf5b-81f993f74b14 service nova] Releasing lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:22:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] No BDM found with device name hda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:22:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] No VIF found with MAC fa:16:3e:0e:14:6d, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:22:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:22:44 user nova-compute[74630]:   <nova:package version="0.0.0"/>
Oct 26 03:22:44 user nova-compute[74630]:   <nova:name>tempest-device-tagging-server-1573607150</nova:name>
Oct 26 03:22:44 user nova-compute[74630]:   <nova:creationTime>2023-10-26 03:22:44</nova:creationTime>
Oct 26 03:22:44 user nova-compute[74630]:   <nova:flavor name="m1.tiny">
Oct 26 03:22:44 user nova-compute[74630]:     <nova:memory>512</nova:memory>
Oct 26 03:22:44 user nova-compute[74630]:     <nova:disk>1</nova:disk>
Oct 26 03:22:44 user nova-compute[74630]:     <nova:swap>0</nova:swap>
Oct 26 03:22:44 user nova-compute[74630]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:22:44 user nova-compute[74630]:     <nova:vcpus>1</nova:vcpus>
Oct 26 03:22:44 user nova-compute[74630]:   </nova:flavor>
Oct 26 03:22:44 user nova-compute[74630]:   <nova:owner>
Oct 26 03:22:44 user nova-compute[74630]:     <nova:user uuid="ad908828808542d88bf198ad10a67ce8">tempest-TaggedAttachmentsTest-162967180-project-member</nova:user>
Oct 26 03:22:44 user nova-compute[74630]:     <nova:project uuid="7ee5c011c90e43d7be5ae38812de10e0">tempest-TaggedAttachmentsTest-162967180</nova:project>
Oct 26 03:22:44 user nova-compute[74630]:   </nova:owner>
Oct 26 03:22:44 user nova-compute[74630]:   <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:22:44 user nova-compute[74630]:   <nova:ports>
Oct 26 03:22:44 user nova-compute[74630]:     <nova:port uuid="4fb62476-5cff-4ebe-a5fe-4990895d991d">
Oct 26 03:22:44 user nova-compute[74630]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 03:22:44 user nova-compute[74630]:     </nova:port>
Oct 26 03:22:44 user nova-compute[74630]:     <nova:port uuid="95c62802-d8c8-467d-a4c5-4a4192f1b1b1">
Oct 26 03:22:44 user nova-compute[74630]:       <nova:ip type="fixed" address="10.10.10.183" ipVersion="4"/>
Oct 26 03:22:44 user nova-compute[74630]:     </nova:port>
Oct 26 03:22:44 user nova-compute[74630]:   </nova:ports>
Oct 26 03:22:44 user nova-compute[74630]: </nova:instance>
Oct 26 03:22:44 user nova-compute[74630]:  {{(pid=74630) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 03:22:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e028cb35-0cc6-4909-8c21-6321af20660b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "interface-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.053s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-cfe74d57-95ef-4fca-ac37-e3f56427f338 req-f332b784-6b35-4761-931b-ce9bfd97fa6c service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received event network-vif-plugged-95c62802-d8c8-467d-a4c5-4a4192f1b1b1 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cfe74d57-95ef-4fca-ac37-e3f56427f338 req-f332b784-6b35-4761-931b-ce9bfd97fa6c service nova] Acquiring lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cfe74d57-95ef-4fca-ac37-e3f56427f338 req-f332b784-6b35-4761-931b-ce9bfd97fa6c service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cfe74d57-95ef-4fca-ac37-e3f56427f338 req-f332b784-6b35-4761-931b-ce9bfd97fa6c service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-cfe74d57-95ef-4fca-ac37-e3f56427f338 req-f332b784-6b35-4761-931b-ce9bfd97fa6c service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] No waiting events found dispatching network-vif-plugged-95c62802-d8c8-467d-a4c5-4a4192f1b1b1 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:22:45 user nova-compute[74630]: WARNING nova.compute.manager [req-cfe74d57-95ef-4fca-ac37-e3f56427f338 req-f332b784-6b35-4761-931b-ce9bfd97fa6c service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received unexpected event network-vif-plugged-95c62802-d8c8-467d-a4c5-4a4192f1b1b1 for instance with vm_state active and task_state None.
Oct 26 03:22:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-d01ae807-ac26-4b8a-91f1-4318302878f2 req-1943e032-5fdb-42a9-957a-35c2f00ca070 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Received event network-changed-f59f8d04-3231-40d4-8e2f-f40517ed0d09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:22:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-d01ae807-ac26-4b8a-91f1-4318302878f2 req-1943e032-5fdb-42a9-957a-35c2f00ca070 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Refreshing instance network info cache due to event network-changed-f59f8d04-3231-40d4-8e2f-f40517ed0d09. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:22:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d01ae807-ac26-4b8a-91f1-4318302878f2 req-1943e032-5fdb-42a9-957a-35c2f00ca070 service nova] Acquiring lock "refresh_cache-933f84b6-a3bb-47d7-b82e-f80ec5c15c43" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:22:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d01ae807-ac26-4b8a-91f1-4318302878f2 req-1943e032-5fdb-42a9-957a-35c2f00ca070 service nova] Acquired lock "refresh_cache-933f84b6-a3bb-47d7-b82e-f80ec5c15c43" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:22:51 user nova-compute[74630]: DEBUG nova.network.neutron [req-d01ae807-ac26-4b8a-91f1-4318302878f2 req-1943e032-5fdb-42a9-957a-35c2f00ca070 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Refreshing network info cache for port f59f8d04-3231-40d4-8e2f-f40517ed0d09 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:22:52 user nova-compute[74630]: DEBUG nova.network.neutron [req-d01ae807-ac26-4b8a-91f1-4318302878f2 req-1943e032-5fdb-42a9-957a-35c2f00ca070 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Updated VIF entry in instance network info cache for port f59f8d04-3231-40d4-8e2f-f40517ed0d09. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:22:52 user nova-compute[74630]: DEBUG nova.network.neutron [req-d01ae807-ac26-4b8a-91f1-4318302878f2 req-1943e032-5fdb-42a9-957a-35c2f00ca070 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Updating instance_info_cache with network_info: [{"id": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "address": "fa:16:3e:1f:1b:29", "network": {"id": "fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1042679542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5438cb807444ca791de9c7070430b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59f8d04-32", "ovs_interfaceid": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:22:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d01ae807-ac26-4b8a-91f1-4318302878f2 req-1943e032-5fdb-42a9-957a-35c2f00ca070 service nova] Releasing lock "refresh_cache-933f84b6-a3bb-47d7-b82e-f80ec5c15c43" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:22:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connector [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Factory for ISCSI on None {{(pid=74630) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGVtqDfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:22:56 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:22:56 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:22:56 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec920c81-1f0f-4f2d-9422-933a6d55ec2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:22:56 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b609f6a4-a50e-488d-87d6-0fce1ee40495]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8] added
Oct 26 03:22:56 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8aa305f-fbaa-440f-a22b-99e4badd7ed6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9de3d2-a10e-4387-928f-ee63f2fb6d07]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGVtqDfl {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGVtqDfl" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec7cc8c-2d70-4847-9fb6-89632cb4e91f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xGVtqDfl'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c8d838-f71c-42b0-9d12-260c333cf479]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c351509b-28a8-4122-a5fe-4007d1acadbe]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 03:22:56 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 03:22:56 user nova-compute[74630]:  {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:22:56 user nova-compute[74630]: WARNING os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 03:22:56 user nova-compute[74630]: 
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7599cd2-acd1-447c-af96-3457cacd84b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8, portal: 172.16.0.220,3260]
Oct 26 03:22:56 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8, portal: 172.16.0.220,3260] successful.
Oct 26 03:22:56 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b29838-c4da-4fb1-bf2a-a8bd15d62c83]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UaPcgVuz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:22:56 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[642171ab-f9bf-4b35-9af8-f02d3558fb2d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:22:56 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:22:56 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f3fe6f-b03a-4886-8b8e-5aed252080e5]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGVtqDfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Acquiring lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lazy-loading 'flavor' on Instance uuid 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG nova.objects.instance [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Lazy-loading 'flavor' on Instance uuid 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:22:56 user nova-compute[74630]: INFO nova.virt.block_device [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Booting with volume ec4b8394-e12d-48f4-9c06-54b8ef848417 at /dev/vdc
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.utils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ef0086-a8bc-4f11-9075-9379fa00d3f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[487baf84-ac1d-49ad-bb78-ff2b420a87e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5888be79-a68f-488e-a162-a8778c2211fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b921f96-d78c-49f4-a8f5-1a5026c3e907]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:22:56 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[45546a9e-46b7-4006-a04b-0229c8c51a29]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.utils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updating existing volume attachment record: d5b6aa3e-56dd-4444-a0ed-6ea058a3476a {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:56 user nova-compute[74630]: INFO nova.compute.manager [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Attaching volume 0964ef04-4d52-41f6-98d4-60f12d843ebb to /dev/vdb
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Acquiring lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:22:56 user nova-compute[74630]: INFO nova.compute.manager [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Attaching volume 3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 to /dev/vdb
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.utils [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aed44ec-252d-42d8-b933-77a0d089ca01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.utils [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5835e6-3c2b-48d8-8baa-fe847fdbb6dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c39631-a549-4f49-906c-6136ef8a3dd7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[337eb53b-ee96-41b8-9244-89bb87c47328]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5613e3-0c1d-41bc-a419-ee4402bf9bff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2742b25a-cefc-4a3d-918c-586f03aebb0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ab078e-9f62-4991-bbb9-b16fed9e038e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:22:56 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e02ad62-218e-4b6c-a058-5e4949a83a42]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f842fb63-0797-4c6e-9394-0607529d00b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.utils [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Updating existing volume attachment record: f688d92a-c1f9-4d17-af3f-f64331dc2c1c {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:22:56 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:22:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2c53b7-e704-4703-a9f1-e5e003a71da7]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG os_brick.utils [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:22:56 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Updating existing volume attachment record: 06ee7d81-b4cb-498d-9060-383f7300c76e {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26166623933366163', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166623933366163', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.062s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:22:57 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:22:57 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG nova.objects.instance [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lazy-loading 'flavor' on Instance uuid d1591088-0892-4aa5-b7ea-3addb083bc69 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a7a08a-890b-4029-a756-de2a7a4224de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:22:57 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:22:57 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:22:57 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 03:22:57 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:22:57 user nova-compute[74630]:   <serial>22f70573-4b88-457a-b930-ee2f7247e6d8</serial>
Oct 26 03:22:57 user nova-compute[74630]: </disk>
Oct 26 03:22:57 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9110da-94a0-475b-9fd8-6c8ee959e89e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45] added
Oct 26 03:22:57 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f264243d-896f-471b-8a9a-1fa0eff05ec0]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[80413e06-8e50-47a3-9a64-09a7c92e4e4e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UaPcgVuz {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UaPcgVuz" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85a30e3-e986-4476-9aa9-b49dee850e88]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UaPcgVuz'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d1b0f4-e768-4bbb-9680-d72d53d6ad86]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[131393dd-3c94-4493-856a-53c5c5fdff2a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:22:57 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:22:57 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[46743fc6-0717-4de9-9b52-bed89f4313f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45, portal: 172.16.0.220,3260]
Oct 26 03:22:57 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45, portal: 172.16.0.220,3260] successful.
Oct 26 03:22:57 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fa4497-bfea-4aa4-b9b7-08c5034ba16b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fde72b-3240-486a-b0dc-ed90a3980e5f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:22:57 user nova-compute[74630]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)
Oct 26 03:22:57 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:22:57 user nova-compute[74630]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)
Oct 26 03:22:57 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba484f0b-8032-4a19-85e5-d88a890a3051]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UaPcgVuz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:22:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] No VIF found with MAC fa:16:3e:eb:7c:ee, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:22:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:22:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:22:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] <== connect_volume: return (2383ms) {'type': 'block', 'scsi_wwn': '23064623135616330', 'path': '/dev/sdc'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:22:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064623135616330', 'path': '/dev/sdc'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:22:58 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lazy-loading 'flavor' on Instance uuid 82be4c02-7dbe-4ed7-af19-e4da1855065d {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:22:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:22:58 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:22:58 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:22:58 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:22:58 user nova-compute[74630]:   <serial>434454f0-6437-4e59-8d02-7ece4b19fc45</serial>
Oct 26 03:22:58 user nova-compute[74630]: </disk>
Oct 26 03:22:58 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:22:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:22:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:22:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] No VIF found with MAC fa:16:3e:bd:b3:80, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:23:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:10 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:23:11 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:23:12 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:23:12 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:23:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:13 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:23:13 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:23:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-747e596d-d9b3-4af2-be42-0fd494b6ef9a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:23:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-747e596d-d9b3-4af2-be42-0fd494b6ef9a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:23:13 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:23:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:13 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Updating instance_info_cache with network_info: [{"id": "bea61e08-ab64-488a-bd39-88fd0649d434", "address": "fa:16:3e:01:c5:87", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea61e08-ab", "ovs_interfaceid": "bea61e08-ab64-488a-bd39-88fd0649d434", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:23:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-747e596d-d9b3-4af2-be42-0fd494b6ef9a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:23:13 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:23:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SNHcLmgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:23:16 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:16 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:16 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[849a1a1e-3849-454f-9641-36e01bf9a12b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:23:16 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzhKDspo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:23:16 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[de46911e-7708-4909-9014-3223706aff44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "40316e54-eee2-4072-b436-4c5bb31724a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1] added
Oct 26 03:23:16 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG nova.compute.manager [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08c1bc7-6870-4c4f-b37c-f5c1b32b99c6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd308bb9-94cd-46d4-975d-c44a629f0cde]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SNHcLmgU {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SNHcLmgU" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ee3590-acd1-4d5e-8152-8f85e294513e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SNHcLmgU'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5150d8-7698-46e9-a969-e3d13abd2e53]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7c62a014-74a1-4c30-8f92-5709acdc9331 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.125s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[85946ed9-501a-4101-bf81-6adf15204354]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:16 user nova-compute[74630]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)
Oct 26 03:23:16 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:16 user nova-compute[74630]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)
Oct 26 03:23:16 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a926a7-0446-4d4d-b6cb-3830ce3cd9ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1, portal: 172.16.0.220,3260]
Oct 26 03:23:16 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1, portal: 172.16.0.220,3260] successful.
Oct 26 03:23:16 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:23:16 user nova-compute[74630]: INFO nova.compute.claims [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Claim successful on node user
Oct 26 03:23:16 user nova-compute[74630]: DEBUG nova.objects.instance [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lazy-loading 'flavor' on Instance uuid bb93fd61-5432-44d2-86c4-b4cdccc0e1c5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5504932b-3217-4092-ab10-d96091b2be82 tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 55.478s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8354609-c862-4fc1-974a-e16a52370f69]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1bec04-d8a2-4052-bce7-1797107ce433]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:16 user nova-compute[74630]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)
Oct 26 03:23:16 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:16 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:16 user nova-compute[74630]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)
Oct 26 03:23:16 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:16 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[61017149-e395-4e7e-9544-e033708b0772]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SNHcLmgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:16 user nova-compute[74630]: INFO nova.compute.manager [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Attaching volume 3292f489-a6c3-45a4-976c-7bf35239477a to /dev/sdc
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG os_brick.utils [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[27888771-ebdf-419e-a118-1102989628fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ea2b27-3b25-4ede-acb0-dc847cc0af7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d29be8-1c70-40bb-a795-f28f592469a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8155ef7-a463-47fa-9f64-cc723c444f6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:23:17 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e71681-d146-4c0d-96bf-9f7d10dfbd5b]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG os_brick.utils [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] <== get_connector_properties: return (212ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Updating existing volume attachment record: df0638a1-46bd-4e86-92b8-c8f2d32949bb {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.926s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG nova.network.neutron [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:23:17 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:23:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '26334373234633963', 'path': '/dev/sdd'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334373234633963', 'path': '/dev/sdd'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.361s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:17 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:17 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:23:17 user nova-compute[74630]: DEBUG nova.policy [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8694c5db6e34f1e88595b55f8e5fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e396316ddc243c594c29f5c434501cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[badcfc96-fd50-43c6-b65f-7c0c5077b874]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:23:17 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Acquiring lock "82be4c02-7dbe-4ed7-af19-e4da1855065d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Acquiring lock "82be4c02-7dbe-4ed7-af19-e4da1855065d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:17 user nova-compute[74630]: INFO nova.virt.block_device [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Booting with blank volume at /dev/vda
Oct 26 03:23:17 user nova-compute[74630]: INFO nova.compute.manager [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Terminating instance
Oct 26 03:23:17 user nova-compute[74630]: DEBUG nova.objects.instance [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Lazy-loading 'flavor' on Instance uuid 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81d34b3-ef64-47c6-9d20-f34f7439f04a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb] added
Oct 26 03:23:17 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[30971329-1796-4a68-adce-99cdb282cb02]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] attach device xml: <disk type="block" device="disk">
Oct 26 03:23:17 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:23:17 user nova-compute[74630]:   <source dev="/dev/sdd"/>
Oct 26 03:23:17 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:23:17 user nova-compute[74630]:   <serial>3392d2f7-d965-435c-9ba1-af9cd3e4c4f1</serial>
Oct 26 03:23:17 user nova-compute[74630]: </disk>
Oct 26 03:23:17 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ff3d4a-9484-487d-862c-4ce95c05c099]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kzhKDspo {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kzhKDspo" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8767e76-2e11-4ca3-ab57-be85a8de0136]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kzhKDspo'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b52c660-732b-4ec7-968a-e1a27b096a67]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0483be-64b7-461c-b8aa-bd2366cb2b1a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:18 user nova-compute[74630]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)
Oct 26 03:23:18 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:18 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:18 user nova-compute[74630]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)
Oct 26 03:23:18 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:18 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea879c7-f4e0-477e-af46-87ccf23d8539]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb, portal: 172.16.0.220,3260]
Oct 26 03:23:18 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb, portal: 172.16.0.220,3260] successful.
Oct 26 03:23:18 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca935f4-5465-4c42-bec2-eff3bd6a2b32]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0129b15-dee0-4d02-8b3b-1a36e83dccee]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:18 user nova-compute[74630]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)
Oct 26 03:23:18 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:18 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:18 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:18 user nova-compute[74630]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)
Oct 26 03:23:18 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:18 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:18 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.474s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-cf6f66fb-3598-45fc-b214-1debba973737 req-35e2e656-33d8-460b-b8ae-7cb155db77df service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Received event network-vif-unplugged-2722ab74-ccfd-44dc-ba27-6a2b98375ef8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cf6f66fb-3598-45fc-b214-1debba973737 req-35e2e656-33d8-460b-b8ae-7cb155db77df service nova] Acquiring lock "82be4c02-7dbe-4ed7-af19-e4da1855065d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cf6f66fb-3598-45fc-b214-1debba973737 req-35e2e656-33d8-460b-b8ae-7cb155db77df service nova] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cf6f66fb-3598-45fc-b214-1debba973737 req-35e2e656-33d8-460b-b8ae-7cb155db77df service nova] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-cf6f66fb-3598-45fc-b214-1debba973737 req-35e2e656-33d8-460b-b8ae-7cb155db77df service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] No waiting events found dispatching network-vif-unplugged-2722ab74-ccfd-44dc-ba27-6a2b98375ef8 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-cf6f66fb-3598-45fc-b214-1debba973737 req-35e2e656-33d8-460b-b8ae-7cb155db77df service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Received event network-vif-unplugged-2722ab74-ccfd-44dc-ba27-6a2b98375ef8 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abc775a-3e95-4ea8-8b7b-4f94b3d94a01]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzhKDspo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] No VIF found with MAC fa:16:3e:1f:1b:29, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG nova.network.neutron [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Successfully created port: 09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:23:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Instance destroyed successfully.
Oct 26 03:23:18 user nova-compute[74630]: DEBUG nova.objects.instance [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lazy-loading 'resources' on Instance uuid 82be4c02-7dbe-4ed7-af19-e4da1855065d {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-101769242',display_name='tempest-DeleteServersTestJSON-server-101769242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-101769242',id=2,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:20:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2d9b74567e04da0b94a1077f1b57bb8',ramdisk_id='',reservation_id='r-eah67v4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1244515193',owner_user_name='tempest-DeleteServersTestJSON-1244515193-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:20:37Z,user_data=None,user_id='b6a5a26bca1143e69720627d76b6e15a',uuid=82be4c02-7dbe-4ed7-af19-e4da1855065d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "address": "fa:16:3e:bd:b3:80", "network": {"id": "cc606e10-c5b0-4275-b289-4bcd2eca1b85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-218412921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2d9b74567e04da0b94a1077f1b57bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2722ab74-cc", "ovs_interfaceid": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Converting VIF {"id": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "address": "fa:16:3e:bd:b3:80", "network": {"id": "cc606e10-c5b0-4275-b289-4bcd2eca1b85", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-218412921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2d9b74567e04da0b94a1077f1b57bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2722ab74-cc", "ovs_interfaceid": "2722ab74-ccfd-44dc-ba27-6a2b98375ef8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:b3:80,bridge_name='br-int',has_traffic_filtering=True,id=2722ab74-ccfd-44dc-ba27-6a2b98375ef8,network=Network(cc606e10-c5b0-4275-b289-4bcd2eca1b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2722ab74-cc') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG os_vif [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:b3:80,bridge_name='br-int',has_traffic_filtering=True,id=2722ab74-ccfd-44dc-ba27-6a2b98375ef8,network=Network(cc606e10-c5b0-4275-b289-4bcd2eca1b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2722ab74-cc') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2722ab74-cc, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-da8b9dd6-9a97-4224-8e04-9a800f1a65cb tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.319s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57f53a74-59ab-407f-88a9-55c311511602) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:19 user nova-compute[74630]: INFO os_vif [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:b3:80,bridge_name='br-int',has_traffic_filtering=True,id=2722ab74-ccfd-44dc-ba27-6a2b98375ef8,network=Network(cc606e10-c5b0-4275-b289-4bcd2eca1b85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2722ab74-cc')
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UaPcgVuz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:23:19 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "d1591088-0892-4aa5-b7ea-3addb083bc69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:19 user nova-compute[74630]: INFO nova.compute.manager [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Detaching volume 22f70573-4b88-457a-b930-ee2f7247e6d8
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.529s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] <== connect_volume: return (2891ms) {'type': 'block', 'scsi_wwn': '26536666266326237', 'path': '/dev/sde'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536666266326237', 'path': '/dev/sde'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.291s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lazy-loading 'flavor' on Instance uuid 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:23:19 user nova-compute[74630]: INFO nova.virt.block_device [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Attempting to driver detach volume 22f70573-4b88-457a-b930-ee2f7247e6d8 from mountpoint /dev/vdb
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Attempting to detach device vdb from instance d1591088-0892-4aa5-b7ea-3addb083bc69 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:23:19 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:23:19 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 03:23:19 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:23:19 user nova-compute[74630]:   <serial>22f70573-4b88-457a-b930-ee2f7247e6d8</serial>
Oct 26 03:23:19 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:23:19 user nova-compute[74630]: </disk>
Oct 26 03:23:19 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8b8673-9c6f-485d-b6d1-348c4d240109]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:23:19 user nova-compute[74630]: No targets found.
Oct 26 03:23:19 user nova-compute[74630]: iSNS:
Oct 26 03:23:19 user nova-compute[74630]: No targets found.
Oct 26 03:23:19 user nova-compute[74630]: STATIC:
Oct 26 03:23:19 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45
Oct 26 03:23:19 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:19 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:19 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8
Oct 26 03:23:19 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:19 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:19 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1
Oct 26 03:23:19 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:19 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:19 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb
Oct 26 03:23:19 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:19 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:19 user nova-compute[74630]: FIRMWARE:
Oct 26 03:23:19 user nova-compute[74630]: No targets found.
Oct 26 03:23:19 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:23:19 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:23:19 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:19 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Successfully detached device vdb from instance d1591088-0892-4aa5-b7ea-3addb083bc69 from the persistent domain config.
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d1591088-0892-4aa5-b7ea-3addb083bc69 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:23:19 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:23:19 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 03:23:19 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:23:19 user nova-compute[74630]:   <serial>22f70573-4b88-457a-b930-ee2f7247e6d8</serial>
Oct 26 03:23:19 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:23:19 user nova-compute[74630]: </disk>
Oct 26 03:23:19 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:23:19 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:23:19 user nova-compute[74630]:   <source dev="/dev/sde"/>
Oct 26 03:23:19 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:23:19 user nova-compute[74630]:   <serial>0964ef04-4d52-41f6-98d4-60f12d843ebb</serial>
Oct 26 03:23:19 user nova-compute[74630]: </disk>
Oct 26 03:23:19 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[da650934-b188-4e1f-bba0-bb9fd72b6684]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9cf2cc-2c13-472e-8fef-da786b36938e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:19 user nova-compute[74630]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)
Oct 26 03:23:19 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:19 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:19 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:19 user nova-compute[74630]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 (non-flash)
Oct 26 03:23:19 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:19 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:19 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f318d757d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45'): ({'sdc'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Removing single pathed devices sdc {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.network.neutron [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Successfully updated port: 09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7567b4d3-bd30-4a94-a18c-93558f635bce]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquired lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.network.neutron [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-a9649e29-5618-4bfb-a5e1-98e5edf037a1 req-9476150f-9701-4fc2-bcc5-fe3703e693f1 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received event network-changed-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-a9649e29-5618-4bfb-a5e1-98e5edf037a1 req-9476150f-9701-4fc2-bcc5-fe3703e693f1 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Refreshing instance network info cache due to event network-changed-09559581-1c5c-4bee-90ea-fb70ae613d86. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a9649e29-5618-4bfb-a5e1-98e5edf037a1 req-9476150f-9701-4fc2-bcc5-fe3703e693f1 service nova] Acquiring lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b629c213-101b-48e5-9b8b-5078eceda3f7]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Flushing IO for device /dev/sdc {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[346a5612-b35b-47ef-bec9-4c601814cbf4]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.network.neutron [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[44307234-7d66-4f16-a57d-d7f8f5440898]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d0b87a-63a9-4a66-81c4-d0aaf2b42066]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe83ac1-75cb-4042-97d2-2e99e8d1212b]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45, portal: 172.16.0.220,3260]
Oct 26 03:23:19 user nova-compute[74630]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45, portal: 172.16.0.220,3260] successful.
Oct 26 03:23:19 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:434454f0-6437-4e59-8d02-7ece4b19fc45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3defbb9a-f35a-48dd-8051-bf8668600303]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] <== disconnect_volume: return (764ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:23:19 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Deleting instance files /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d_del
Oct 26 03:23:19 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Deletion of /opt/stack/data/nova/instances/82be4c02-7dbe-4ed7-af19-e4da1855065d_del complete
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:19 user nova-compute[74630]: INFO nova.compute.manager [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Took 2.07 seconds to destroy the instance on the hypervisor.
Oct 26 03:23:19 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:23:19 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] No BDM found with device name hda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] No VIF found with MAC fa:16:3e:0e:14:6d, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a8ff8cec-a6f5-4663-b445-b12c602ccc11 tempest-VolumesAssistedSnapshotsTest-1189393806 tempest-VolumesAssistedSnapshotsTest-1189393806-project] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] volume_snapshot_create: create_info: {'snapshot_id': 'd0115b83-a3e3-45be-8e01-be22caa5ff96', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74630) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-ab2e987f-4c14-4a2b-a5b3-af121d4429e5 req-bdf88e99-26f7-42f0-b8d9-0452face1721 service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Received event network-vif-plugged-2722ab74-ccfd-44dc-ba27-6a2b98375ef8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ab2e987f-4c14-4a2b-a5b3-af121d4429e5 req-bdf88e99-26f7-42f0-b8d9-0452face1721 service nova] Acquiring lock "82be4c02-7dbe-4ed7-af19-e4da1855065d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ab2e987f-4c14-4a2b-a5b3-af121d4429e5 req-bdf88e99-26f7-42f0-b8d9-0452face1721 service nova] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ab2e987f-4c14-4a2b-a5b3-af121d4429e5 req-bdf88e99-26f7-42f0-b8d9-0452face1721 service nova] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-ab2e987f-4c14-4a2b-a5b3-af121d4429e5 req-bdf88e99-26f7-42f0-b8d9-0452face1721 service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] No waiting events found dispatching network-vif-plugged-2722ab74-ccfd-44dc-ba27-6a2b98375ef8 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:20 user nova-compute[74630]: WARNING nova.compute.manager [req-ab2e987f-4c14-4a2b-a5b3-af121d4429e5 req-bdf88e99-26f7-42f0-b8d9-0452face1721 service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Received unexpected event network-vif-plugged-2722ab74-ccfd-44dc-ba27-6a2b98375ef8 for instance with vm_state active and task_state deleting.
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-429228be-b4ca-45f4-a8c6-9b16de650eeb tempest-VolumesAssistedSnapshotsTest-1189393806 tempest-VolumesAssistedSnapshotsTest-1189393806-project] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] volume_snapshot_delete: delete_info: {'volume_id': '3392d2f7-d965-435c-9ba1-af9cd3e4c4f1'} {{(pid=74630) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [None req-429228be-b4ca-45f4-a8c6-9b16de650eeb tempest-VolumesAssistedSnapshotsTest-1189393806 tempest-VolumesAssistedSnapshotsTest-1189393806-project] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Traceback (most recent call last):
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     if delete_info['type'] != 'qcow2':
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] KeyError: 'type'
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] 
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d1591088-0892-4aa5-b7ea-3addb083bc69 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a8ff8cec-a6f5-4663-b445-b12c602ccc11 tempest-VolumesAssistedSnapshotsTest-1189393806 tempest-VolumesAssistedSnapshotsTest-1189393806-project] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] snap xml: <domainsnapshot>
Oct 26 03:23:20 user nova-compute[74630]:   <disks>
Oct 26 03:23:20 user nova-compute[74630]:     <disk name="/dev/sdd" snapshot="external" type="file">
Oct 26 03:23:20 user nova-compute[74630]:       <source file="/dev/new_file"/>
Oct 26 03:23:20 user nova-compute[74630]:     </disk>
Oct 26 03:23:20 user nova-compute[74630]:     <disk name="vda" snapshot="no"/>
Oct 26 03:23:20 user nova-compute[74630]:   </disks>
Oct 26 03:23:20 user nova-compute[74630]: </domainsnapshot>
Oct 26 03:23:20 user nova-compute[74630]:  {{(pid=74630) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.objects.instance [None req-a8ff8cec-a6f5-4663-b445-b12c602ccc11 tempest-VolumesAssistedSnapshotsTest-1189393806 tempest-VolumesAssistedSnapshotsTest-1189393806-project] Lazy-loading 'system_metadata' on Instance uuid 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:23:20 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:23:20 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=6688MB free_disk=25.308414459228516GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [None req-429228be-b4ca-45f4-a8c6-9b16de650eeb tempest-VolumesAssistedSnapshotsTest-1189393806 tempest-VolumesAssistedSnapshotsTest-1189393806-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver 
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver 
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-5f4b7f01-e2d0-408f-ae15-8f469b1ed5da)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver 
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver 
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver 
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server [None req-429228be-b4ca-45f4-a8c6-9b16de650eeb tempest-VolumesAssistedSnapshotsTest-1189393806 tempest-VolumesAssistedSnapshotsTest-1189393806-project] Exception during message handling: KeyError: 'type'
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server 
Oct 26 03:23:20 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-a8ff8cec-a6f5-4663-b445-b12c602ccc11 tempest-VolumesAssistedSnapshotsTest-1189393806 tempest-VolumesAssistedSnapshotsTest-1189393806-project] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [None req-a8ff8cec-a6f5-4663-b445-b12c602ccc11 tempest-VolumesAssistedSnapshotsTest-1189393806 tempest-VolumesAssistedSnapshotsTest-1189393806-project] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Traceback (most recent call last):
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     rv = execute(f, *args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     six.reraise(c, e, tb)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     raise value
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     rv = meth(*args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] 
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [None req-a8ff8cec-a6f5-4663-b445-b12c602ccc11 tempest-VolumesAssistedSnapshotsTest-1189393806 tempest-VolumesAssistedSnapshotsTest-1189393806-project] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Traceback (most recent call last):
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     self._volume_snapshot_create(context, instance, guest,
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     rv = execute(f, *args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     six.reraise(c, e, tb)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     raise value
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     rv = meth(*args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] 
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver [None req-a8ff8cec-a6f5-4663-b445-b12c602ccc11 tempest-VolumesAssistedSnapshotsTest-1189393806 tempest-VolumesAssistedSnapshotsTest-1189393806-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot d0115b83-a3e3-45be-8e01-be22caa5ff96 could not be found.
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     raise value
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver 
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver 
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot d0115b83-a3e3-45be-8e01-be22caa5ff96 could not be found. (HTTP 404) (Request-ID: req-3afab43b-2dc9-4de0-bb54-2e5026ed422a)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver 
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver 
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot d0115b83-a3e3-45be-8e01-be22caa5ff96 could not be found.
Oct 26 03:23:20 user nova-compute[74630]: ERROR nova.virt.libvirt.driver 
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b75fa2d2-007a-4120-877a-42a51280359c tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.106s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server [None req-a8ff8cec-a6f5-4663-b445-b12c602ccc11 tempest-VolumesAssistedSnapshotsTest-1189393806 tempest-VolumesAssistedSnapshotsTest-1189393806-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     raise value
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 03:23:20 user nova-compute[74630]: ERROR oslo_messaging.rpc.server 
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:23:20 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Creating image(s)
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Ensure instance console log exists: /opt/stack/data/nova/instances/2d851c9c-c56c-4be0-ac59-ea59ea9304c2/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Start _get_guest_xml network_info=[{"id": "bf5f9227-19d4-480f-bdda-d8d839b63030", "address": "fa:16:3e:99:96:bd", "network": {"id": "dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1333134059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5f9227-19", "ovs_interfaceid": "bf5f9227-19d4-480f-bdda-d8d839b63030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "address": "fa:16:3e:b0:a9:f6", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ed9aa-b6", "ovs_interfaceid": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "address": "fa:16:3e:ad:f4:1d", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap812b7cf9-19", "ovs_interfaceid": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "address": "fa:16:3e:94:57:f1", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03b6f6f-4e", "ovs_interfaceid": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "address": "fa:16:3e:b9:da:9b", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b88a64-c3", "ovs_interfaceid": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6756804-11a1-42a7-a432-bd0829d6dea0", "address": "fa:16:3e:0a:93:81", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6756804-11", "ovs_interfaceid": "d6756804-11a1-42a7-a432-bd0829d6dea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "address": "fa:16:3e:cb:c8:46", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff80c83f-f6", "ovs_interfaceid": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Sultmbad', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2d851c9c-c56c-4be0-ac59-ea59ea9304c2', 'attached_at': '', 'detached_at': '', 'volume_id': '66fc789f-3bdc-4f37-925a-5e1e646e2550', 'serial': '66fc789f-3bdc-4f37-925a-5e1e646e2550'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '43947fca-d4fb-4ae0-8586-38a69049bb34', 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVCNKUvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2d851c9c-c56c-4be0-ac59-ea59ea9304c2', 'attached_at': '', 'detached_at': '', 'volume_id': 'b40ba2fd-80b5-4121-88a1-27603fb56fea', 'serial': 'b40ba2fd-80b5-4121-88a1-27603fb56fea'}, 'boot_index': 1, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '35a71926-7298-4b89-b8d3-443016f3edcf', 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQxOdzaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2d851c9c-c56c-4be0-ac59-ea59ea9304c2', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec4b8394-e12d-48f4-9c06-54b8ef848417', 'serial': 'ec4b8394-e12d-48f4-9c06-54b8ef848417'}, 'boot_index': 2, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'd5b6aa3e-56dd-4444-a0ed-6ea058a3476a', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 65ff804f-8b98-406d-8c5c-3d73bb52ff18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance bb93fd61-5432-44d2-86c4-b4cdccc0e1c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 82be4c02-7dbe-4ed7-af19-e4da1855065d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 2d851c9c-c56c-4be0-ac59-ea59ea9304c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 747e596d-d9b3-4af2-be42-0fd494b6ef9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance b4b703bf-de53-4f1f-b94e-2c3048577d52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d1591088-0892-4aa5-b7ea-3addb083bc69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:23:20 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:23:20 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Sultmbad', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:23:20 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:20 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:20 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.network.neutron [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Updating instance_info_cache with network_info: [{"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7e474f-b19c-444e-9c3e-2460e44eab14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:23:20 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Releasing lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.compute.manager [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Instance network_info: |[{"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Acquiring lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a9649e29-5618-4bfb-a5e1-98e5edf037a1 req-9476150f-9701-4fc2-bcc5-fe3703e693f1 service nova] Acquired lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG nova.network.neutron [req-a9649e29-5618-4bfb-a5e1-98e5edf037a1 req-9476150f-9701-4fc2-bcc5-fe3703e693f1 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Refreshing network info cache for port 09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:23:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed251788-85f5-483d-9f10-fe9e8d8c4eb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550] added
Oct 26 03:23:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:21 user nova-compute[74630]: INFO nova.compute.manager [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Detaching volume 3392d2f7-d965-435c-9ba1-af9cd3e4c4f1
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcbfe56-ac62-4403-bfc1-956b16912d39]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:21 user nova-compute[74630]: INFO nova.virt.block_device [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Attempting to driver detach volume 3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 from mountpoint /dev/vdb
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cbd27e-e65a-44ff-9fca-421d20ae882f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Sultmbad {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Attempting to detach device vdb from instance 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] detach device xml: <disk type="block" device="disk">
Oct 26 03:23:21 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:23:21 user nova-compute[74630]:   <source dev="/dev/sdd"/>
Oct 26 03:23:21 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:23:21 user nova-compute[74630]:   <serial>3392d2f7-d965-435c-9ba1-af9cd3e4c4f1</serial>
Oct 26 03:23:21 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:23:21 user nova-compute[74630]: </disk>
Oct 26 03:23:21 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Sultmbad" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1791931-a845-4ac7-89ca-a5cbe8847e18]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:21 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Successfully detached device vdb from instance 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 from the persistent domain config.
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] detach device xml: <disk type="block" device="disk">
Oct 26 03:23:21 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:23:21 user nova-compute[74630]:   <source dev="/dev/sdd"/>
Oct 26 03:23:21 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:23:21 user nova-compute[74630]:   <serial>3392d2f7-d965-435c-9ba1-af9cd3e4c4f1</serial>
Oct 26 03:23:21 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:23:21 user nova-compute[74630]: </disk>
Oct 26 03:23:21 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Sultmbad'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d389f3-73bb-43be-8fae-f15f76425a06]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cb52db-c3a6-49c4-836d-ba6013c67ef6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:21 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:21 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:21 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:21 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:21 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Took 1.19 seconds to deallocate network for instance.
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.compute.manager [req-ee9416e2-0857-4385-b311-b5400c395c4e req-21f02301-b19d-4d9e-a0b6-94d52d44f141 service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Received event network-vif-deleted-2722ab74-ccfd-44dc-ba27-6a2b98375ef8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:21 user nova-compute[74630]: INFO nova.compute.manager [req-ee9416e2-0857-4385-b311-b5400c395c4e req-21f02301-b19d-4d9e-a0b6-94d52d44f141 service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Neutron deleted interface 2722ab74-ccfd-44dc-ba27-6a2b98375ef8; detaching it from the instance and deleting it from the info cache
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.network.neutron [req-ee9416e2-0857-4385-b311-b5400c395c4e req-21f02301-b19d-4d9e-a0b6-94d52d44f141 service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.compute.manager [req-ee9416e2-0857-4385-b311-b5400c395c4e req-21f02301-b19d-4d9e-a0b6-94d52d44f141 service nova] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Detach interface failed, port_id=2722ab74-ccfd-44dc-ba27-6a2b98375ef8, reason: Instance 82be4c02-7dbe-4ed7-af19-e4da1855065d could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[906d1906-6286-4b31-9d25-a01e58da9f6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550, portal: 172.16.0.220,3260]
Oct 26 03:23:21 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550, portal: 172.16.0.220,3260] successful.
Oct 26 03:23:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c75ec4d-becb-4ae7-afc5-4fb02b77da12]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[39765230-5431-4fb1-b53e-8f0f3af34717]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:21 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:21 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:21 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:21 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:21 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:21 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] HCTL ('34', '-', '-', 0) found on session 6 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5109dcc5-533f-4379-89dd-c81ba579926b]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Sultmbad', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.network.neutron [req-a9649e29-5618-4bfb-a5e1-98e5edf037a1 req-9476150f-9701-4fc2-bcc5-fe3703e693f1 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Updated VIF entry in instance network info cache for port 09559581-1c5c-4bee-90ea-fb70ae613d86. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.network.neutron [req-a9649e29-5618-4bfb-a5e1-98e5edf037a1 req-9476150f-9701-4fc2-bcc5-fe3703e693f1 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Updating instance_info_cache with network_info: [{"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.931s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a9649e29-5618-4bfb-a5e1-98e5edf037a1 req-9476150f-9701-4fc2-bcc5-fe3703e693f1 service nova] Releasing lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:21 user nova-compute[74630]: INFO nova.compute.manager [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Detaching volume 0964ef04-4d52-41f6-98d4-60f12d843ebb
Oct 26 03:23:21 user nova-compute[74630]: INFO nova.virt.block_device [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Attempting to driver detach volume 0964ef04-4d52-41f6-98d4-60f12d843ebb from mountpoint /dev/vdb
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Attempting to detach device vdb from instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:23:21 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:23:21 user nova-compute[74630]:   <source dev="/dev/sde"/>
Oct 26 03:23:21 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:23:21 user nova-compute[74630]:   <serial>0964ef04-4d52-41f6-98d4-60f12d843ebb</serial>
Oct 26 03:23:21 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 03:23:21 user nova-compute[74630]: </disk>
Oct 26 03:23:21 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:23:21 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Successfully detached device vdb from instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b from the persistent domain config.
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:23:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:23:21 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:23:21 user nova-compute[74630]:   <source dev="/dev/sde"/>
Oct 26 03:23:21 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:23:21 user nova-compute[74630]:   <serial>0964ef04-4d52-41f6-98d4-60f12d843ebb</serial>
Oct 26 03:23:21 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 03:23:21 user nova-compute[74630]: </disk>
Oct 26 03:23:21 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:23:22 user nova-compute[74630]: INFO nova.compute.manager [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] [instance: 82be4c02-7dbe-4ed7-af19-e4da1855065d] Took 0.94 seconds to detach 1 volumes for instance.
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '23363636632323533', 'path': '/dev/sdc'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363636632323533', 'path': '/dev/sdc'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVCNKUvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:23:22 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:22 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:22 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:23:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5d430c-d906-4134-bc75-0d24a233e801]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:23:22 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2835f4c5-2658-4bc3-b9d4-5c3272d92561]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea] added
Oct 26 03:23:22 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4f0d2b-92ae-41db-8622-0c0e1336afa6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1894a7d9-15ce-434e-bb54-0f6e005cb00b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oVCNKUvM {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oVCNKUvM" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f021bf-c0a8-45df-b993-f8517f899c4a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oVCNKUvM'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7f8c00-cf2c-434b-9978-5fc4ad547a1b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf27a09-025d-486f-be3f-02db0b02a999]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:22 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:22 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:22 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:22 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:22 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:22 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:22 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:22 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9901094-6fa5-4510-ad77-e2294271f6ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea, portal: 172.16.0.220,3260]
Oct 26 03:23:22 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea, portal: 172.16.0.220,3260] successful.
Oct 26 03:23:22 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07ae943-bba6-4f19-95d1-ae6f38478a24]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[75497e9a-7fb9-44bf-bf7e-1d8fc6668f2e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:22 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:22 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:22 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:22 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:22 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:22 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:22 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:22 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:22 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:22 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8def357-ce45-41fe-b42b-e522e1ac9770]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:23:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVCNKUvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:23:22 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Deleted allocations for instance 82be4c02-7dbe-4ed7-af19-e4da1855065d
Oct 26 03:23:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e023df2b-8ee8-4fbf-a1ae-1a9b73af161f tempest-DeleteServersTestJSON-1244515193 tempest-DeleteServersTestJSON-1244515193-project-member] Lock "82be4c02-7dbe-4ed7-af19-e4da1855065d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.009s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23563313838623465', 'path': '/dev/sdf'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563313838623465', 'path': '/dev/sdf'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQxOdzaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:23:23 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:23 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:23 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e5bb4f-1051-4de0-8cee-f6795f17481d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:23:23 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be7a920-08d2-4a58-95fa-c45722879de6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417] added
Oct 26 03:23:23 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52a406f-62c3-41bd-a654-97b76c12765a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebb2b01-0082-43aa-94f4-cd931c8b3c08]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oQxOdzaA {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG os_brick.utils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oQxOdzaA" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d009ff0c-9031-45ec-888d-3b77644a4e36]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oQxOdzaA'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a85b26-d108-4d02-967a-c2edbac47920]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[05574253-6624-4945-ad73-46f45ee43a45]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[92164355-930f-47d2-b8c2-b963f3b40f40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6cfa74-957c-4dfc-819c-68525bcd48f3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:24 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:24 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab4c577-a01e-4c05-b033-538b3b60b1c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[947e185a-3401-4798-832f-403dffeb984d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:23:24 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3697eb1-3fba-4ce9-b1ba-32a076b96cc6]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a5f380-cd11-4d53-9bf4-0f1d4db1c65a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.utils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Updating existing volume attachment record: ba34519e-1b55-404b-b19f-2738c9b2f2fc {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417, portal: 172.16.0.220,3260]
Oct 26 03:23:24 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417, portal: 172.16.0.220,3260] successful.
Oct 26 03:23:24 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51d7a40-4b78-4028-9335-7bf57621f799]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0b2625-d197-48c6-9408-1de03367bc79]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:24 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:24 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:24 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b50b90-4d27-418b-8159-73f4918a1ad5]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:23:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQxOdzaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23139376562336532', 'path': '/dev/sdg'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139376562336532', 'path': '/dev/sdg'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf5f9227-19d4-480f-bdda-d8d839b63030", "address": "fa:16:3e:99:96:bd", "network": {"id": "dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1333134059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5f9227-19", "ovs_interfaceid": "bf5f9227-19d4-480f-bdda-d8d839b63030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "bf5f9227-19d4-480f-bdda-d8d839b63030", "address": "fa:16:3e:99:96:bd", "network": {"id": "dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1333134059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5f9227-19", "ovs_interfaceid": "bf5f9227-19d4-480f-bdda-d8d839b63030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:96:bd,bridge_name='br-int',has_traffic_filtering=True,id=bf5f9227-19d4-480f-bdda-d8d839b63030,network=Network(dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5f9227-19') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "address": "fa:16:3e:b0:a9:f6", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ed9aa-b6", "ovs_interfaceid": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "address": "fa:16:3e:b0:a9:f6", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ed9aa-b6", "ovs_interfaceid": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a9:f6,bridge_name='br-int',has_traffic_filtering=True,id=209ed9aa-b6ea-4103-8231-7f6380f5d187,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap209ed9aa-b6') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "address": "fa:16:3e:ad:f4:1d", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap812b7cf9-19", "ovs_interfaceid": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "address": "fa:16:3e:ad:f4:1d", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap812b7cf9-19", "ovs_interfaceid": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f4:1d,bridge_name='br-int',has_traffic_filtering=True,id=812b7cf9-199e-458a-93f5-3a73dfe4a05a,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap812b7cf9-19') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "address": "fa:16:3e:94:57:f1", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03b6f6f-4e", "ovs_interfaceid": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "address": "fa:16:3e:94:57:f1", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03b6f6f-4e", "ovs_interfaceid": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:57:f1,bridge_name='br-int',has_traffic_filtering=True,id=d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03b6f6f-4e') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "address": "fa:16:3e:b9:da:9b", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b88a64-c3", "ovs_interfaceid": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "address": "fa:16:3e:b9:da:9b", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b88a64-c3", "ovs_interfaceid": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:da:9b,bridge_name='br-int',has_traffic_filtering=True,id=07b88a64-c3ce-41e1-a8c5-9a394f06f0a6,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b88a64-c3') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6756804-11a1-42a7-a432-bd0829d6dea0", "address": "fa:16:3e:0a:93:81", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6756804-11", "ovs_interfaceid": "d6756804-11a1-42a7-a432-bd0829d6dea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "d6756804-11a1-42a7-a432-bd0829d6dea0", "address": "fa:16:3e:0a:93:81", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6756804-11", "ovs_interfaceid": "d6756804-11a1-42a7-a432-bd0829d6dea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:93:81,bridge_name='br-int',has_traffic_filtering=True,id=d6756804-11a1-42a7-a432-bd0829d6dea0,network=Network(d0787d74-357e-438a-9f2c-5246827263ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6756804-11') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "address": "fa:16:3e:cb:c8:46", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff80c83f-f6", "ovs_interfaceid": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "address": "fa:16:3e:cb:c8:46", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff80c83f-f6", "ovs_interfaceid": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c8:46,bridge_name='br-int',has_traffic_filtering=True,id=ff80c83f-f62c-4f70-a9ca-add8c4a366fd,network=Network(d0787d74-357e-438a-9f2c-5246827263ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff80c83f-f6') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d851c9c-c56c-4be0-ac59-ea59ea9304c2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:23:25 user nova-compute[74630]:   <uuid>2d851c9c-c56c-4be0-ac59-ea59ea9304c2</uuid>
Oct 26 03:23:25 user nova-compute[74630]:   <name>instance-0000000c</name>
Oct 26 03:23:25 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:23:25 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:23:25 user nova-compute[74630]:   <metadata>
Oct 26 03:23:25 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:23:25 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:23:25 user nova-compute[74630]:       <nova:name>tempest-device-tagging-server-890194570</nova:name>
Oct 26 03:23:25 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:23:20</nova:creationTime>
Oct 26 03:23:25 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:23:25 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:23:25 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:23:25 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:23:25 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:23:25 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:23:25 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:23:25 user nova-compute[74630]:       <nova:owner>
Oct 26 03:23:25 user nova-compute[74630]:         <nova:user uuid="32312445505b4992826f937b5c080395">tempest-TaggedBootDevicesTest_v242-1268455053-project-member</nova:user>
Oct 26 03:23:25 user nova-compute[74630]:         <nova:project uuid="ab9f996fcad8409981bf1093a0a48c0c">tempest-TaggedBootDevicesTest_v242-1268455053</nova:project>
Oct 26 03:23:25 user nova-compute[74630]:       </nova:owner>
Oct 26 03:23:25 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:23:25 user nova-compute[74630]:       <nova:ports>
Oct 26 03:23:25 user nova-compute[74630]:         <nova:port uuid="bf5f9227-19d4-480f-bdda-d8d839b63030">
Oct 26 03:23:25 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 03:23:25 user nova-compute[74630]:         </nova:port>
Oct 26 03:23:25 user nova-compute[74630]:         <nova:port uuid="209ed9aa-b6ea-4103-8231-7f6380f5d187">
Oct 26 03:23:25 user nova-compute[74630]:           <nova:ip type="fixed" address="10.1.1.3" ipVersion="4"/>
Oct 26 03:23:25 user nova-compute[74630]:         </nova:port>
Oct 26 03:23:25 user nova-compute[74630]:         <nova:port uuid="812b7cf9-199e-458a-93f5-3a73dfe4a05a">
Oct 26 03:23:25 user nova-compute[74630]:           <nova:ip type="fixed" address="10.1.1.140" ipVersion="4"/>
Oct 26 03:23:25 user nova-compute[74630]:         </nova:port>
Oct 26 03:23:25 user nova-compute[74630]:         <nova:port uuid="d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1">
Oct 26 03:23:25 user nova-compute[74630]:           <nova:ip type="fixed" address="10.1.1.27" ipVersion="4"/>
Oct 26 03:23:25 user nova-compute[74630]:         </nova:port>
Oct 26 03:23:25 user nova-compute[74630]:         <nova:port uuid="07b88a64-c3ce-41e1-a8c5-9a394f06f0a6">
Oct 26 03:23:25 user nova-compute[74630]:           <nova:ip type="fixed" address="10.1.1.175" ipVersion="4"/>
Oct 26 03:23:25 user nova-compute[74630]:         </nova:port>
Oct 26 03:23:25 user nova-compute[74630]:         <nova:port uuid="d6756804-11a1-42a7-a432-bd0829d6dea0">
Oct 26 03:23:25 user nova-compute[74630]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 26 03:23:25 user nova-compute[74630]:         </nova:port>
Oct 26 03:23:25 user nova-compute[74630]:         <nova:port uuid="ff80c83f-f62c-4f70-a9ca-add8c4a366fd">
Oct 26 03:23:25 user nova-compute[74630]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 26 03:23:25 user nova-compute[74630]:         </nova:port>
Oct 26 03:23:25 user nova-compute[74630]:       </nova:ports>
Oct 26 03:23:25 user nova-compute[74630]:     </nova:instance>
Oct 26 03:23:25 user nova-compute[74630]:   </metadata>
Oct 26 03:23:25 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:23:25 user nova-compute[74630]:     <system>
Oct 26 03:23:25 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:23:25 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:23:25 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:23:25 user nova-compute[74630]:       <entry name="serial">2d851c9c-c56c-4be0-ac59-ea59ea9304c2</entry>
Oct 26 03:23:25 user nova-compute[74630]:       <entry name="uuid">2d851c9c-c56c-4be0-ac59-ea59ea9304c2</entry>
Oct 26 03:23:25 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:23:25 user nova-compute[74630]:     </system>
Oct 26 03:23:25 user nova-compute[74630]:   </sysinfo>
Oct 26 03:23:25 user nova-compute[74630]:   <os>
Oct 26 03:23:25 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:23:25 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:23:25 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:23:25 user nova-compute[74630]:   </os>
Oct 26 03:23:25 user nova-compute[74630]:   <features>
Oct 26 03:23:25 user nova-compute[74630]:     <acpi/>
Oct 26 03:23:25 user nova-compute[74630]:     <apic/>
Oct 26 03:23:25 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:23:25 user nova-compute[74630]:   </features>
Oct 26 03:23:25 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:23:25 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:23:25 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:23:25 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:23:25 user nova-compute[74630]:   </clock>
Oct 26 03:23:25 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:23:25 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:23:25 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:23:25 user nova-compute[74630]:   </cpu>
Oct 26 03:23:25 user nova-compute[74630]:   <devices>
Oct 26 03:23:25 user nova-compute[74630]:     <disk type="file" device="cdrom">
Oct 26 03:23:25 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 03:23:25 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/2d851c9c-c56c-4be0-ac59-ea59ea9304c2/disk.config"/>
Oct 26 03:23:25 user nova-compute[74630]:       <target dev="hda" bus="ide"/>
Oct 26 03:23:25 user nova-compute[74630]:     </disk>
Oct 26 03:23:25 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:23:25 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:23:25 user nova-compute[74630]:       <source dev="/dev/sdc"/>
Oct 26 03:23:25 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:23:25 user nova-compute[74630]:       <serial>66fc789f-3bdc-4f37-925a-5e1e646e2550</serial>
Oct 26 03:23:25 user nova-compute[74630]:     </disk>
Oct 26 03:23:25 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:23:25 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:23:25 user nova-compute[74630]:       <source dev="/dev/sdf"/>
Oct 26 03:23:25 user nova-compute[74630]:       <target dev="vdb" bus="virtio"/>
Oct 26 03:23:25 user nova-compute[74630]:       <serial>b40ba2fd-80b5-4121-88a1-27603fb56fea</serial>
Oct 26 03:23:25 user nova-compute[74630]:     </disk>
Oct 26 03:23:25 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:23:25 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:23:25 user nova-compute[74630]:       <source dev="/dev/sdg"/>
Oct 26 03:23:25 user nova-compute[74630]:       <target dev="vdc" bus="virtio"/>
Oct 26 03:23:25 user nova-compute[74630]:       <serial>ec4b8394-e12d-48f4-9c06-54b8ef848417</serial>
Oct 26 03:23:25 user nova-compute[74630]:     </disk>
Oct 26 03:23:25 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:23:25 user nova-compute[74630]:       <mac address="fa:16:3e:99:96:bd"/>
Oct 26 03:23:25 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:23:25 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:23:25 user nova-compute[74630]:       <target dev="tapbf5f9227-19"/>
Oct 26 03:23:25 user nova-compute[74630]:     </interface>
Oct 26 03:23:25 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:23:25 user nova-compute[74630]:       <mac address="fa:16:3e:b0:a9:f6"/>
Oct 26 03:23:25 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:23:25 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:23:25 user nova-compute[74630]:       <target dev="tap209ed9aa-b6"/>
Oct 26 03:23:25 user nova-compute[74630]:     </interface>
Oct 26 03:23:25 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:23:25 user nova-compute[74630]:       <mac address="fa:16:3e:ad:f4:1d"/>
Oct 26 03:23:25 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:23:25 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:23:25 user nova-compute[74630]:       <target dev="tap812b7cf9-19"/>
Oct 26 03:23:25 user nova-compute[74630]:     </interface>
Oct 26 03:23:25 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:23:25 user nova-compute[74630]:       <mac address="fa:16:3e:94:57:f1"/>
Oct 26 03:23:25 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:23:25 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:23:25 user nova-compute[74630]:       <target dev="tapd03b6f6f-4e"/>
Oct 26 03:23:25 user nova-compute[74630]:     </interface>
Oct 26 03:23:25 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:23:25 user nova-compute[74630]:       <mac address="fa:16:3e:b9:da:9b"/>
Oct 26 03:23:25 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:23:25 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:23:25 user nova-compute[74630]:       <target dev="tap07b88a64-c3"/>
Oct 26 03:23:25 user nova-compute[74630]:     </interface>
Oct 26 03:23:25 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:23:25 user nova-compute[74630]:       <mac address="fa:16:3e:0a:93:81"/>
Oct 26 03:23:25 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:23:25 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:23:25 user nova-compute[74630]:       <target dev="tapd6756804-11"/>
Oct 26 03:23:25 user nova-compute[74630]:     </interface>
Oct 26 03:23:25 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:23:25 user nova-compute[74630]:       <mac address="fa:16:3e:cb:c8:46"/>
Oct 26 03:23:25 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:23:25 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:23:25 user nova-compute[74630]:       <target dev="tapff80c83f-f6"/>
Oct 26 03:23:25 user nova-compute[74630]:     </interface>
Oct 26 03:23:25 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:23:25 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/2d851c9c-c56c-4be0-ac59-ea59ea9304c2/console.log" append="off"/>
Oct 26 03:23:25 user nova-compute[74630]:     </serial>
Oct 26 03:23:25 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:23:25 user nova-compute[74630]:     <video>
Oct 26 03:23:25 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:23:25 user nova-compute[74630]:     </video>
Oct 26 03:23:25 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:23:25 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:23:25 user nova-compute[74630]:     </rng>
Oct 26 03:23:25 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:23:25 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:23:25 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:23:25 user nova-compute[74630]:     </memballoon>
Oct 26 03:23:25 user nova-compute[74630]:   </devices>
Oct 26 03:23:25 user nova-compute[74630]: </domain>
Oct 26 03:23:25 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf5f9227-19d4-480f-bdda-d8d839b63030", "address": "fa:16:3e:99:96:bd", "network": {"id": "dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1333134059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5f9227-19", "ovs_interfaceid": "bf5f9227-19d4-480f-bdda-d8d839b63030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "bf5f9227-19d4-480f-bdda-d8d839b63030", "address": "fa:16:3e:99:96:bd", "network": {"id": "dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1333134059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5f9227-19", "ovs_interfaceid": "bf5f9227-19d4-480f-bdda-d8d839b63030", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:96:bd,bridge_name='br-int',has_traffic_filtering=True,id=bf5f9227-19d4-480f-bdda-d8d839b63030,network=Network(dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5f9227-19') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG os_vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:96:bd,bridge_name='br-int',has_traffic_filtering=True,id=bf5f9227-19d4-480f-bdda-d8d839b63030,network=Network(dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5f9227-19') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2646ae9-54d8-5831-9752-a1e0aec3ea5c', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf5f9227-19, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf5f9227-19, col_values=(('qos', UUID('5f329360-0298-4836-86d3-b9bc8968f03c')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf5f9227-19, col_values=(('external_ids', {'iface-id': 'bf5f9227-19d4-480f-bdda-d8d839b63030', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:96:bd', 'vm-uuid': '2d851c9c-c56c-4be0-ac59-ea59ea9304c2'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: INFO os_vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:96:bd,bridge_name='br-int',has_traffic_filtering=True,id=bf5f9227-19d4-480f-bdda-d8d839b63030,network=Network(dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5f9227-19')
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "address": "fa:16:3e:b0:a9:f6", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ed9aa-b6", "ovs_interfaceid": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "address": "fa:16:3e:b0:a9:f6", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ed9aa-b6", "ovs_interfaceid": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a9:f6,bridge_name='br-int',has_traffic_filtering=True,id=209ed9aa-b6ea-4103-8231-7f6380f5d187,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap209ed9aa-b6') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG os_vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a9:f6,bridge_name='br-int',has_traffic_filtering=True,id=209ed9aa-b6ea-4103-8231-7f6380f5d187,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap209ed9aa-b6') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cabac61-0658-53d4-b434-15f336996ce0', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap209ed9aa-b6, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap209ed9aa-b6, col_values=(('qos', UUID('e151a978-ac42-4ea8-bdce-381fedc81e1f')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap209ed9aa-b6, col_values=(('external_ids', {'iface-id': '209ed9aa-b6ea-4103-8231-7f6380f5d187', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:a9:f6', 'vm-uuid': '2d851c9c-c56c-4be0-ac59-ea59ea9304c2'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: INFO os_vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a9:f6,bridge_name='br-int',has_traffic_filtering=True,id=209ed9aa-b6ea-4103-8231-7f6380f5d187,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap209ed9aa-b6')
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "address": "fa:16:3e:ad:f4:1d", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap812b7cf9-19", "ovs_interfaceid": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "address": "fa:16:3e:ad:f4:1d", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap812b7cf9-19", "ovs_interfaceid": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f4:1d,bridge_name='br-int',has_traffic_filtering=True,id=812b7cf9-199e-458a-93f5-3a73dfe4a05a,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap812b7cf9-19') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG os_vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f4:1d,bridge_name='br-int',has_traffic_filtering=True,id=812b7cf9-199e-458a-93f5-3a73dfe4a05a,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap812b7cf9-19') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2980a30c-f5da-5854-ba7c-8975e3b25126', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap812b7cf9-19, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap812b7cf9-19, col_values=(('qos', UUID('67c8b6fe-9bcd-4f7d-8789-e62bc042eb7b')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap812b7cf9-19, col_values=(('external_ids', {'iface-id': '812b7cf9-199e-458a-93f5-3a73dfe4a05a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:f4:1d', 'vm-uuid': '2d851c9c-c56c-4be0-ac59-ea59ea9304c2'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: INFO os_vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f4:1d,bridge_name='br-int',has_traffic_filtering=True,id=812b7cf9-199e-458a-93f5-3a73dfe4a05a,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap812b7cf9-19')
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "address": "fa:16:3e:94:57:f1", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03b6f6f-4e", "ovs_interfaceid": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "address": "fa:16:3e:94:57:f1", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03b6f6f-4e", "ovs_interfaceid": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:57:f1,bridge_name='br-int',has_traffic_filtering=True,id=d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03b6f6f-4e') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG os_vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:57:f1,bridge_name='br-int',has_traffic_filtering=True,id=d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03b6f6f-4e') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97807ee8-c42e-5dec-bd2a-0ee5fca11861', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd03b6f6f-4e, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd03b6f6f-4e, col_values=(('qos', UUID('d682eec4-7d82-41ac-9424-afeacdac63a2')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd03b6f6f-4e, col_values=(('external_ids', {'iface-id': 'd03b6f6f-4ee5-4759-ad3b-aca2d8256dd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:57:f1', 'vm-uuid': '2d851c9c-c56c-4be0-ac59-ea59ea9304c2'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: INFO os_vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:57:f1,bridge_name='br-int',has_traffic_filtering=True,id=d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03b6f6f-4e')
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "address": "fa:16:3e:b9:da:9b", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b88a64-c3", "ovs_interfaceid": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "address": "fa:16:3e:b9:da:9b", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b88a64-c3", "ovs_interfaceid": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:da:9b,bridge_name='br-int',has_traffic_filtering=True,id=07b88a64-c3ce-41e1-a8c5-9a394f06f0a6,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b88a64-c3') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG os_vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:da:9b,bridge_name='br-int',has_traffic_filtering=True,id=07b88a64-c3ce-41e1-a8c5-9a394f06f0a6,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b88a64-c3') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd292c439-fd85-59f0-a7a6-715ab46caa93', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07b88a64-c3, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07b88a64-c3, col_values=(('qos', UUID('02e2247c-4045-45ff-b455-46f605ecc137')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07b88a64-c3, col_values=(('external_ids', {'iface-id': '07b88a64-c3ce-41e1-a8c5-9a394f06f0a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:da:9b', 'vm-uuid': '2d851c9c-c56c-4be0-ac59-ea59ea9304c2'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: INFO os_vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:da:9b,bridge_name='br-int',has_traffic_filtering=True,id=07b88a64-c3ce-41e1-a8c5-9a394f06f0a6,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b88a64-c3')
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6756804-11a1-42a7-a432-bd0829d6dea0", "address": "fa:16:3e:0a:93:81", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6756804-11", "ovs_interfaceid": "d6756804-11a1-42a7-a432-bd0829d6dea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "d6756804-11a1-42a7-a432-bd0829d6dea0", "address": "fa:16:3e:0a:93:81", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6756804-11", "ovs_interfaceid": "d6756804-11a1-42a7-a432-bd0829d6dea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:93:81,bridge_name='br-int',has_traffic_filtering=True,id=d6756804-11a1-42a7-a432-bd0829d6dea0,network=Network(d0787d74-357e-438a-9f2c-5246827263ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6756804-11') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG os_vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:93:81,bridge_name='br-int',has_traffic_filtering=True,id=d6756804-11a1-42a7-a432-bd0829d6dea0,network=Network(d0787d74-357e-438a-9f2c-5246827263ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6756804-11') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ccb0cbf-b043-5e93-9dfc-0f1748c340e6', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6756804-11, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6756804-11, col_values=(('qos', UUID('229a6a7f-7b66-4b94-b767-a90dbe12a7e9')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6756804-11, col_values=(('external_ids', {'iface-id': 'd6756804-11a1-42a7-a432-bd0829d6dea0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:93:81', 'vm-uuid': '2d851c9c-c56c-4be0-ac59-ea59ea9304c2'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: INFO os_vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:93:81,bridge_name='br-int',has_traffic_filtering=True,id=d6756804-11a1-42a7-a432-bd0829d6dea0,network=Network(d0787d74-357e-438a-9f2c-5246827263ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6756804-11')
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:21:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "address": "fa:16:3e:cb:c8:46", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff80c83f-f6", "ovs_interfaceid": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "address": "fa:16:3e:cb:c8:46", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff80c83f-f6", "ovs_interfaceid": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c8:46,bridge_name='br-int',has_traffic_filtering=True,id=ff80c83f-f62c-4f70-a9ca-add8c4a366fd,network=Network(d0787d74-357e-438a-9f2c-5246827263ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff80c83f-f6') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG os_vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c8:46,bridge_name='br-int',has_traffic_filtering=True,id=ff80c83f-f62c-4f70-a9ca-add8c4a366fd,network=Network(d0787d74-357e-438a-9f2c-5246827263ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff80c83f-f6') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4561f92f-d4f7-5d4e-a000-1774f51a699f', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff80c83f-f6, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff80c83f-f6, col_values=(('qos', UUID('f8f60c64-20e4-490c-ade1-e5335fcfc03c')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff80c83f-f6, col_values=(('external_ids', {'iface-id': 'ff80c83f-f62c-4f70-a9ca-add8c4a366fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:c8:46', 'vm-uuid': '2d851c9c-c56c-4be0-ac59-ea59ea9304c2'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:25 user nova-compute[74630]: INFO os_vif [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c8:46,bridge_name='br-int',has_traffic_filtering=True,id=ff80c83f-f62c-4f70-a9ca-add8c4a366fd,network=Network(d0787d74-357e-438a-9f2c-5246827263ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff80c83f-f6')
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] No BDM found with device name hda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] No VIF found with MAC fa:16:3e:99:96:bd, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:23:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] No VIF found with MAC fa:16:3e:b9:da:9b, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:23:25 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Using config drive
Oct 26 03:23:26 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Creating config drive at /opt/stack/data/nova/instances/2d851c9c-c56c-4be0-ac59-ea59ea9304c2/disk.config
Oct 26 03:23:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2d851c9c-c56c-4be0-ac59-ea59ea9304c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwhet2vpi {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2d851c9c-c56c-4be0-ac59-ea59ea9304c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwhet2vpi" returned: 0 in 0.065s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-75dd5594-4afe-4389-9234-0024b32e19c8 req-ca98c9a2-9143-4d60-af63-caee68d10129 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-bf5f9227-19d4-480f-bdda-d8d839b63030 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-75dd5594-4afe-4389-9234-0024b32e19c8 req-ca98c9a2-9143-4d60-af63-caee68d10129 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-75dd5594-4afe-4389-9234-0024b32e19c8 req-ca98c9a2-9143-4d60-af63-caee68d10129 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-75dd5594-4afe-4389-9234-0024b32e19c8 req-ca98c9a2-9143-4d60-af63-caee68d10129 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-75dd5594-4afe-4389-9234-0024b32e19c8 req-ca98c9a2-9143-4d60-af63-caee68d10129 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-bf5f9227-19d4-480f-bdda-d8d839b63030 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:27 user nova-compute[74630]: WARNING nova.compute.manager [req-75dd5594-4afe-4389-9234-0024b32e19c8 req-ca98c9a2-9143-4d60-af63-caee68d10129 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-bf5f9227-19d4-480f-bdda-d8d839b63030 for instance with vm_state building and task_state spawning.
Oct 26 03:23:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-6a130ea8-362c-4209-b6a6-293d5bbb9dce req-349b374e-82a9-42c7-9f8e-7a5d78bcd3ff service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-209ed9aa-b6ea-4103-8231-7f6380f5d187 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6a130ea8-362c-4209-b6a6-293d5bbb9dce req-349b374e-82a9-42c7-9f8e-7a5d78bcd3ff service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6a130ea8-362c-4209-b6a6-293d5bbb9dce req-349b374e-82a9-42c7-9f8e-7a5d78bcd3ff service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6a130ea8-362c-4209-b6a6-293d5bbb9dce req-349b374e-82a9-42c7-9f8e-7a5d78bcd3ff service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-6a130ea8-362c-4209-b6a6-293d5bbb9dce req-349b374e-82a9-42c7-9f8e-7a5d78bcd3ff service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-209ed9aa-b6ea-4103-8231-7f6380f5d187 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:28 user nova-compute[74630]: WARNING nova.compute.manager [req-6a130ea8-362c-4209-b6a6-293d5bbb9dce req-349b374e-82a9-42c7-9f8e-7a5d78bcd3ff service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-209ed9aa-b6ea-4103-8231-7f6380f5d187 for instance with vm_state building and task_state spawning.
Oct 26 03:23:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-2d20128e-591c-4dad-a681-36f07bc2bd68 req-913c7191-7de8-4882-bdd8-29635dd6f6a2 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2d20128e-591c-4dad-a681-36f07bc2bd68 req-913c7191-7de8-4882-bdd8-29635dd6f6a2 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2d20128e-591c-4dad-a681-36f07bc2bd68 req-913c7191-7de8-4882-bdd8-29635dd6f6a2 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2d20128e-591c-4dad-a681-36f07bc2bd68 req-913c7191-7de8-4882-bdd8-29635dd6f6a2 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-2d20128e-591c-4dad-a681-36f07bc2bd68 req-913c7191-7de8-4882-bdd8-29635dd6f6a2 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:29 user nova-compute[74630]: WARNING nova.compute.manager [req-2d20128e-591c-4dad-a681-36f07bc2bd68 req-913c7191-7de8-4882-bdd8-29635dd6f6a2 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 for instance with vm_state building and task_state spawning.
Oct 26 03:23:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-bf5f9227-19d4-480f-bdda-d8d839b63030 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-bf5f9227-19d4-480f-bdda-d8d839b63030 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:29 user nova-compute[74630]: WARNING nova.compute.manager [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-bf5f9227-19d4-480f-bdda-d8d839b63030 for instance with vm_state building and task_state spawning.
Oct 26 03:23:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:30 user nova-compute[74630]: WARNING nova.compute.manager [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 for instance with vm_state building and task_state spawning.
Oct 26 03:23:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:30 user nova-compute[74630]: WARNING nova.compute.manager [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 for instance with vm_state building and task_state spawning.
Oct 26 03:23:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-d6756804-11a1-42a7-a432-bd0829d6dea0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-d6756804-11a1-42a7-a432-bd0829d6dea0 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:30 user nova-compute[74630]: WARNING nova.compute.manager [req-0920e90b-f833-486d-b316-d982567b2e96 req-9ef39ed9-f90f-4899-a23c-570f025d81f7 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-d6756804-11a1-42a7-a432-bd0829d6dea0 for instance with vm_state building and task_state spawning.
Oct 26 03:23:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-209ed9aa-b6ea-4103-8231-7f6380f5d187 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-209ed9aa-b6ea-4103-8231-7f6380f5d187 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:30 user nova-compute[74630]: WARNING nova.compute.manager [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-209ed9aa-b6ea-4103-8231-7f6380f5d187 for instance with vm_state building and task_state spawning.
Oct 26 03:23:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-812b7cf9-199e-458a-93f5-3a73dfe4a05a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-812b7cf9-199e-458a-93f5-3a73dfe4a05a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:30 user nova-compute[74630]: WARNING nova.compute.manager [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-812b7cf9-199e-458a-93f5-3a73dfe4a05a for instance with vm_state building and task_state spawning.
Oct 26 03:23:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-812b7cf9-199e-458a-93f5-3a73dfe4a05a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-812b7cf9-199e-458a-93f5-3a73dfe4a05a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:30 user nova-compute[74630]: WARNING nova.compute.manager [req-e074fb4d-9778-479a-9ae0-d2a02af06de2 req-2d9f28f2-443d-414d-a17d-a60c8a5114f6 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-812b7cf9-199e-458a-93f5-3a73dfe4a05a for instance with vm_state building and task_state spawning.
Oct 26 03:23:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-7bdc96e3-e46e-4b57-ad63-260e63b87e42 req-41092f4f-f98c-4893-acda-136d1a4e8c8f service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7bdc96e3-e46e-4b57-ad63-260e63b87e42 req-41092f4f-f98c-4893-acda-136d1a4e8c8f service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7bdc96e3-e46e-4b57-ad63-260e63b87e42 req-41092f4f-f98c-4893-acda-136d1a4e8c8f service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7bdc96e3-e46e-4b57-ad63-260e63b87e42 req-41092f4f-f98c-4893-acda-136d1a4e8c8f service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-7bdc96e3-e46e-4b57-ad63-260e63b87e42 req-41092f4f-f98c-4893-acda-136d1a4e8c8f service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:31 user nova-compute[74630]: WARNING nova.compute.manager [req-7bdc96e3-e46e-4b57-ad63-260e63b87e42 req-41092f4f-f98c-4893-acda-136d1a4e8c8f service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 for instance with vm_state building and task_state spawning.
Oct 26 03:23:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.compute.manager [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-d6756804-11a1-42a7-a432-bd0829d6dea0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.compute.manager [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-d6756804-11a1-42a7-a432-bd0829d6dea0 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:32 user nova-compute[74630]: WARNING nova.compute.manager [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-d6756804-11a1-42a7-a432-bd0829d6dea0 for instance with vm_state building and task_state spawning.
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.compute.manager [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-ff80c83f-f62c-4f70-a9ca-add8c4a366fd {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.compute.manager [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-ff80c83f-f62c-4f70-a9ca-add8c4a366fd {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:32 user nova-compute[74630]: WARNING nova.compute.manager [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-ff80c83f-f62c-4f70-a9ca-add8c4a366fd for instance with vm_state building and task_state spawning.
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.compute.manager [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-ff80c83f-f62c-4f70-a9ca-add8c4a366fd {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.compute.manager [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-ff80c83f-f62c-4f70-a9ca-add8c4a366fd {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:32 user nova-compute[74630]: WARNING nova.compute.manager [req-9bba71ee-65ad-4f59-aacf-586b95a63f9b req-551e9f95-521c-4e72-8d09-d44b3d0452ef service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-ff80c83f-f62c-4f70-a9ca-add8c4a366fd for instance with vm_state building and task_state spawning.
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:23:32 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Instance spawned successfully.
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:23:32 user nova-compute[74630]: INFO nova.compute.manager [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Took 11.46 seconds to spawn the instance on the hypervisor.
Oct 26 03:23:32 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:23:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:32 user nova-compute[74630]: INFO nova.compute.manager [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Took 97.85 seconds to build instance.
Oct 26 03:23:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b0385394-3bc3-4579-a14a-4c02f4db0622 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 97.953s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVJAbTQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:23:39 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:39 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:39 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[478fde08-43d3-4a03-a000-228c3f47a15f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:23:39 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec9812f-cb11-422d-9bce-109cd1e07d92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a] added
Oct 26 03:23:39 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec111b6-2858-4180-aede-165c2e9472ff]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db685d5-fc7c-4da6-80f9-b729dd0ac1c2]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kVJAbTQl {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kVJAbTQl" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ea34d9-76fa-4102-8603-cfc4005d11b8]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kVJAbTQl'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5020ccb-9be7-40bd-a6a1-d597a5bc2ff9]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fa009d-f128-45c4-8903-5dfdb807568b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[688416b5-10ef-4aaf-b58b-99dd10fe06d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a, portal: 172.16.0.220,3260]
Oct 26 03:23:39 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a, portal: 172.16.0.220,3260] successful.
Oct 26 03:23:39 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5125ea-213c-4cf1-9d83-7e1b06271fff]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3fe6a5-e642-486b-809d-afc87444913d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)
Oct 26 03:23:39 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:39 user nova-compute[74630]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)
Oct 26 03:23:39 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[236c7bb7-95ac-4169-83c4-d83c23ce9c4b]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:39 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVJAbTQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23264633066623932', 'path': '/dev/sdh'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264633066623932', 'path': '/dev/sdh'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG nova.objects.instance [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lazy-loading 'flavor' on Instance uuid bb93fd61-5432-44d2-86c4-b4cdccc0e1c5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:23:40 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:23:40 user nova-compute[74630]:   <source dev="/dev/sdh"/>
Oct 26 03:23:40 user nova-compute[74630]:   <target dev="sdc" bus="scsi"/>
Oct 26 03:23:40 user nova-compute[74630]:   <serial>3292f489-a6c3-45a4-976c-7bf35239477a</serial>
Oct 26 03:23:40 user nova-compute[74630]:   <address type="drive" controller="0" unit="2"/>
Oct 26 03:23:40 user nova-compute[74630]: </disk>
Oct 26 03:23:40 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:23:40 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d1591088-0892-4aa5-b7ea-3addb083bc69 is timed out.
Oct 26 03:23:40 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Successfully detached device vdb from instance d1591088-0892-4aa5-b7ea-3addb083bc69 from the live domain config.
Oct 26 03:23:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGVtqDfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:23:40 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f7edf2-6665-4b69-ae41-70e56b8efbf9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:23:40 user nova-compute[74630]: No targets found.
Oct 26 03:23:40 user nova-compute[74630]: iSNS:
Oct 26 03:23:40 user nova-compute[74630]: No targets found.
Oct 26 03:23:40 user nova-compute[74630]: STATIC:
Oct 26 03:23:40 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a
Oct 26 03:23:40 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:40 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:40 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417
Oct 26 03:23:40 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:40 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:40 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550
Oct 26 03:23:40 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:40 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:40 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8
Oct 26 03:23:40 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:40 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:40 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea
Oct 26 03:23:40 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:40 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:40 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1
Oct 26 03:23:40 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:40 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:40 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb
Oct 26 03:23:40 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:40 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:40 user nova-compute[74630]: FIRMWARE:
Oct 26 03:23:40 user nova-compute[74630]: No targets found.
Oct 26 03:23:40 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:23:40 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:23:40 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cc9769-19d3-4084-8466-2f13daa09f0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2d5126-8df0-486f-bff2-78a4bf85d133]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:40 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:40 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:40 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:40 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:40 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:40 user nova-compute[74630]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)
Oct 26 03:23:40 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 (non-flash)
Oct 26 03:23:40 user nova-compute[74630]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:40 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:40 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:40 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:40 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:40 user nova-compute[74630]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)
Oct 26 03:23:40 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3184625b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6528d202-1b59-45c9-b62b-eeb668c0afdb]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6216ec-c23d-4ed2-b128-81306a73ada7]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9429effe-960e-45da-96d3-8046e7616de3]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e534775-78b3-4b97-8795-00c338e585ff]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbb75f1-50eb-4c24-a032-b3f9c62277a1]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f310ee-f907-43a0-bd4d-e0a9392253e3]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8, portal: 172.16.0.220,3260]
Oct 26 03:23:40 user nova-compute[74630]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8, portal: 172.16.0.220,3260] successful.
Oct 26 03:23:40 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f70573-4b88-457a-b930-ee2f7247e6d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c250300-b282-429f-b8bf-b96680284207]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] <== disconnect_volume: return (360ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:23:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] No BDM found with device name sda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] No VIF found with MAC fa:16:3e:33:fc:53, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2d443a7d-04cf-48fc-bdf0-f03b6c2384f6 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.218s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:41 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 is timed out.
Oct 26 03:23:41 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Successfully detached device vdb from instance 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 from the live domain config.
Oct 26 03:23:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SNHcLmgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:23:41 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9454a137-ac3b-4973-8a94-c43850405367]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:23:41 user nova-compute[74630]: No targets found.
Oct 26 03:23:41 user nova-compute[74630]: iSNS:
Oct 26 03:23:41 user nova-compute[74630]: No targets found.
Oct 26 03:23:41 user nova-compute[74630]: STATIC:
Oct 26 03:23:41 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a
Oct 26 03:23:41 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:41 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:41 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417
Oct 26 03:23:41 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:41 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:41 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550
Oct 26 03:23:41 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:41 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:41 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea
Oct 26 03:23:41 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:41 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:41 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1
Oct 26 03:23:41 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:41 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:41 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb
Oct 26 03:23:41 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:41 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:41 user nova-compute[74630]: FIRMWARE:
Oct 26 03:23:41 user nova-compute[74630]: No targets found.
Oct 26 03:23:41 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:23:41 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:23:41 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b760010e-478d-4cbb-84e4-473cd5e3702e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dccc8ff-d328-4835-8f5d-b7173390e7e4]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:41 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:41 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:41 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:41 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:41 user nova-compute[74630]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)
Oct 26 03:23:41 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 (non-flash)
Oct 26 03:23:41 user nova-compute[74630]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:41 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:41 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:41 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:41 user nova-compute[74630]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)
Oct 26 03:23:41 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f318419acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1'): ({'sdd'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Removing single pathed devices sdd {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baea0d7-8ed8-4643-852c-cea9421d91f3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec64658-2e0f-4958-80dc-5bb71ca96ed5]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Flushing IO for device /dev/sdd {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c99693-de14-4fa6-b4d0-207e79743575]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[245820a7-aa0b-4d13-b4a8-016c39c3ad3c]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2edf845-7697-416a-b9f0-d679e34da3e7]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:41 user nova-compute[74630]: INFO nova.compute.manager [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Detaching volume 3292f489-a6c3-45a4-976c-7bf35239477a
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[631a0a9d-8e49-453d-90e4-fd3f4a516a3b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1, portal: 172.16.0.220,3260]
Oct 26 03:23:41 user nova-compute[74630]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1, portal: 172.16.0.220,3260] successful.
Oct 26 03:23:41 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392d2f7-d965-435c-9ba1-af9cd3e4c4f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[828d7a4b-75ef-4ef0-b0fd-786843a7c3aa]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] <== disconnect_volume: return (340ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:23:41 user nova-compute[74630]: INFO nova.virt.block_device [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Attempting to driver detach volume 3292f489-a6c3-45a4-976c-7bf35239477a from mountpoint /dev/sdc
Oct 26 03:23:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Attempting to detach device sdc from instance bb93fd61-5432-44d2-86c4-b4cdccc0e1c5 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:23:41 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:23:41 user nova-compute[74630]:   <source dev="/dev/sdh"/>
Oct 26 03:23:41 user nova-compute[74630]:   <target dev="sdc" bus="scsi"/>
Oct 26 03:23:41 user nova-compute[74630]:   <serial>3292f489-a6c3-45a4-976c-7bf35239477a</serial>
Oct 26 03:23:41 user nova-compute[74630]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 26 03:23:41 user nova-compute[74630]: </disk>
Oct 26 03:23:41 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:23:41 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Successfully detached device sdc from instance bb93fd61-5432-44d2-86c4-b4cdccc0e1c5 from the persistent domain config.
Oct 26 03:23:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance bb93fd61-5432-44d2-86c4-b4cdccc0e1c5 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:23:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:23:41 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:23:41 user nova-compute[74630]:   <source dev="/dev/sdh"/>
Oct 26 03:23:41 user nova-compute[74630]:   <target dev="sdc" bus="scsi"/>
Oct 26 03:23:41 user nova-compute[74630]:   <serial>3292f489-a6c3-45a4-976c-7bf35239477a</serial>
Oct 26 03:23:41 user nova-compute[74630]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 26 03:23:41 user nova-compute[74630]: </disk>
Oct 26 03:23:41 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG nova.objects.instance [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lazy-loading 'flavor' on Instance uuid d1591088-0892-4aa5-b7ea-3addb083bc69 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8bbe96c3-63c4-41c6-960a-be47a7e2e35a tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.823s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance bb93fd61-5432-44d2-86c4-b4cdccc0e1c5 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:23:42 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b is timed out.
Oct 26 03:23:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Successfully detached device vdb from instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b from the live domain config.
Oct 26 03:23:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzhKDspo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:23:42 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e84928-2139-4623-85f0-afd55d3cd10f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:23:42 user nova-compute[74630]: No targets found.
Oct 26 03:23:42 user nova-compute[74630]: iSNS:
Oct 26 03:23:42 user nova-compute[74630]: No targets found.
Oct 26 03:23:42 user nova-compute[74630]: STATIC:
Oct 26 03:23:42 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a
Oct 26 03:23:42 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:42 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:42 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417
Oct 26 03:23:42 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:42 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:42 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550
Oct 26 03:23:42 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:42 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:42 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea
Oct 26 03:23:42 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:42 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:42 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb
Oct 26 03:23:42 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:23:42 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:23:42 user nova-compute[74630]: FIRMWARE:
Oct 26 03:23:42 user nova-compute[74630]: No targets found.
Oct 26 03:23:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:23:42 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:23:42 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e27c0c-acbc-479d-9fe3-a1ae896c3413]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc896b05-df72-41c4-a36a-60b53c10cefe]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:42 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:42 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:42 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:42 user nova-compute[74630]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)
Oct 26 03:23:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb (non-flash)
Oct 26 03:23:42 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:42 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:42 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:42 user nova-compute[74630]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)
Oct 26 03:23:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f318429b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb'): ({'sde'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Removing single pathed devices sde {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd9d441-d397-433c-b115-3083006dcfee]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cd660a-5ae1-4a25-9afe-c9d016e60c01]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Flushing IO for device /dev/sde {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[082e5315-d9a5-41f0-ba22-9c01a2e329db]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebf389c-e69b-42cc-9e50-a930e7983d90]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] SCSI volumes sde have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e99f26-2474-4a95-b37c-1383bf212706]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[594056f4-3d6b-4c4b-b0c6-d3338242e978]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb, portal: 172.16.0.220,3260]
Oct 26 03:23:42 user nova-compute[74630]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb, portal: 172.16.0.220,3260] successful.
Oct 26 03:23:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0964ef04-4d52-41f6-98d4-60f12d843ebb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb93c293-0fd7-4832-8a05-c116fa594ce7]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] <== disconnect_volume: return (343ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG nova.objects.instance [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Lazy-loading 'flavor' on Instance uuid 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:23:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-771bdbc0-bdf9-49d3-992e-37523e75e233 tempest-VolumesAssistedSnapshotsTest-251329024 tempest-VolumesAssistedSnapshotsTest-251329024-project-admin] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.896s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:43 user nova-compute[74630]: DEBUG nova.objects.instance [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lazy-loading 'flavor' on Instance uuid 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:23:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-855d02df-8011-4870-96dc-880a10dcdf5e tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.889s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "interface-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-95c62802-d8c8-467d-a4c5-4a4192f1b1b1" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "interface-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-95c62802-d8c8-467d-a4c5-4a4192f1b1b1" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG nova.objects.instance [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lazy-loading 'flavor' on Instance uuid 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1573607150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1573607150',id=10,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZvVt6JBJwjHuYv5rzAu6BfJiTRPT7gKst00ewuSImGcEAgmFYYyJpfkfMTPoD2yUtdQjdpC1u2VHivVP4deD3aeXnWol8rB/ye8SYwl6D/y52fGTUBa9use//IRHEP+g==',key_name='tempest-keypair-1967708874',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:21:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ee5c011c90e43d7be5ae38812de10e0',ramdisk_id='',reservation_id='r-48ob7np6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-162967180',owner_user_name='tempest-TaggedAttachmentsTest-162967180-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad908828808542d88bf198ad10a67ce8',uuid=5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "address": "fa:16:3e:50:b9:f9", "network": {"id": "3609f436-64b7-4afa-b29f-6d35afcdc1be", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1237555728", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c62802-d8", "ovs_interfaceid": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Converting VIF {"id": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "address": "fa:16:3e:50:b9:f9", "network": {"id": "3609f436-64b7-4afa-b29f-6d35afcdc1be", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1237555728", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c62802-d8", "ovs_interfaceid": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:b9:f9,bridge_name='br-int',has_traffic_filtering=True,id=95c62802-d8c8-467d-a4c5-4a4192f1b1b1,network=Network(3609f436-64b7-4afa-b29f-6d35afcdc1be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c62802-d8') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:50:b9:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap95c62802-d8"/></interface> {{(pid=74630) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:50:b9:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap95c62802-d8"/></interface> {{(pid=74630) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Attempting to detach device tap95c62802-d8 from instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] detach device xml: <interface type="ethernet">
Oct 26 03:23:44 user nova-compute[74630]:   <mac address="fa:16:3e:50:b9:f9"/>
Oct 26 03:23:44 user nova-compute[74630]:   <model type="virtio"/>
Oct 26 03:23:44 user nova-compute[74630]:   <mtu size="1442"/>
Oct 26 03:23:44 user nova-compute[74630]:   <target dev="tap95c62802-d8"/>
Oct 26 03:23:44 user nova-compute[74630]: </interface>
Oct 26 03:23:44 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:50:b9:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap95c62802-d8"/></interface> {{(pid=74630) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:50:b9:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap95c62802-d8"/></interface>not found in domain: <domain type='kvm' id='10'>
Oct 26 03:23:44 user nova-compute[74630]:   <name>instance-0000000a</name>
Oct 26 03:23:44 user nova-compute[74630]:   <uuid>5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b</uuid>
Oct 26 03:23:44 user nova-compute[74630]:   <metadata>
Oct 26 03:23:44 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:23:44 user nova-compute[74630]:   <nova:package version="0.0.0"/>
Oct 26 03:23:44 user nova-compute[74630]:   <nova:name>tempest-device-tagging-server-1573607150</nova:name>
Oct 26 03:23:44 user nova-compute[74630]:   <nova:creationTime>2023-10-26 03:22:44</nova:creationTime>
Oct 26 03:23:44 user nova-compute[74630]:   <nova:flavor name="m1.tiny">
Oct 26 03:23:44 user nova-compute[74630]:     <nova:memory>512</nova:memory>
Oct 26 03:23:44 user nova-compute[74630]:     <nova:disk>1</nova:disk>
Oct 26 03:23:44 user nova-compute[74630]:     <nova:swap>0</nova:swap>
Oct 26 03:23:44 user nova-compute[74630]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:23:44 user nova-compute[74630]:     <nova:vcpus>1</nova:vcpus>
Oct 26 03:23:44 user nova-compute[74630]:   </nova:flavor>
Oct 26 03:23:44 user nova-compute[74630]:   <nova:owner>
Oct 26 03:23:44 user nova-compute[74630]:     <nova:user uuid="ad908828808542d88bf198ad10a67ce8">tempest-TaggedAttachmentsTest-162967180-project-member</nova:user>
Oct 26 03:23:44 user nova-compute[74630]:     <nova:project uuid="7ee5c011c90e43d7be5ae38812de10e0">tempest-TaggedAttachmentsTest-162967180</nova:project>
Oct 26 03:23:44 user nova-compute[74630]:   </nova:owner>
Oct 26 03:23:44 user nova-compute[74630]:   <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:23:44 user nova-compute[74630]:   <nova:ports>
Oct 26 03:23:44 user nova-compute[74630]:     <nova:port uuid="4fb62476-5cff-4ebe-a5fe-4990895d991d">
Oct 26 03:23:44 user nova-compute[74630]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 03:23:44 user nova-compute[74630]:     </nova:port>
Oct 26 03:23:44 user nova-compute[74630]:     <nova:port uuid="95c62802-d8c8-467d-a4c5-4a4192f1b1b1">
Oct 26 03:23:44 user nova-compute[74630]:       <nova:ip type="fixed" address="10.10.10.183" ipVersion="4"/>
Oct 26 03:23:44 user nova-compute[74630]:     </nova:port>
Oct 26 03:23:44 user nova-compute[74630]:   </nova:ports>
Oct 26 03:23:44 user nova-compute[74630]: </nova:instance>
Oct 26 03:23:44 user nova-compute[74630]:   </metadata>
Oct 26 03:23:44 user nova-compute[74630]:   <memory unit='KiB'>524288</memory>
Oct 26 03:23:44 user nova-compute[74630]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 03:23:44 user nova-compute[74630]:   <vcpu placement='static'>1</vcpu>
Oct 26 03:23:44 user nova-compute[74630]:   <resource>
Oct 26 03:23:44 user nova-compute[74630]:     <partition>/machine</partition>
Oct 26 03:23:44 user nova-compute[74630]:   </resource>
Oct 26 03:23:44 user nova-compute[74630]:   <sysinfo type='smbios'>
Oct 26 03:23:44 user nova-compute[74630]:     <system>
Oct 26 03:23:44 user nova-compute[74630]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 03:23:44 user nova-compute[74630]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 03:23:44 user nova-compute[74630]:       <entry name='version'>0.0.0</entry>
Oct 26 03:23:44 user nova-compute[74630]:       <entry name='serial'>5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b</entry>
Oct 26 03:23:44 user nova-compute[74630]:       <entry name='uuid'>5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b</entry>
Oct 26 03:23:44 user nova-compute[74630]:       <entry name='family'>Virtual Machine</entry>
Oct 26 03:23:44 user nova-compute[74630]:     </system>
Oct 26 03:23:44 user nova-compute[74630]:   </sysinfo>
Oct 26 03:23:44 user nova-compute[74630]:   <os>
Oct 26 03:23:44 user nova-compute[74630]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 03:23:44 user nova-compute[74630]:     <boot dev='hd'/>
Oct 26 03:23:44 user nova-compute[74630]:     <smbios mode='sysinfo'/>
Oct 26 03:23:44 user nova-compute[74630]:   </os>
Oct 26 03:23:44 user nova-compute[74630]:   <features>
Oct 26 03:23:44 user nova-compute[74630]:     <acpi/>
Oct 26 03:23:44 user nova-compute[74630]:     <apic/>
Oct 26 03:23:44 user nova-compute[74630]:     <vmcoreinfo state='on'/>
Oct 26 03:23:44 user nova-compute[74630]:   </features>
Oct 26 03:23:44 user nova-compute[74630]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 03:23:44 user nova-compute[74630]:     <model fallback='forbid'>Nehalem</model>
Oct 26 03:23:44 user nova-compute[74630]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 03:23:44 user nova-compute[74630]:     <feature policy='require' name='vme'/>
Oct 26 03:23:44 user nova-compute[74630]:     <feature policy='require' name='x2apic'/>
Oct 26 03:23:44 user nova-compute[74630]:     <feature policy='require' name='hypervisor'/>
Oct 26 03:23:44 user nova-compute[74630]:   </cpu>
Oct 26 03:23:44 user nova-compute[74630]:   <clock offset='utc'>
Oct 26 03:23:44 user nova-compute[74630]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 03:23:44 user nova-compute[74630]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 03:23:44 user nova-compute[74630]:     <timer name='hpet' present='no'/>
Oct 26 03:23:44 user nova-compute[74630]:   </clock>
Oct 26 03:23:44 user nova-compute[74630]:   <on_poweroff>destroy</on_poweroff>
Oct 26 03:23:44 user nova-compute[74630]:   <on_reboot>restart</on_reboot>
Oct 26 03:23:44 user nova-compute[74630]:   <on_crash>destroy</on_crash>
Oct 26 03:23:44 user nova-compute[74630]:   <devices>
Oct 26 03:23:44 user nova-compute[74630]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 03:23:44 user nova-compute[74630]:     <disk type='file' device='disk'>
Oct 26 03:23:44 user nova-compute[74630]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 03:23:44 user nova-compute[74630]:       <source file='/opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk' index='2'/>
Oct 26 03:23:44 user nova-compute[74630]:       <backingStore type='file' index='3'>
Oct 26 03:23:44 user nova-compute[74630]:         <format type='raw'/>
Oct 26 03:23:44 user nova-compute[74630]:         <source file='/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b'/>
Oct 26 03:23:44 user nova-compute[74630]:         <backingStore/>
Oct 26 03:23:44 user nova-compute[74630]:       </backingStore>
Oct 26 03:23:44 user nova-compute[74630]:       <target dev='vda' bus='virtio'/>
Oct 26 03:23:44 user nova-compute[74630]:       <alias name='virtio-disk0'/>
Oct 26 03:23:44 user nova-compute[74630]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 03:23:44 user nova-compute[74630]:     </disk>
Oct 26 03:23:44 user nova-compute[74630]:     <disk type='file' device='cdrom'>
Oct 26 03:23:44 user nova-compute[74630]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 03:23:44 user nova-compute[74630]:       <source file='/opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk.config' index='1'/>
Oct 26 03:23:44 user nova-compute[74630]:       <backingStore/>
Oct 26 03:23:44 user nova-compute[74630]:       <target dev='hda' bus='ide'/>
Oct 26 03:23:44 user nova-compute[74630]:       <readonly/>
Oct 26 03:23:44 user nova-compute[74630]:       <alias name='ide0-0-0'/>
Oct 26 03:23:44 user nova-compute[74630]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 03:23:44 user nova-compute[74630]:     </disk>
Oct 26 03:23:44 user nova-compute[74630]:     <controller type='usb' index='0' model='none'>
Oct 26 03:23:44 user nova-compute[74630]:       <alias name='usb'/>
Oct 26 03:23:44 user nova-compute[74630]:     </controller>
Oct 26 03:23:44 user nova-compute[74630]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 03:23:44 user nova-compute[74630]:       <alias name='pci.0'/>
Oct 26 03:23:44 user nova-compute[74630]:     </controller>
Oct 26 03:23:44 user nova-compute[74630]:     <controller type='ide' index='0'>
Oct 26 03:23:44 user nova-compute[74630]:       <alias name='ide'/>
Oct 26 03:23:44 user nova-compute[74630]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 03:23:44 user nova-compute[74630]:     </controller>
Oct 26 03:23:44 user nova-compute[74630]:     <interface type='ethernet'>
Oct 26 03:23:44 user nova-compute[74630]:       <mac address='fa:16:3e:0e:14:6d'/>
Oct 26 03:23:44 user nova-compute[74630]:       <target dev='tap4fb62476-5c'/>
Oct 26 03:23:44 user nova-compute[74630]:       <model type='virtio'/>
Oct 26 03:23:44 user nova-compute[74630]:       <mtu size='1442'/>
Oct 26 03:23:44 user nova-compute[74630]:       <alias name='net0'/>
Oct 26 03:23:44 user nova-compute[74630]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 03:23:44 user nova-compute[74630]:     </interface>
Oct 26 03:23:44 user nova-compute[74630]:     <interface type='ethernet'>
Oct 26 03:23:44 user nova-compute[74630]:       <mac address='fa:16:3e:50:b9:f9'/>
Oct 26 03:23:44 user nova-compute[74630]:       <target dev='tap95c62802-d8'/>
Oct 26 03:23:44 user nova-compute[74630]:       <model type='virtio'/>
Oct 26 03:23:44 user nova-compute[74630]:       <mtu size='1442'/>
Oct 26 03:23:44 user nova-compute[74630]:       <alias name='net1'/>
Oct 26 03:23:44 user nova-compute[74630]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 26 03:23:44 user nova-compute[74630]:     </interface>
Oct 26 03:23:44 user nova-compute[74630]:     <serial type='pty'>
Oct 26 03:23:44 user nova-compute[74630]:       <source path='/dev/pts/9'/>
Oct 26 03:23:44 user nova-compute[74630]:       <log file='/opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/console.log' append='off'/>
Oct 26 03:23:44 user nova-compute[74630]:       <target type='isa-serial' port='0'>
Oct 26 03:23:44 user nova-compute[74630]:         <model name='isa-serial'/>
Oct 26 03:23:44 user nova-compute[74630]:       </target>
Oct 26 03:23:44 user nova-compute[74630]:       <alias name='serial0'/>
Oct 26 03:23:44 user nova-compute[74630]:     </serial>
Oct 26 03:23:44 user nova-compute[74630]:     <console type='pty' tty='/dev/pts/9'>
Oct 26 03:23:44 user nova-compute[74630]:       <source path='/dev/pts/9'/>
Oct 26 03:23:44 user nova-compute[74630]:       <log file='/opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/console.log' append='off'/>
Oct 26 03:23:44 user nova-compute[74630]:       <target type='serial' port='0'/>
Oct 26 03:23:44 user nova-compute[74630]:       <alias name='serial0'/>
Oct 26 03:23:44 user nova-compute[74630]:     </console>
Oct 26 03:23:44 user nova-compute[74630]:     <input type='mouse' bus='ps2'>
Oct 26 03:23:44 user nova-compute[74630]:       <alias name='input0'/>
Oct 26 03:23:44 user nova-compute[74630]:     </input>
Oct 26 03:23:44 user nova-compute[74630]:     <input type='keyboard' bus='ps2'>
Oct 26 03:23:44 user nova-compute[74630]:       <alias name='input1'/>
Oct 26 03:23:44 user nova-compute[74630]:     </input>
Oct 26 03:23:44 user nova-compute[74630]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Oct 26 03:23:44 user nova-compute[74630]:       <listen type='address' address='0.0.0.0'/>
Oct 26 03:23:44 user nova-compute[74630]:     </graphics>
Oct 26 03:23:44 user nova-compute[74630]:     <audio id='1' type='none'/>
Oct 26 03:23:44 user nova-compute[74630]:     <video>
Oct 26 03:23:44 user nova-compute[74630]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 03:23:44 user nova-compute[74630]:       <alias name='video0'/>
Oct 26 03:23:44 user nova-compute[74630]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 03:23:44 user nova-compute[74630]:     </video>
Oct 26 03:23:44 user nova-compute[74630]:     <memballoon model='virtio'>
Oct 26 03:23:44 user nova-compute[74630]:       <stats period='10'/>
Oct 26 03:23:44 user nova-compute[74630]:       <alias name='balloon0'/>
Oct 26 03:23:44 user nova-compute[74630]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 03:23:44 user nova-compute[74630]:     </memballoon>
Oct 26 03:23:44 user nova-compute[74630]:     <rng model='virtio'>
Oct 26 03:23:44 user nova-compute[74630]:       <backend model='random'>/dev/urandom</backend>
Oct 26 03:23:44 user nova-compute[74630]:       <alias name='rng0'/>
Oct 26 03:23:44 user nova-compute[74630]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 03:23:44 user nova-compute[74630]:     </rng>
Oct 26 03:23:44 user nova-compute[74630]:   </devices>
Oct 26 03:23:44 user nova-compute[74630]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 03:23:44 user nova-compute[74630]:     <label>libvirt-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b</label>
Oct 26 03:23:44 user nova-compute[74630]:     <imagelabel>libvirt-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b</imagelabel>
Oct 26 03:23:44 user nova-compute[74630]:   </seclabel>
Oct 26 03:23:44 user nova-compute[74630]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 03:23:44 user nova-compute[74630]:     <label>+64055:+108</label>
Oct 26 03:23:44 user nova-compute[74630]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 03:23:44 user nova-compute[74630]:   </seclabel>
Oct 26 03:23:44 user nova-compute[74630]: </domain>
Oct 26 03:23:44 user nova-compute[74630]:  {{(pid=74630) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 03:23:44 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Successfully detached device tap95c62802-d8 from instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b from the persistent domain config.
Oct 26 03:23:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] (1/8): Attempting to detach device tap95c62802-d8 with device alias net1 from instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] detach device xml: <interface type="ethernet">
Oct 26 03:23:44 user nova-compute[74630]:   <mac address="fa:16:3e:50:b9:f9"/>
Oct 26 03:23:44 user nova-compute[74630]:   <model type="virtio"/>
Oct 26 03:23:44 user nova-compute[74630]:   <mtu size="1442"/>
Oct 26 03:23:44 user nova-compute[74630]:   <target dev="tap95c62802-d8"/>
Oct 26 03:23:44 user nova-compute[74630]: </interface>
Oct 26 03:23:44 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Start waiting for the detach event from libvirt for device tap95c62802-d8 with device alias net1 for instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-4830d2d1-744e-48e8-8b70-6862c34178d6 req-fe3ba1e1-dd50-4ed3-9ddd-67bdae525233 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received event network-vif-unplugged-95c62802-d8c8-467d-a4c5-4a4192f1b1b1 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4830d2d1-744e-48e8-8b70-6862c34178d6 req-fe3ba1e1-dd50-4ed3-9ddd-67bdae525233 service nova] Acquiring lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4830d2d1-744e-48e8-8b70-6862c34178d6 req-fe3ba1e1-dd50-4ed3-9ddd-67bdae525233 service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4830d2d1-744e-48e8-8b70-6862c34178d6 req-fe3ba1e1-dd50-4ed3-9ddd-67bdae525233 service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-4830d2d1-744e-48e8-8b70-6862c34178d6 req-fe3ba1e1-dd50-4ed3-9ddd-67bdae525233 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] No waiting events found dispatching network-vif-unplugged-95c62802-d8c8-467d-a4c5-4a4192f1b1b1 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:44 user nova-compute[74630]: WARNING nova.compute.manager [req-4830d2d1-744e-48e8-8b70-6862c34178d6 req-fe3ba1e1-dd50-4ed3-9ddd-67bdae525233 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received unexpected event network-vif-unplugged-95c62802-d8c8-467d-a4c5-4a4192f1b1b1 for instance with vm_state active and task_state None.
Oct 26 03:23:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.compute.manager [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:23:46 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Creating image(s)
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Ensure instance console log exists: /opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Start _get_guest_xml network_info=[{"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZSsQfDla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '40316e54-eee2-4072-b436-4c5bb31724a9', 'attached_at': '', 'detached_at': '', 'volume_id': '89dadf3d-bdf3-448e-9b5c-e2613cc0adee', 'serial': '89dadf3d-bdf3-448e-9b5c-e2613cc0adee'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'ba34519e-1b55-404b-b19f-2738c9b2f2fc', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:23:46 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:23:46 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZSsQfDla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:23:46 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:46 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:23:46 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcbedda-0659-4e50-b3bb-cf4b4954380c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:23:46 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a963c8a4-26ff-48ca-ad1d-5a8e865443cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee] added
Oct 26 03:23:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e9f430-50bc-41b6-88c1-fdf0b2c27a5f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[419d13cb-fff7-484e-955f-c6fa92d5322f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZSsQfDla {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZSsQfDla" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1edacf4-d187-4468-8319-6787775a614d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZSsQfDla'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc048313-ec29-4daa-80a5-7adec4f845c9]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4adb97-51ac-44d1-b75c-6ee4326245b3]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:46 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:46 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:46 user nova-compute[74630]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)
Oct 26 03:23:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:46 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:46 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:46 user nova-compute[74630]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)
Oct 26 03:23:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc80fd54-2922-4475-bfc2-09c3aedc5dad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee, portal: 172.16.0.220,3260]
Oct 26 03:23:46 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee, portal: 172.16.0.220,3260] successful.
Oct 26 03:23:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a48458-249f-44d4-bc73-cbfee11f1d9c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f59a32-5005-448a-99f9-341bae8e4864]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:23:46 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:46 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:46 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:46 user nova-compute[74630]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)
Oct 26 03:23:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:23:46 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:23:46 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:23:46 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:23:46 user nova-compute[74630]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)
Oct 26 03:23:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6220a4b7-e4a3-4e42-9875-09a34e803b86]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZSsQfDla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-ae875380-2eb7-4791-93b1-22939b38c256 req-13036c38-3875-4608-8a24-01b057fc8da5 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received event network-vif-plugged-95c62802-d8c8-467d-a4c5-4a4192f1b1b1 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ae875380-2eb7-4791-93b1-22939b38c256 req-13036c38-3875-4608-8a24-01b057fc8da5 service nova] Acquiring lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ae875380-2eb7-4791-93b1-22939b38c256 req-13036c38-3875-4608-8a24-01b057fc8da5 service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ae875380-2eb7-4791-93b1-22939b38c256 req-13036c38-3875-4608-8a24-01b057fc8da5 service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-ae875380-2eb7-4791-93b1-22939b38c256 req-13036c38-3875-4608-8a24-01b057fc8da5 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] No waiting events found dispatching network-vif-plugged-95c62802-d8c8-467d-a4c5-4a4192f1b1b1 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:46 user nova-compute[74630]: WARNING nova.compute.manager [req-ae875380-2eb7-4791-93b1-22939b38c256 req-13036c38-3875-4608-8a24-01b057fc8da5 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received unexpected event network-vif-plugged-95c62802-d8c8-467d-a4c5-4a4192f1b1b1 for instance with vm_state active and task_state None.
Oct 26 03:23:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26431363436373830', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431363436373830', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-158280684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-158280684',id=14,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e396316ddc243c594c29f5c434501cb',ramdisk_id='',reservation_id='r-wjqons9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:23:18Z,user_data=None,user_id='f8694c5db6e34f1e88595b55f8e5fe70',uuid=40316e54-eee2-4072-b436-4c5bb31724a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converting VIF {"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:fe:2f,bridge_name='br-int',has_traffic_filtering=True,id=09559581-1c5c-4bee-90ea-fb70ae613d86,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09559581-1c') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG nova.objects.instance [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'pci_devices' on Instance uuid 40316e54-eee2-4072-b436-4c5bb31724a9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:23:47 user nova-compute[74630]:   <uuid>40316e54-eee2-4072-b436-4c5bb31724a9</uuid>
Oct 26 03:23:47 user nova-compute[74630]:   <name>instance-0000000e</name>
Oct 26 03:23:47 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:23:47 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:23:47 user nova-compute[74630]:   <metadata>
Oct 26 03:23:47 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:23:47 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:23:47 user nova-compute[74630]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-158280684</nova:name>
Oct 26 03:23:47 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:23:46</nova:creationTime>
Oct 26 03:23:47 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:23:47 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:23:47 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:23:47 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:23:47 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:23:47 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:23:47 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:23:47 user nova-compute[74630]:       <nova:owner>
Oct 26 03:23:47 user nova-compute[74630]:         <nova:user uuid="f8694c5db6e34f1e88595b55f8e5fe70">tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member</nova:user>
Oct 26 03:23:47 user nova-compute[74630]:         <nova:project uuid="1e396316ddc243c594c29f5c434501cb">tempest-ServerBootFromVolumeStableRescueTest-1296515996</nova:project>
Oct 26 03:23:47 user nova-compute[74630]:       </nova:owner>
Oct 26 03:23:47 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:23:47 user nova-compute[74630]:       <nova:ports>
Oct 26 03:23:47 user nova-compute[74630]:         <nova:port uuid="09559581-1c5c-4bee-90ea-fb70ae613d86">
Oct 26 03:23:47 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 03:23:47 user nova-compute[74630]:         </nova:port>
Oct 26 03:23:47 user nova-compute[74630]:       </nova:ports>
Oct 26 03:23:47 user nova-compute[74630]:     </nova:instance>
Oct 26 03:23:47 user nova-compute[74630]:   </metadata>
Oct 26 03:23:47 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:23:47 user nova-compute[74630]:     <system>
Oct 26 03:23:47 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:23:47 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:23:47 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:23:47 user nova-compute[74630]:       <entry name="serial">40316e54-eee2-4072-b436-4c5bb31724a9</entry>
Oct 26 03:23:47 user nova-compute[74630]:       <entry name="uuid">40316e54-eee2-4072-b436-4c5bb31724a9</entry>
Oct 26 03:23:47 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:23:47 user nova-compute[74630]:     </system>
Oct 26 03:23:47 user nova-compute[74630]:   </sysinfo>
Oct 26 03:23:47 user nova-compute[74630]:   <os>
Oct 26 03:23:47 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:23:47 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:23:47 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:23:47 user nova-compute[74630]:   </os>
Oct 26 03:23:47 user nova-compute[74630]:   <features>
Oct 26 03:23:47 user nova-compute[74630]:     <acpi/>
Oct 26 03:23:47 user nova-compute[74630]:     <apic/>
Oct 26 03:23:47 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:23:47 user nova-compute[74630]:   </features>
Oct 26 03:23:47 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:23:47 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:23:47 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:23:47 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:23:47 user nova-compute[74630]:   </clock>
Oct 26 03:23:47 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:23:47 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:23:47 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:23:47 user nova-compute[74630]:   </cpu>
Oct 26 03:23:47 user nova-compute[74630]:   <devices>
Oct 26 03:23:47 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:23:47 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:23:47 user nova-compute[74630]:       <source dev="/dev/sdb"/>
Oct 26 03:23:47 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:23:47 user nova-compute[74630]:       <serial>89dadf3d-bdf3-448e-9b5c-e2613cc0adee</serial>
Oct 26 03:23:47 user nova-compute[74630]:     </disk>
Oct 26 03:23:47 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:23:47 user nova-compute[74630]:       <mac address="fa:16:3e:cb:fe:2f"/>
Oct 26 03:23:47 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:23:47 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:23:47 user nova-compute[74630]:       <target dev="tap09559581-1c"/>
Oct 26 03:23:47 user nova-compute[74630]:     </interface>
Oct 26 03:23:47 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:23:47 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/console.log" append="off"/>
Oct 26 03:23:47 user nova-compute[74630]:     </serial>
Oct 26 03:23:47 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:23:47 user nova-compute[74630]:     <video>
Oct 26 03:23:47 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:23:47 user nova-compute[74630]:     </video>
Oct 26 03:23:47 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:23:47 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:23:47 user nova-compute[74630]:     </rng>
Oct 26 03:23:47 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:23:47 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:23:47 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:23:47 user nova-compute[74630]:     </memballoon>
Oct 26 03:23:47 user nova-compute[74630]:   </devices>
Oct 26 03:23:47 user nova-compute[74630]: </domain>
Oct 26 03:23:47 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-158280684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-158280684',id=14,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e396316ddc243c594c29f5c434501cb',ramdisk_id='',reservation_id='r-wjqons9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:23:18Z,user_data=None,user_id='f8694c5db6e34f1e88595b55f8e5fe70',uuid=40316e54-eee2-4072-b436-4c5bb31724a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converting VIF {"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:fe:2f,bridge_name='br-int',has_traffic_filtering=True,id=09559581-1c5c-4bee-90ea-fb70ae613d86,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09559581-1c') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG os_vif [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:fe:2f,bridge_name='br-int',has_traffic_filtering=True,id=09559581-1c5c-4bee-90ea-fb70ae613d86,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09559581-1c') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcb60d15-4b73-5e7e-a4cf-e85e975371dd', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09559581-1c, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09559581-1c, col_values=(('qos', UUID('f52572e1-c27f-4990-8a51-6c88ad396954')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09559581-1c, col_values=(('external_ids', {'iface-id': '09559581-1c5c-4bee-90ea-fb70ae613d86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:fe:2f', 'vm-uuid': '40316e54-eee2-4072-b436-4c5bb31724a9'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:47 user nova-compute[74630]: INFO os_vif [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:fe:2f,bridge_name='br-int',has_traffic_filtering=True,id=09559581-1c5c-4bee-90ea-fb70ae613d86,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09559581-1c')
Oct 26 03:23:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:23:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] No VIF found with MAC fa:16:3e:cb:fe:2f, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:23:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-1502be21-56d4-4750-9e4a-2574e0b460c4 req-caa6aa4c-d482-4f3b-a9ba-7a72db9e12dd service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1502be21-56d4-4750-9e4a-2574e0b460c4 req-caa6aa4c-d482-4f3b-a9ba-7a72db9e12dd service nova] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1502be21-56d4-4750-9e4a-2574e0b460c4 req-caa6aa4c-d482-4f3b-a9ba-7a72db9e12dd service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1502be21-56d4-4750-9e4a-2574e0b460c4 req-caa6aa4c-d482-4f3b-a9ba-7a72db9e12dd service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-1502be21-56d4-4750-9e4a-2574e0b460c4 req-caa6aa4c-d482-4f3b-a9ba-7a72db9e12dd service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] No waiting events found dispatching network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:49 user nova-compute[74630]: WARNING nova.compute.manager [req-1502be21-56d4-4750-9e4a-2574e0b460c4 req-caa6aa4c-d482-4f3b-a9ba-7a72db9e12dd service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received unexpected event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 for instance with vm_state building and task_state spawning.
Oct 26 03:23:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-598178b3-c8b8-4b6e-b3b0-c682c76b2270 req-4c48a016-a413-4e6a-aeff-e9086d3a2eaa service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-598178b3-c8b8-4b6e-b3b0-c682c76b2270 req-4c48a016-a413-4e6a-aeff-e9086d3a2eaa service nova] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-598178b3-c8b8-4b6e-b3b0-c682c76b2270 req-4c48a016-a413-4e6a-aeff-e9086d3a2eaa service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-598178b3-c8b8-4b6e-b3b0-c682c76b2270 req-4c48a016-a413-4e6a-aeff-e9086d3a2eaa service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-598178b3-c8b8-4b6e-b3b0-c682c76b2270 req-4c48a016-a413-4e6a-aeff-e9086d3a2eaa service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] No waiting events found dispatching network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:51 user nova-compute[74630]: WARNING nova.compute.manager [req-598178b3-c8b8-4b6e-b3b0-c682c76b2270 req-4c48a016-a413-4e6a-aeff-e9086d3a2eaa service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received unexpected event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 for instance with vm_state building and task_state spawning.
Oct 26 03:23:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:23:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:23:51 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Instance spawned successfully.
Oct 26 03:23:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:23:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:23:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:23:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:23:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:23:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:23:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:23:51 user nova-compute[74630]: INFO nova.compute.manager [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Took 5.58 seconds to spawn the instance on the hypervisor.
Oct 26 03:23:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:23:51 user nova-compute[74630]: INFO nova.compute.manager [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Took 35.32 seconds to build instance.
Oct 26 03:23:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-17cc0e41-034d-449c-a28c-66aa3b3690d3 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "40316e54-eee2-4072-b436-4c5bb31724a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.453s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "b4b703bf-de53-4f1f-b94e-2c3048577d52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "b4b703bf-de53-4f1f-b94e-2c3048577d52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "b4b703bf-de53-4f1f-b94e-2c3048577d52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "b4b703bf-de53-4f1f-b94e-2c3048577d52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "b4b703bf-de53-4f1f-b94e-2c3048577d52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:58 user nova-compute[74630]: INFO nova.compute.manager [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Terminating instance
Oct 26 03:23:58 user nova-compute[74630]: DEBUG nova.compute.manager [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:23:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG nova.compute.manager [req-ffb2dd2c-a630-4f3b-93f1-a7b35d805a43 req-dc1a03db-4a05-436e-8aa7-00fd17cd76ae service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Received event network-vif-unplugged-441ac47b-e3f0-462e-b4f6-8752b0e98b5c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ffb2dd2c-a630-4f3b-93f1-a7b35d805a43 req-dc1a03db-4a05-436e-8aa7-00fd17cd76ae service nova] Acquiring lock "b4b703bf-de53-4f1f-b94e-2c3048577d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ffb2dd2c-a630-4f3b-93f1-a7b35d805a43 req-dc1a03db-4a05-436e-8aa7-00fd17cd76ae service nova] Lock "b4b703bf-de53-4f1f-b94e-2c3048577d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ffb2dd2c-a630-4f3b-93f1-a7b35d805a43 req-dc1a03db-4a05-436e-8aa7-00fd17cd76ae service nova] Lock "b4b703bf-de53-4f1f-b94e-2c3048577d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG nova.compute.manager [req-ffb2dd2c-a630-4f3b-93f1-a7b35d805a43 req-dc1a03db-4a05-436e-8aa7-00fd17cd76ae service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] No waiting events found dispatching network-vif-unplugged-441ac47b-e3f0-462e-b4f6-8752b0e98b5c {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG nova.compute.manager [req-ffb2dd2c-a630-4f3b-93f1-a7b35d805a43 req-dc1a03db-4a05-436e-8aa7-00fd17cd76ae service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Received event network-vif-unplugged-441ac47b-e3f0-462e-b4f6-8752b0e98b5c for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:59 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Instance destroyed successfully.
Oct 26 03:23:59 user nova-compute[74630]: DEBUG nova.objects.instance [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lazy-loading 'resources' on Instance uuid b4b703bf-de53-4f1f-b94e-2c3048577d52 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:22:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1727955185',display_name='tempest-ServersNegativeTestJSON-server-1727955185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1727955185',id=13,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb2fa2469fb44a7ea42666b7ba4eab31',ramdisk_id='',reservation_id='r-x07lf6v5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-939634393',owner_user_name='tempest-ServersNegativeTestJSON-939634393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:22:18Z,user_data=None,user_id='e3f70e566f1b46b8bd4131758921f49a',uuid=b4b703bf-de53-4f1f-b94e-2c3048577d52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "address": "fa:16:3e:d4:c9:3f", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441ac47b-e3", "ovs_interfaceid": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Converting VIF {"id": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "address": "fa:16:3e:d4:c9:3f", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap441ac47b-e3", "ovs_interfaceid": "441ac47b-e3f0-462e-b4f6-8752b0e98b5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c9:3f,bridge_name='br-int',has_traffic_filtering=True,id=441ac47b-e3f0-462e-b4f6-8752b0e98b5c,network=Network(0c987002-6658-42a0-afe5-c0d349e73477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441ac47b-e3') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG os_vif [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c9:3f,bridge_name='br-int',has_traffic_filtering=True,id=441ac47b-e3f0-462e-b4f6-8752b0e98b5c,network=Network(0c987002-6658-42a0-afe5-c0d349e73477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441ac47b-e3') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap441ac47b-e3, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fb70fff-bfb1-4fee-b7bd-e0dd105b2c11) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:23:59 user nova-compute[74630]: INFO os_vif [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:c9:3f,bridge_name='br-int',has_traffic_filtering=True,id=441ac47b-e3f0-462e-b4f6-8752b0e98b5c,network=Network(0c987002-6658-42a0-afe5-c0d349e73477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap441ac47b-e3')
Oct 26 03:23:59 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Deleting instance files /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52_del
Oct 26 03:23:59 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Deletion of /opt/stack/data/nova/instances/b4b703bf-de53-4f1f-b94e-2c3048577d52_del complete
Oct 26 03:23:59 user nova-compute[74630]: INFO nova.compute.manager [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 26 03:23:59 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:23:59 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:24:00 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:00 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Took 0.46 seconds to deallocate network for instance.
Oct 26 03:24:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:00 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:24:00 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:24:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:00 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Deleted allocations for instance b4b703bf-de53-4f1f-b94e-2c3048577d52
Oct 26 03:24:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-55ab767c-47a7-4d1f-884f-863c69b2b2b0 tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "b4b703bf-de53-4f1f-b94e-2c3048577d52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.947s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-4381561c-3690-4f05-a201-cff7c8b39a9b req-84905775-e165-4e9d-9677-d15e32ce0172 service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Received event network-vif-plugged-441ac47b-e3f0-462e-b4f6-8752b0e98b5c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4381561c-3690-4f05-a201-cff7c8b39a9b req-84905775-e165-4e9d-9677-d15e32ce0172 service nova] Acquiring lock "b4b703bf-de53-4f1f-b94e-2c3048577d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4381561c-3690-4f05-a201-cff7c8b39a9b req-84905775-e165-4e9d-9677-d15e32ce0172 service nova] Lock "b4b703bf-de53-4f1f-b94e-2c3048577d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4381561c-3690-4f05-a201-cff7c8b39a9b req-84905775-e165-4e9d-9677-d15e32ce0172 service nova] Lock "b4b703bf-de53-4f1f-b94e-2c3048577d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-4381561c-3690-4f05-a201-cff7c8b39a9b req-84905775-e165-4e9d-9677-d15e32ce0172 service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] No waiting events found dispatching network-vif-plugged-441ac47b-e3f0-462e-b4f6-8752b0e98b5c {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:01 user nova-compute[74630]: WARNING nova.compute.manager [req-4381561c-3690-4f05-a201-cff7c8b39a9b req-84905775-e165-4e9d-9677-d15e32ce0172 service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Received unexpected event network-vif-plugged-441ac47b-e3f0-462e-b4f6-8752b0e98b5c for instance with vm_state deleted and task_state None.
Oct 26 03:24:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-4381561c-3690-4f05-a201-cff7c8b39a9b req-84905775-e165-4e9d-9677-d15e32ce0172 service nova] [instance: b4b703bf-de53-4f1f-b94e-2c3048577d52] Received event network-vif-deleted-441ac47b-e3f0-462e-b4f6-8752b0e98b5c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:02 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance bb93fd61-5432-44d2-86c4-b4cdccc0e1c5 is timed out.
Oct 26 03:24:02 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Successfully detached device sdc from instance bb93fd61-5432-44d2-86c4-b4cdccc0e1c5 from the live domain config.
Oct 26 03:24:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVJAbTQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:24:02 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4975463-bcaa-470c-ba6d-9f696fbf78ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:24:02 user nova-compute[74630]: No targets found.
Oct 26 03:24:02 user nova-compute[74630]: iSNS:
Oct 26 03:24:02 user nova-compute[74630]: No targets found.
Oct 26 03:24:02 user nova-compute[74630]: STATIC:
Oct 26 03:24:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:24:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a
Oct 26 03:24:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417
Oct 26 03:24:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550
Oct 26 03:24:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea
Oct 26 03:24:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:02 user nova-compute[74630]: FIRMWARE:
Oct 26 03:24:02 user nova-compute[74630]: No targets found.
Oct 26 03:24:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:24:02 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:24:02 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5760a712-6c17-4001-8d51-a7c1c3c0cfec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d3869c-1a39-4624-a110-ec364d1194b5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:24:02 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:24:02 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:24:02 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:24:02 user nova-compute[74630]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)
Oct 26 03:24:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:24:02 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:24:02 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:24:02 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:24:02 user nova-compute[74630]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a (non-flash)
Oct 26 03:24:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f318464e5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a'): ({'sdh'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Removing single pathed devices sdh {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b77ae1f-491c-453e-9804-f3de1b16927a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c872f6c0-6145-455c-9c82-372d6716cfa0]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Flushing IO for device /dev/sdh {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98759c9-387e-47c7-80f8-908da5d9d3db]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.036s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7a65d7-65dc-4193-84ce-b4f1bf3eada3]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] SCSI volumes sdh have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa947968-abf1-49f6-b354-9f9c6e177d13]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e31e93c-7393-4c6d-b55f-0963582f1035]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a, portal: 172.16.0.220,3260]
Oct 26 03:24:02 user nova-compute[74630]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a, portal: 172.16.0.220,3260] successful.
Oct 26 03:24:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3292f489-a6c3-45a4-976c-7bf35239477a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[066c3e7e-3c71-4d1c-b76a-ec476c57e00e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] <== disconnect_volume: return (331ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:24:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:24:03 user nova-compute[74630]: DEBUG nova.objects.instance [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lazy-loading 'flavor' on Instance uuid bb93fd61-5432-44d2-86c4-b4cdccc0e1c5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:24:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6165abb2-2790-4226-b736-434d738b9a83 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.810s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:04 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Waiting for libvirt event about the detach of device tap95c62802-d8 with device alias net1 from instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b is timed out.
Oct 26 03:24:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:50:b9:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap95c62802-d8"/></interface> {{(pid=74630) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:50:b9:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap95c62802-d8"/></interface>not found in domain: <domain type='kvm' id='10'>
Oct 26 03:24:04 user nova-compute[74630]:   <name>instance-0000000a</name>
Oct 26 03:24:04 user nova-compute[74630]:   <uuid>5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b</uuid>
Oct 26 03:24:04 user nova-compute[74630]:   <metadata>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:24:04 user nova-compute[74630]:   <nova:package version="0.0.0"/>
Oct 26 03:24:04 user nova-compute[74630]:   <nova:name>tempest-device-tagging-server-1573607150</nova:name>
Oct 26 03:24:04 user nova-compute[74630]:   <nova:creationTime>2023-10-26 03:22:44</nova:creationTime>
Oct 26 03:24:04 user nova-compute[74630]:   <nova:flavor name="m1.tiny">
Oct 26 03:24:04 user nova-compute[74630]:     <nova:memory>512</nova:memory>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:disk>1</nova:disk>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:swap>0</nova:swap>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:vcpus>1</nova:vcpus>
Oct 26 03:24:04 user nova-compute[74630]:   </nova:flavor>
Oct 26 03:24:04 user nova-compute[74630]:   <nova:owner>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:user uuid="ad908828808542d88bf198ad10a67ce8">tempest-TaggedAttachmentsTest-162967180-project-member</nova:user>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:project uuid="7ee5c011c90e43d7be5ae38812de10e0">tempest-TaggedAttachmentsTest-162967180</nova:project>
Oct 26 03:24:04 user nova-compute[74630]:   </nova:owner>
Oct 26 03:24:04 user nova-compute[74630]:   <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:24:04 user nova-compute[74630]:   <nova:ports>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:port uuid="4fb62476-5cff-4ebe-a5fe-4990895d991d">
Oct 26 03:24:04 user nova-compute[74630]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 03:24:04 user nova-compute[74630]:     </nova:port>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:port uuid="95c62802-d8c8-467d-a4c5-4a4192f1b1b1">
Oct 26 03:24:04 user nova-compute[74630]:       <nova:ip type="fixed" address="10.10.10.183" ipVersion="4"/>
Oct 26 03:24:04 user nova-compute[74630]:     </nova:port>
Oct 26 03:24:04 user nova-compute[74630]:   </nova:ports>
Oct 26 03:24:04 user nova-compute[74630]: </nova:instance>
Oct 26 03:24:04 user nova-compute[74630]:   </metadata>
Oct 26 03:24:04 user nova-compute[74630]:   <memory unit='KiB'>524288</memory>
Oct 26 03:24:04 user nova-compute[74630]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 03:24:04 user nova-compute[74630]:   <vcpu placement='static'>1</vcpu>
Oct 26 03:24:04 user nova-compute[74630]:   <resource>
Oct 26 03:24:04 user nova-compute[74630]:     <partition>/machine</partition>
Oct 26 03:24:04 user nova-compute[74630]:   </resource>
Oct 26 03:24:04 user nova-compute[74630]:   <sysinfo type='smbios'>
Oct 26 03:24:04 user nova-compute[74630]:     <system>
Oct 26 03:24:04 user nova-compute[74630]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 03:24:04 user nova-compute[74630]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 03:24:04 user nova-compute[74630]:       <entry name='version'>0.0.0</entry>
Oct 26 03:24:04 user nova-compute[74630]:       <entry name='serial'>5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b</entry>
Oct 26 03:24:04 user nova-compute[74630]:       <entry name='uuid'>5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b</entry>
Oct 26 03:24:04 user nova-compute[74630]:       <entry name='family'>Virtual Machine</entry>
Oct 26 03:24:04 user nova-compute[74630]:     </system>
Oct 26 03:24:04 user nova-compute[74630]:   </sysinfo>
Oct 26 03:24:04 user nova-compute[74630]:   <os>
Oct 26 03:24:04 user nova-compute[74630]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 03:24:04 user nova-compute[74630]:     <boot dev='hd'/>
Oct 26 03:24:04 user nova-compute[74630]:     <smbios mode='sysinfo'/>
Oct 26 03:24:04 user nova-compute[74630]:   </os>
Oct 26 03:24:04 user nova-compute[74630]:   <features>
Oct 26 03:24:04 user nova-compute[74630]:     <acpi/>
Oct 26 03:24:04 user nova-compute[74630]:     <apic/>
Oct 26 03:24:04 user nova-compute[74630]:     <vmcoreinfo state='on'/>
Oct 26 03:24:04 user nova-compute[74630]:   </features>
Oct 26 03:24:04 user nova-compute[74630]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 03:24:04 user nova-compute[74630]:     <model fallback='forbid'>Nehalem</model>
Oct 26 03:24:04 user nova-compute[74630]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 03:24:04 user nova-compute[74630]:     <feature policy='require' name='vme'/>
Oct 26 03:24:04 user nova-compute[74630]:     <feature policy='require' name='x2apic'/>
Oct 26 03:24:04 user nova-compute[74630]:     <feature policy='require' name='hypervisor'/>
Oct 26 03:24:04 user nova-compute[74630]:   </cpu>
Oct 26 03:24:04 user nova-compute[74630]:   <clock offset='utc'>
Oct 26 03:24:04 user nova-compute[74630]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 03:24:04 user nova-compute[74630]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 03:24:04 user nova-compute[74630]:     <timer name='hpet' present='no'/>
Oct 26 03:24:04 user nova-compute[74630]:   </clock>
Oct 26 03:24:04 user nova-compute[74630]:   <on_poweroff>destroy</on_poweroff>
Oct 26 03:24:04 user nova-compute[74630]:   <on_reboot>restart</on_reboot>
Oct 26 03:24:04 user nova-compute[74630]:   <on_crash>destroy</on_crash>
Oct 26 03:24:04 user nova-compute[74630]:   <devices>
Oct 26 03:24:04 user nova-compute[74630]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 03:24:04 user nova-compute[74630]:     <disk type='file' device='disk'>
Oct 26 03:24:04 user nova-compute[74630]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 03:24:04 user nova-compute[74630]:       <source file='/opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk' index='2'/>
Oct 26 03:24:04 user nova-compute[74630]:       <backingStore type='file' index='3'>
Oct 26 03:24:04 user nova-compute[74630]:         <format type='raw'/>
Oct 26 03:24:04 user nova-compute[74630]:         <source file='/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b'/>
Oct 26 03:24:04 user nova-compute[74630]:         <backingStore/>
Oct 26 03:24:04 user nova-compute[74630]:       </backingStore>
Oct 26 03:24:04 user nova-compute[74630]:       <target dev='vda' bus='virtio'/>
Oct 26 03:24:04 user nova-compute[74630]:       <alias name='virtio-disk0'/>
Oct 26 03:24:04 user nova-compute[74630]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 03:24:04 user nova-compute[74630]:     </disk>
Oct 26 03:24:04 user nova-compute[74630]:     <disk type='file' device='cdrom'>
Oct 26 03:24:04 user nova-compute[74630]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 03:24:04 user nova-compute[74630]:       <source file='/opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk.config' index='1'/>
Oct 26 03:24:04 user nova-compute[74630]:       <backingStore/>
Oct 26 03:24:04 user nova-compute[74630]:       <target dev='hda' bus='ide'/>
Oct 26 03:24:04 user nova-compute[74630]:       <readonly/>
Oct 26 03:24:04 user nova-compute[74630]:       <alias name='ide0-0-0'/>
Oct 26 03:24:04 user nova-compute[74630]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 03:24:04 user nova-compute[74630]:     </disk>
Oct 26 03:24:04 user nova-compute[74630]:     <controller type='usb' index='0' model='none'>
Oct 26 03:24:04 user nova-compute[74630]:       <alias name='usb'/>
Oct 26 03:24:04 user nova-compute[74630]:     </controller>
Oct 26 03:24:04 user nova-compute[74630]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 03:24:04 user nova-compute[74630]:       <alias name='pci.0'/>
Oct 26 03:24:04 user nova-compute[74630]:     </controller>
Oct 26 03:24:04 user nova-compute[74630]:     <controller type='ide' index='0'>
Oct 26 03:24:04 user nova-compute[74630]:       <alias name='ide'/>
Oct 26 03:24:04 user nova-compute[74630]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 03:24:04 user nova-compute[74630]:     </controller>
Oct 26 03:24:04 user nova-compute[74630]:     <interface type='ethernet'>
Oct 26 03:24:04 user nova-compute[74630]:       <mac address='fa:16:3e:0e:14:6d'/>
Oct 26 03:24:04 user nova-compute[74630]:       <target dev='tap4fb62476-5c'/>
Oct 26 03:24:04 user nova-compute[74630]:       <model type='virtio'/>
Oct 26 03:24:04 user nova-compute[74630]:       <mtu size='1442'/>
Oct 26 03:24:04 user nova-compute[74630]:       <alias name='net0'/>
Oct 26 03:24:04 user nova-compute[74630]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 03:24:04 user nova-compute[74630]:     </interface>
Oct 26 03:24:04 user nova-compute[74630]:     <serial type='pty'>
Oct 26 03:24:04 user nova-compute[74630]:       <source path='/dev/pts/9'/>
Oct 26 03:24:04 user nova-compute[74630]:       <log file='/opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/console.log' append='off'/>
Oct 26 03:24:04 user nova-compute[74630]:       <target type='isa-serial' port='0'>
Oct 26 03:24:04 user nova-compute[74630]:         <model name='isa-serial'/>
Oct 26 03:24:04 user nova-compute[74630]:       </target>
Oct 26 03:24:04 user nova-compute[74630]:       <alias name='serial0'/>
Oct 26 03:24:04 user nova-compute[74630]:     </serial>
Oct 26 03:24:04 user nova-compute[74630]:     <console type='pty' tty='/dev/pts/9'>
Oct 26 03:24:04 user nova-compute[74630]:       <source path='/dev/pts/9'/>
Oct 26 03:24:04 user nova-compute[74630]:       <log file='/opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/console.log' append='off'/>
Oct 26 03:24:04 user nova-compute[74630]:       <target type='serial' port='0'/>
Oct 26 03:24:04 user nova-compute[74630]:       <alias name='serial0'/>
Oct 26 03:24:04 user nova-compute[74630]:     </console>
Oct 26 03:24:04 user nova-compute[74630]:     <input type='mouse' bus='ps2'>
Oct 26 03:24:04 user nova-compute[74630]:       <alias name='input0'/>
Oct 26 03:24:04 user nova-compute[74630]:     </input>
Oct 26 03:24:04 user nova-compute[74630]:     <input type='keyboard' bus='ps2'>
Oct 26 03:24:04 user nova-compute[74630]:       <alias name='input1'/>
Oct 26 03:24:04 user nova-compute[74630]:     </input>
Oct 26 03:24:04 user nova-compute[74630]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Oct 26 03:24:04 user nova-compute[74630]:       <listen type='address' address='0.0.0.0'/>
Oct 26 03:24:04 user nova-compute[74630]:     </graphics>
Oct 26 03:24:04 user nova-compute[74630]:     <audio id='1' type='none'/>
Oct 26 03:24:04 user nova-compute[74630]:     <video>
Oct 26 03:24:04 user nova-compute[74630]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 03:24:04 user nova-compute[74630]:       <alias name='video0'/>
Oct 26 03:24:04 user nova-compute[74630]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 03:24:04 user nova-compute[74630]:     </video>
Oct 26 03:24:04 user nova-compute[74630]:     <memballoon model='virtio'>
Oct 26 03:24:04 user nova-compute[74630]:       <stats period='10'/>
Oct 26 03:24:04 user nova-compute[74630]:       <alias name='balloon0'/>
Oct 26 03:24:04 user nova-compute[74630]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 03:24:04 user nova-compute[74630]:     </memballoon>
Oct 26 03:24:04 user nova-compute[74630]:     <rng model='virtio'>
Oct 26 03:24:04 user nova-compute[74630]:       <backend model='random'>/dev/urandom</backend>
Oct 26 03:24:04 user nova-compute[74630]:       <alias name='rng0'/>
Oct 26 03:24:04 user nova-compute[74630]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 03:24:04 user nova-compute[74630]:     </rng>
Oct 26 03:24:04 user nova-compute[74630]:   </devices>
Oct 26 03:24:04 user nova-compute[74630]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 03:24:04 user nova-compute[74630]:     <label>libvirt-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b</label>
Oct 26 03:24:04 user nova-compute[74630]:     <imagelabel>libvirt-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b</imagelabel>
Oct 26 03:24:04 user nova-compute[74630]:   </seclabel>
Oct 26 03:24:04 user nova-compute[74630]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 03:24:04 user nova-compute[74630]:     <label>+64055:+108</label>
Oct 26 03:24:04 user nova-compute[74630]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 03:24:04 user nova-compute[74630]:   </seclabel>
Oct 26 03:24:04 user nova-compute[74630]: </domain>
Oct 26 03:24:04 user nova-compute[74630]:  {{(pid=74630) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 03:24:04 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Successfully detached device tap95c62802-d8 from instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b from the live domain config.
Oct 26 03:24:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1573607150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1573607150',id=10,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZvVt6JBJwjHuYv5rzAu6BfJiTRPT7gKst00ewuSImGcEAgmFYYyJpfkfMTPoD2yUtdQjdpC1u2VHivVP4deD3aeXnWol8rB/ye8SYwl6D/y52fGTUBa9use//IRHEP+g==',key_name='tempest-keypair-1967708874',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:21:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ee5c011c90e43d7be5ae38812de10e0',ramdisk_id='',reservation_id='r-48ob7np6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-162967180',owner_user_name='tempest-TaggedAttachmentsTest-162967180-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad908828808542d88bf198ad10a67ce8',uuid=5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "address": "fa:16:3e:50:b9:f9", "network": {"id": "3609f436-64b7-4afa-b29f-6d35afcdc1be", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1237555728", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c62802-d8", "ovs_interfaceid": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Converting VIF {"id": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "address": "fa:16:3e:50:b9:f9", "network": {"id": "3609f436-64b7-4afa-b29f-6d35afcdc1be", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1237555728", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c62802-d8", "ovs_interfaceid": "95c62802-d8c8-467d-a4c5-4a4192f1b1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:b9:f9,bridge_name='br-int',has_traffic_filtering=True,id=95c62802-d8c8-467d-a4c5-4a4192f1b1b1,network=Network(3609f436-64b7-4afa-b29f-6d35afcdc1be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c62802-d8') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG os_vif [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:b9:f9,bridge_name='br-int',has_traffic_filtering=True,id=95c62802-d8c8-467d-a4c5-4a4192f1b1b1,network=Network(3609f436-64b7-4afa-b29f-6d35afcdc1be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c62802-d8') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95c62802-d8, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6b4a310-5830-4d2a-b3cd-033a25b7a965) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:04 user nova-compute[74630]: INFO os_vif [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:b9:f9,bridge_name='br-int',has_traffic_filtering=True,id=95c62802-d8c8-467d-a4c5-4a4192f1b1b1,network=Network(3609f436-64b7-4afa-b29f-6d35afcdc1be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c62802-d8')
Oct 26 03:24:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:24:04 user nova-compute[74630]:   <nova:package version="0.0.0"/>
Oct 26 03:24:04 user nova-compute[74630]:   <nova:name>tempest-device-tagging-server-1573607150</nova:name>
Oct 26 03:24:04 user nova-compute[74630]:   <nova:creationTime>2023-10-26 03:24:04</nova:creationTime>
Oct 26 03:24:04 user nova-compute[74630]:   <nova:flavor name="m1.tiny">
Oct 26 03:24:04 user nova-compute[74630]:     <nova:memory>512</nova:memory>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:disk>1</nova:disk>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:swap>0</nova:swap>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:vcpus>1</nova:vcpus>
Oct 26 03:24:04 user nova-compute[74630]:   </nova:flavor>
Oct 26 03:24:04 user nova-compute[74630]:   <nova:owner>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:user uuid="ad908828808542d88bf198ad10a67ce8">tempest-TaggedAttachmentsTest-162967180-project-member</nova:user>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:project uuid="7ee5c011c90e43d7be5ae38812de10e0">tempest-TaggedAttachmentsTest-162967180</nova:project>
Oct 26 03:24:04 user nova-compute[74630]:   </nova:owner>
Oct 26 03:24:04 user nova-compute[74630]:   <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:24:04 user nova-compute[74630]:   <nova:ports>
Oct 26 03:24:04 user nova-compute[74630]:     <nova:port uuid="4fb62476-5cff-4ebe-a5fe-4990895d991d">
Oct 26 03:24:04 user nova-compute[74630]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 03:24:04 user nova-compute[74630]:     </nova:port>
Oct 26 03:24:04 user nova-compute[74630]:   </nova:ports>
Oct 26 03:24:04 user nova-compute[74630]: </nova:instance>
Oct 26 03:24:04 user nova-compute[74630]:  {{(pid=74630) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:04 user nova-compute[74630]: INFO nova.compute.manager [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Terminating instance
Oct 26 03:24:04 user nova-compute[74630]: DEBUG nova.compute.manager [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-07be674c-e51e-4ab4-82bc-fbd22fcb2e0b req-be4b999f-85a7-4b0a-ba62-6940bba519f6 service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Received event network-vif-unplugged-94f2d964-4b95-4a4c-a7cb-94bd34132f52 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-07be674c-e51e-4ab4-82bc-fbd22fcb2e0b req-be4b999f-85a7-4b0a-ba62-6940bba519f6 service nova] Acquiring lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-07be674c-e51e-4ab4-82bc-fbd22fcb2e0b req-be4b999f-85a7-4b0a-ba62-6940bba519f6 service nova] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-07be674c-e51e-4ab4-82bc-fbd22fcb2e0b req-be4b999f-85a7-4b0a-ba62-6940bba519f6 service nova] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-07be674c-e51e-4ab4-82bc-fbd22fcb2e0b req-be4b999f-85a7-4b0a-ba62-6940bba519f6 service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] No waiting events found dispatching network-vif-unplugged-94f2d964-4b95-4a4c-a7cb-94bd34132f52 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-07be674c-e51e-4ab4-82bc-fbd22fcb2e0b req-be4b999f-85a7-4b0a-ba62-6940bba519f6 service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Received event network-vif-unplugged-94f2d964-4b95-4a4c-a7cb-94bd34132f52 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:24:05 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Instance destroyed successfully.
Oct 26 03:24:05 user nova-compute[74630]: DEBUG nova.objects.instance [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lazy-loading 'resources' on Instance uuid bb93fd61-5432-44d2-86c4-b4cdccc0e1c5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:20:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1330254384',display_name='tempest-AttachSCSIVolumeTestJSON-server-1330254384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1330254384',id=9,image_ref='32cb998b-d4bd-4b65-9e8d-9e901f3bbe2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZ2xOIGLzjX1FvphLBbMCFCZ3J6zR7Tafod2krG7wOHFkG4/w5lYXWROX6sNi+TClJG9Jr4iSZR8nZfTh0qt1J706GzmWtQSDhEfMAX+bJdkBkP7Fv8OAYCBFJ9QbJH0Q==',key_name='tempest-keypair-291388067',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:21:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7adc62ff197348a19e8870850be33852',ramdisk_id='',reservation_id='r-ywt50wef',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='32cb998b-d4bd-4b65-9e8d-9e901f3bbe2f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2142747077',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2142747077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bcf784e61b0b4817a21c59028aa3ac66',uuid=bb93fd61-5432-44d2-86c4-b4cdccc0e1c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "address": "fa:16:3e:33:fc:53", "network": {"id": "aa89e219-e3f2-4813-a9f8-d8d983c69cc9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1154204399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7adc62ff197348a19e8870850be33852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f2d964-4b", "ovs_interfaceid": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Converting VIF {"id": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "address": "fa:16:3e:33:fc:53", "network": {"id": "aa89e219-e3f2-4813-a9f8-d8d983c69cc9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1154204399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7adc62ff197348a19e8870850be33852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94f2d964-4b", "ovs_interfaceid": "94f2d964-4b95-4a4c-a7cb-94bd34132f52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:fc:53,bridge_name='br-int',has_traffic_filtering=True,id=94f2d964-4b95-4a4c-a7cb-94bd34132f52,network=Network(aa89e219-e3f2-4813-a9f8-d8d983c69cc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f2d964-4b') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG os_vif [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:fc:53,bridge_name='br-int',has_traffic_filtering=True,id=94f2d964-4b95-4a4c-a7cb-94bd34132f52,network=Network(aa89e219-e3f2-4813-a9f8-d8d983c69cc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f2d964-4b') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94f2d964-4b, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7a7f057-11a9-4322-aa5d-1b7afbd556f4) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:05 user nova-compute[74630]: INFO os_vif [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:fc:53,bridge_name='br-int',has_traffic_filtering=True,id=94f2d964-4b95-4a4c-a7cb-94bd34132f52,network=Network(aa89e219-e3f2-4813-a9f8-d8d983c69cc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94f2d964-4b')
Oct 26 03:24:05 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Deleting instance files /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5_del
Oct 26 03:24:05 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Deletion of /opt/stack/data/nova/instances/bb93fd61-5432-44d2-86c4-b4cdccc0e1c5_del complete
Oct 26 03:24:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquired lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG nova.network.neutron [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:24:05 user nova-compute[74630]: INFO nova.compute.manager [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 26 03:24:05 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:24:05 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:24:06 user nova-compute[74630]: INFO nova.network.neutron [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Port 95c62802-d8c8-467d-a4c5-4a4192f1b1b1 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Oct 26 03:24:06 user nova-compute[74630]: DEBUG nova.network.neutron [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Updating instance_info_cache with network_info: [{"id": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "address": "fa:16:3e:0e:14:6d", "network": {"id": "efa0bf4a-3164-4b5e-8a28-cb55a80bf10b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1237751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb62476-5c", "ovs_interfaceid": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Releasing lock "refresh_cache-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:24:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7208fe7c-43ae-44e6-9f21-10cf325fcb4b tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "interface-5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-95c62802-d8c8-467d-a4c5-4a4192f1b1b1" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.402s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:06 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:06 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Took 1.19 seconds to deallocate network for instance.
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG nova.objects.instance [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lazy-loading 'flavor' on Instance uuid 65ff804f-8b98-406d-8c5c-3d73bb52ff18 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-10a873b3-3933-44f6-b5d8-7895a9b21af6 req-55c769d5-afb9-4967-b7d2-018f329a8e3c service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received event network-vif-deleted-95c62802-d8c8-467d-a4c5-4a4192f1b1b1 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-10a873b3-3933-44f6-b5d8-7895a9b21af6 req-55c769d5-afb9-4967-b7d2-018f329a8e3c service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Received event network-vif-plugged-94f2d964-4b95-4a4c-a7cb-94bd34132f52 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-10a873b3-3933-44f6-b5d8-7895a9b21af6 req-55c769d5-afb9-4967-b7d2-018f329a8e3c service nova] Acquiring lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-10a873b3-3933-44f6-b5d8-7895a9b21af6 req-55c769d5-afb9-4967-b7d2-018f329a8e3c service nova] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-10a873b3-3933-44f6-b5d8-7895a9b21af6 req-55c769d5-afb9-4967-b7d2-018f329a8e3c service nova] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-10a873b3-3933-44f6-b5d8-7895a9b21af6 req-55c769d5-afb9-4967-b7d2-018f329a8e3c service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] No waiting events found dispatching network-vif-plugged-94f2d964-4b95-4a4c-a7cb-94bd34132f52 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:07 user nova-compute[74630]: WARNING nova.compute.manager [req-10a873b3-3933-44f6-b5d8-7895a9b21af6 req-55c769d5-afb9-4967-b7d2-018f329a8e3c service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Received unexpected event network-vif-plugged-94f2d964-4b95-4a4c-a7cb-94bd34132f52 for instance with vm_state deleted and task_state None.
Oct 26 03:24:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-10a873b3-3933-44f6-b5d8-7895a9b21af6 req-55c769d5-afb9-4967-b7d2-018f329a8e3c service nova] [instance: bb93fd61-5432-44d2-86c4-b4cdccc0e1c5] Received event network-vif-deleted-94f2d964-4b95-4a4c-a7cb-94bd34132f52 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:07 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Deleted allocations for instance bb93fd61-5432-44d2-86c4-b4cdccc0e1c5
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8960897f-7805-4e26-9a9e-53cf582a66f4 tempest-AttachSCSIVolumeTestJSON-2142747077 tempest-AttachSCSIVolumeTestJSON-2142747077-project-member] Lock "bb93fd61-5432-44d2-86c4-b4cdccc0e1c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.909s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:07 user nova-compute[74630]: INFO nova.compute.manager [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Attaching volume 173e4b04-308c-4ada-b18c-8539105cb677 to /dev/vdb
Oct 26 03:24:07 user nova-compute[74630]: DEBUG os_brick.utils [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[19139f77-7118-4166-a253-66fbda325ef2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2dac6e-e17b-413b-b768-6c0ba4191f51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7ba9a0-b112-4509-a25c-81ceb91f5c62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4477977-0028-48ca-ac22-8df7ce6e6b3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:24:07 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:24:07 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[912c8ece-f88c-46b5-bb21-426e4db8ac9b]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG os_brick.utils [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:24:07 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updating existing volume attachment record: d7d0e6c4-39d5-4a0c-94a1-92b1ab891b1b {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:24:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "f5441872-864e-44d9-8632-e05c5d71bd90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f5441872-864e-44d9-8632-e05c5d71bd90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:24:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:08 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:24:08 user nova-compute[74630]: INFO nova.compute.claims [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Claim successful on node user
Oct 26 03:24:09 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG nova.network.neutron [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:24:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:24:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG nova.policy [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a419737713f4797ab27db62d5aa746c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51542ffdf7a84ac5a61f14e124eb2087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:24:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Creating image(s)
Oct 26 03:24:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "/opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "/opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.213s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk 1073741824" returned: 0 in 0.053s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.230s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:10 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:24:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:10 user nova-compute[74630]: DEBUG nova.network.neutron [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Successfully created port: add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:24:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:10 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Cannot resize image /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:24:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:24:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Ensure instance console log exists: /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:24:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:10 user nova-compute[74630]: DEBUG nova.network.neutron [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Successfully updated port: add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "refresh_cache-f5441872-864e-44d9-8632-e05c5d71bd90" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquired lock "refresh_cache-f5441872-864e-44d9-8632-e05c5d71bd90" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.network.neutron [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "1599e499-12ac-4e25-97a4-17341a03f8c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-4490eb2e-9538-496e-8b83-48782d1631c6 req-dcc4a552-7b06-4b73-9272-ed3809ba5a65 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received event network-changed-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-4490eb2e-9538-496e-8b83-48782d1631c6 req-dcc4a552-7b06-4b73-9272-ed3809ba5a65 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Refreshing instance network info cache due to event network-changed-add088cb-2d9c-4ad2-a72b-64f1138ddfa2. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4490eb2e-9538-496e-8b83-48782d1631c6 req-dcc4a552-7b06-4b73-9272-ed3809ba5a65 service nova] Acquiring lock "refresh_cache-f5441872-864e-44d9-8632-e05c5d71bd90" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.network.neutron [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:24:11 user nova-compute[74630]: INFO nova.compute.claims [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Claim successful on node user
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.network.neutron [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Updating instance_info_cache with network_info: [{"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Releasing lock "refresh_cache-f5441872-864e-44d9-8632-e05c5d71bd90" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Instance network_info: |[{"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4490eb2e-9538-496e-8b83-48782d1631c6 req-dcc4a552-7b06-4b73-9272-ed3809ba5a65 service nova] Acquired lock "refresh_cache-f5441872-864e-44d9-8632-e05c5d71bd90" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.network.neutron [req-4490eb2e-9538-496e-8b83-48782d1631c6 req-dcc4a552-7b06-4b73-9272-ed3809ba5a65 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Refreshing network info cache for port add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Start _get_guest_xml network_info=[{"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:24:11 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:24:11 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-408750285',display_name='tempest-tempest.common.compute-instance-408750285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-408750285',id=15,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRQj+j0h8s5l5/c9Kzf5LlZUmn49bhrlJ3uSCaWTItfHpDtTlIsJ4WHGZJvTY9PtPQoKpGGVmQzLPcnzgoq3B+7cpI6c0xMS0qeeWXVorHztRqAqFqwFVzyTc7R0LLXqA==',key_name='tempest-keypair-1000691134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51542ffdf7a84ac5a61f14e124eb2087',ramdisk_id='',reservation_id='r-6oe0n30b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-41539930',owner_user_name='tempest-ServerActionsTestOtherA-41539930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:24:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a419737713f4797ab27db62d5aa746c',uuid=f5441872-864e-44d9-8632-e05c5d71bd90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converting VIF {"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9b:96,bridge_name='br-int',has_traffic_filtering=True,id=add088cb-2d9c-4ad2-a72b-64f1138ddfa2,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd088cb-2d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.objects.instance [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lazy-loading 'pci_devices' on Instance uuid f5441872-864e-44d9-8632-e05c5d71bd90 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:24:11 user nova-compute[74630]:   <uuid>f5441872-864e-44d9-8632-e05c5d71bd90</uuid>
Oct 26 03:24:11 user nova-compute[74630]:   <name>instance-0000000f</name>
Oct 26 03:24:11 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:24:11 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:24:11 user nova-compute[74630]:   <metadata>
Oct 26 03:24:11 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:24:11 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:24:11 user nova-compute[74630]:       <nova:name>tempest-tempest.common.compute-instance-408750285</nova:name>
Oct 26 03:24:11 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:24:11</nova:creationTime>
Oct 26 03:24:11 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:24:11 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:24:11 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:24:11 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:24:11 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:24:11 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:24:11 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:24:11 user nova-compute[74630]:       <nova:owner>
Oct 26 03:24:11 user nova-compute[74630]:         <nova:user uuid="7a419737713f4797ab27db62d5aa746c">tempest-ServerActionsTestOtherA-41539930-project-member</nova:user>
Oct 26 03:24:11 user nova-compute[74630]:         <nova:project uuid="51542ffdf7a84ac5a61f14e124eb2087">tempest-ServerActionsTestOtherA-41539930</nova:project>
Oct 26 03:24:11 user nova-compute[74630]:       </nova:owner>
Oct 26 03:24:11 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:24:11 user nova-compute[74630]:       <nova:ports>
Oct 26 03:24:11 user nova-compute[74630]:         <nova:port uuid="add088cb-2d9c-4ad2-a72b-64f1138ddfa2">
Oct 26 03:24:11 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 03:24:11 user nova-compute[74630]:         </nova:port>
Oct 26 03:24:11 user nova-compute[74630]:       </nova:ports>
Oct 26 03:24:11 user nova-compute[74630]:     </nova:instance>
Oct 26 03:24:11 user nova-compute[74630]:   </metadata>
Oct 26 03:24:11 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:24:11 user nova-compute[74630]:     <system>
Oct 26 03:24:11 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:24:11 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:24:11 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:24:11 user nova-compute[74630]:       <entry name="serial">f5441872-864e-44d9-8632-e05c5d71bd90</entry>
Oct 26 03:24:11 user nova-compute[74630]:       <entry name="uuid">f5441872-864e-44d9-8632-e05c5d71bd90</entry>
Oct 26 03:24:11 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:24:11 user nova-compute[74630]:     </system>
Oct 26 03:24:11 user nova-compute[74630]:   </sysinfo>
Oct 26 03:24:11 user nova-compute[74630]:   <os>
Oct 26 03:24:11 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:24:11 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:24:11 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:24:11 user nova-compute[74630]:   </os>
Oct 26 03:24:11 user nova-compute[74630]:   <features>
Oct 26 03:24:11 user nova-compute[74630]:     <acpi/>
Oct 26 03:24:11 user nova-compute[74630]:     <apic/>
Oct 26 03:24:11 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:24:11 user nova-compute[74630]:   </features>
Oct 26 03:24:11 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:24:11 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:24:11 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:24:11 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:24:11 user nova-compute[74630]:   </clock>
Oct 26 03:24:11 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:24:11 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:24:11 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:24:11 user nova-compute[74630]:   </cpu>
Oct 26 03:24:11 user nova-compute[74630]:   <devices>
Oct 26 03:24:11 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:24:11 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:24:11 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk"/>
Oct 26 03:24:11 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:24:11 user nova-compute[74630]:     </disk>
Oct 26 03:24:11 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:24:11 user nova-compute[74630]:       <mac address="fa:16:3e:3d:9b:96"/>
Oct 26 03:24:11 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:24:11 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:24:11 user nova-compute[74630]:       <target dev="tapadd088cb-2d"/>
Oct 26 03:24:11 user nova-compute[74630]:     </interface>
Oct 26 03:24:11 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:24:11 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/console.log" append="off"/>
Oct 26 03:24:11 user nova-compute[74630]:     </serial>
Oct 26 03:24:11 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:24:11 user nova-compute[74630]:     <video>
Oct 26 03:24:11 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:24:11 user nova-compute[74630]:     </video>
Oct 26 03:24:11 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:24:11 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:24:11 user nova-compute[74630]:     </rng>
Oct 26 03:24:11 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:24:11 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:24:11 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:24:11 user nova-compute[74630]:     </memballoon>
Oct 26 03:24:11 user nova-compute[74630]:   </devices>
Oct 26 03:24:11 user nova-compute[74630]: </domain>
Oct 26 03:24:11 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-408750285',display_name='tempest-tempest.common.compute-instance-408750285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-408750285',id=15,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRQj+j0h8s5l5/c9Kzf5LlZUmn49bhrlJ3uSCaWTItfHpDtTlIsJ4WHGZJvTY9PtPQoKpGGVmQzLPcnzgoq3B+7cpI6c0xMS0qeeWXVorHztRqAqFqwFVzyTc7R0LLXqA==',key_name='tempest-keypair-1000691134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51542ffdf7a84ac5a61f14e124eb2087',ramdisk_id='',reservation_id='r-6oe0n30b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-41539930',owner_user_name='tempest-ServerActionsTestOtherA-41539930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:24:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a419737713f4797ab27db62d5aa746c',uuid=f5441872-864e-44d9-8632-e05c5d71bd90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converting VIF {"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9b:96,bridge_name='br-int',has_traffic_filtering=True,id=add088cb-2d9c-4ad2-a72b-64f1138ddfa2,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd088cb-2d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG os_vif [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9b:96,bridge_name='br-int',has_traffic_filtering=True,id=add088cb-2d9c-4ad2-a72b-64f1138ddfa2,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd088cb-2d') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '140f4d8b-2c9b-596d-9e48-bf23751049ae', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadd088cb-2d, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapadd088cb-2d, col_values=(('qos', UUID('e4881815-4be1-46b2-b837-b3087a5546ea')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapadd088cb-2d, col_values=(('external_ids', {'iface-id': 'add088cb-2d9c-4ad2-a72b-64f1138ddfa2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:9b:96', 'vm-uuid': 'f5441872-864e-44d9-8632-e05c5d71bd90'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:11 user nova-compute[74630]: INFO os_vif [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:9b:96,bridge_name='br-int',has_traffic_filtering=True,id=add088cb-2d9c-4ad2-a72b-64f1138ddfa2,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd088cb-2d')
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] No VIF found with MAC fa:16:3e:3d:9b:96, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.network.neutron [req-4490eb2e-9538-496e-8b83-48782d1631c6 req-dcc4a552-7b06-4b73-9272-ed3809ba5a65 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Updated VIF entry in instance network info cache for port add088cb-2d9c-4ad2-a72b-64f1138ddfa2. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.network.neutron [req-4490eb2e-9538-496e-8b83-48782d1631c6 req-dcc4a552-7b06-4b73-9272-ed3809ba5a65 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Updating instance_info_cache with network_info: [{"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4490eb2e-9538-496e-8b83-48782d1631c6 req-dcc4a552-7b06-4b73-9272-ed3809ba5a65 service nova] Releasing lock "refresh_cache-f5441872-864e-44d9-8632-e05c5d71bd90" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.network.neutron [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:24:11 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:24:11 user nova-compute[74630]: DEBUG nova.policy [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'accb78f69ef64c9bacb02969887c3aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eccd4345949848cba29e4c991b6cb3b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG nova.compute.manager [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:24:12 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Creating image(s)
Oct 26 03:24:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "/opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "/opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "/opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.198s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk 1073741824" returned: 0 in 0.064s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG nova.network.neutron [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Successfully created port: 27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.228s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Cannot resize image /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Ensure instance console log exists: /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-9ab5d1d7-5f2d-492b-82a6-1596e7a44895 req-88c0d8e6-a705-4077-8dc7-eb30bbe3378f service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received event network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9ab5d1d7-5f2d-492b-82a6-1596e7a44895 req-88c0d8e6-a705-4077-8dc7-eb30bbe3378f service nova] Acquiring lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9ab5d1d7-5f2d-492b-82a6-1596e7a44895 req-88c0d8e6-a705-4077-8dc7-eb30bbe3378f service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9ab5d1d7-5f2d-492b-82a6-1596e7a44895 req-88c0d8e6-a705-4077-8dc7-eb30bbe3378f service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-9ab5d1d7-5f2d-492b-82a6-1596e7a44895 req-88c0d8e6-a705-4077-8dc7-eb30bbe3378f service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] No waiting events found dispatching network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:13 user nova-compute[74630]: WARNING nova.compute.manager [req-9ab5d1d7-5f2d-492b-82a6-1596e7a44895 req-88c0d8e6-a705-4077-8dc7-eb30bbe3378f service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received unexpected event network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 for instance with vm_state building and task_state spawning.
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.network.neutron [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Successfully updated port: 27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "refresh_cache-1599e499-12ac-4e25-97a4-17341a03f8c3" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquired lock "refresh_cache-1599e499-12ac-4e25-97a4-17341a03f8c3" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.network.neutron [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-981e44e1-7c50-4acd-94c5-3015fdece3b2 req-7204f24b-cc5e-4392-bad0-87ee55126ff3 service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Received event network-changed-27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-981e44e1-7c50-4acd-94c5-3015fdece3b2 req-7204f24b-cc5e-4392-bad0-87ee55126ff3 service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Refreshing instance network info cache due to event network-changed-27ccbd00-a0dd-4ff0-80d7-03e165b5cd43. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-981e44e1-7c50-4acd-94c5-3015fdece3b2 req-7204f24b-cc5e-4392-bad0-87ee55126ff3 service nova] Acquiring lock "refresh_cache-1599e499-12ac-4e25-97a4-17341a03f8c3" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.network.neutron [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.network.neutron [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Updating instance_info_cache with network_info: [{"id": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "address": "fa:16:3e:fd:77:e7", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ccbd00-a0", "ovs_interfaceid": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Releasing lock "refresh_cache-1599e499-12ac-4e25-97a4-17341a03f8c3" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.compute.manager [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Instance network_info: |[{"id": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "address": "fa:16:3e:fd:77:e7", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ccbd00-a0", "ovs_interfaceid": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-981e44e1-7c50-4acd-94c5-3015fdece3b2 req-7204f24b-cc5e-4392-bad0-87ee55126ff3 service nova] Acquired lock "refresh_cache-1599e499-12ac-4e25-97a4-17341a03f8c3" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.network.neutron [req-981e44e1-7c50-4acd-94c5-3015fdece3b2 req-7204f24b-cc5e-4392-bad0-87ee55126ff3 service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Refreshing network info cache for port 27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Start _get_guest_xml network_info=[{"id": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "address": "fa:16:3e:fd:77:e7", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ccbd00-a0", "ovs_interfaceid": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:24:13 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:24:13 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:24:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-415712306',display_name='tempest-VolumesAdminNegativeTest-server-415712306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-415712306',id=16,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eccd4345949848cba29e4c991b6cb3b6',ramdisk_id='',reservation_id='r-1vvu4sft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-741862100',owner_user_name='tempest-VolumesAdminNegativeTest-741862100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:24:12Z,user_data=None,user_id='accb78f69ef64c9bacb02969887c3aa2',uuid=1599e499-12ac-4e25-97a4-17341a03f8c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "address": "fa:16:3e:fd:77:e7", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ccbd00-a0", "ovs_interfaceid": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Converting VIF {"id": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "address": "fa:16:3e:fd:77:e7", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ccbd00-a0", "ovs_interfaceid": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:77:e7,bridge_name='br-int',has_traffic_filtering=True,id=27ccbd00-a0dd-4ff0-80d7-03e165b5cd43,network=Network(2ebb9b88-a9a3-4efd-a6e3-be76353d6be5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ccbd00-a0') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lazy-loading 'pci_devices' on Instance uuid 1599e499-12ac-4e25-97a4-17341a03f8c3 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:24:13 user nova-compute[74630]:   <uuid>1599e499-12ac-4e25-97a4-17341a03f8c3</uuid>
Oct 26 03:24:13 user nova-compute[74630]:   <name>instance-00000010</name>
Oct 26 03:24:13 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:24:13 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:24:13 user nova-compute[74630]:   <metadata>
Oct 26 03:24:13 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:24:13 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:24:13 user nova-compute[74630]:       <nova:name>tempest-VolumesAdminNegativeTest-server-415712306</nova:name>
Oct 26 03:24:13 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:24:13</nova:creationTime>
Oct 26 03:24:13 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:24:13 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:24:13 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:24:13 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:24:13 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:24:13 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:24:13 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:24:13 user nova-compute[74630]:       <nova:owner>
Oct 26 03:24:13 user nova-compute[74630]:         <nova:user uuid="accb78f69ef64c9bacb02969887c3aa2">tempest-VolumesAdminNegativeTest-741862100-project-member</nova:user>
Oct 26 03:24:13 user nova-compute[74630]:         <nova:project uuid="eccd4345949848cba29e4c991b6cb3b6">tempest-VolumesAdminNegativeTest-741862100</nova:project>
Oct 26 03:24:13 user nova-compute[74630]:       </nova:owner>
Oct 26 03:24:13 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:24:13 user nova-compute[74630]:       <nova:ports>
Oct 26 03:24:13 user nova-compute[74630]:         <nova:port uuid="27ccbd00-a0dd-4ff0-80d7-03e165b5cd43">
Oct 26 03:24:13 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 03:24:13 user nova-compute[74630]:         </nova:port>
Oct 26 03:24:13 user nova-compute[74630]:       </nova:ports>
Oct 26 03:24:13 user nova-compute[74630]:     </nova:instance>
Oct 26 03:24:13 user nova-compute[74630]:   </metadata>
Oct 26 03:24:13 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:24:13 user nova-compute[74630]:     <system>
Oct 26 03:24:13 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:24:13 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:24:13 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:24:13 user nova-compute[74630]:       <entry name="serial">1599e499-12ac-4e25-97a4-17341a03f8c3</entry>
Oct 26 03:24:13 user nova-compute[74630]:       <entry name="uuid">1599e499-12ac-4e25-97a4-17341a03f8c3</entry>
Oct 26 03:24:13 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:24:13 user nova-compute[74630]:     </system>
Oct 26 03:24:13 user nova-compute[74630]:   </sysinfo>
Oct 26 03:24:13 user nova-compute[74630]:   <os>
Oct 26 03:24:13 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:24:13 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:24:13 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:24:13 user nova-compute[74630]:   </os>
Oct 26 03:24:13 user nova-compute[74630]:   <features>
Oct 26 03:24:13 user nova-compute[74630]:     <acpi/>
Oct 26 03:24:13 user nova-compute[74630]:     <apic/>
Oct 26 03:24:13 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:24:13 user nova-compute[74630]:   </features>
Oct 26 03:24:13 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:24:13 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:24:13 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:24:13 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:24:13 user nova-compute[74630]:   </clock>
Oct 26 03:24:13 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:24:13 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:24:13 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:24:13 user nova-compute[74630]:   </cpu>
Oct 26 03:24:13 user nova-compute[74630]:   <devices>
Oct 26 03:24:13 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:24:13 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:24:13 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk"/>
Oct 26 03:24:13 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:24:13 user nova-compute[74630]:     </disk>
Oct 26 03:24:13 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:24:13 user nova-compute[74630]:       <mac address="fa:16:3e:fd:77:e7"/>
Oct 26 03:24:13 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:24:13 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:24:13 user nova-compute[74630]:       <target dev="tap27ccbd00-a0"/>
Oct 26 03:24:13 user nova-compute[74630]:     </interface>
Oct 26 03:24:13 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:24:13 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/console.log" append="off"/>
Oct 26 03:24:13 user nova-compute[74630]:     </serial>
Oct 26 03:24:13 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:24:13 user nova-compute[74630]:     <video>
Oct 26 03:24:13 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:24:13 user nova-compute[74630]:     </video>
Oct 26 03:24:13 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:24:13 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:24:13 user nova-compute[74630]:     </rng>
Oct 26 03:24:13 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:24:13 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:24:13 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:24:13 user nova-compute[74630]:     </memballoon>
Oct 26 03:24:13 user nova-compute[74630]:   </devices>
Oct 26 03:24:13 user nova-compute[74630]: </domain>
Oct 26 03:24:13 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:24:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-415712306',display_name='tempest-VolumesAdminNegativeTest-server-415712306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-415712306',id=16,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eccd4345949848cba29e4c991b6cb3b6',ramdisk_id='',reservation_id='r-1vvu4sft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-741862100',owner_user_name='tempest-VolumesAdminNegativeTest-741862100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:24:12Z,user_data=None,user_id='accb78f69ef64c9bacb02969887c3aa2',uuid=1599e499-12ac-4e25-97a4-17341a03f8c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "address": "fa:16:3e:fd:77:e7", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ccbd00-a0", "ovs_interfaceid": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Converting VIF {"id": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "address": "fa:16:3e:fd:77:e7", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ccbd00-a0", "ovs_interfaceid": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:77:e7,bridge_name='br-int',has_traffic_filtering=True,id=27ccbd00-a0dd-4ff0-80d7-03e165b5cd43,network=Network(2ebb9b88-a9a3-4efd-a6e3-be76353d6be5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ccbd00-a0') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG os_vif [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:77:e7,bridge_name='br-int',has_traffic_filtering=True,id=27ccbd00-a0dd-4ff0-80d7-03e165b5cd43,network=Network(2ebb9b88-a9a3-4efd-a6e3-be76353d6be5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ccbd00-a0') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '545ddcb2-2365-5d46-a260-b0970600b34d', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27ccbd00-a0, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27ccbd00-a0, col_values=(('qos', UUID('e921cf24-7c5f-46f5-8cf2-060dadd3d16a')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27ccbd00-a0, col_values=(('external_ids', {'iface-id': '27ccbd00-a0dd-4ff0-80d7-03e165b5cd43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:77:e7', 'vm-uuid': '1599e499-12ac-4e25-97a4-17341a03f8c3'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:13 user nova-compute[74630]: INFO os_vif [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:77:e7,bridge_name='br-int',has_traffic_filtering=True,id=27ccbd00-a0dd-4ff0-80d7-03e165b5cd43,network=Network(2ebb9b88-a9a3-4efd-a6e3-be76353d6be5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ccbd00-a0')
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:24:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] No VIF found with MAC fa:16:3e:fd:77:e7, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:24:14 user nova-compute[74630]: DEBUG nova.network.neutron [req-981e44e1-7c50-4acd-94c5-3015fdece3b2 req-7204f24b-cc5e-4392-bad0-87ee55126ff3 service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Updated VIF entry in instance network info cache for port 27ccbd00-a0dd-4ff0-80d7-03e165b5cd43. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:24:14 user nova-compute[74630]: DEBUG nova.network.neutron [req-981e44e1-7c50-4acd-94c5-3015fdece3b2 req-7204f24b-cc5e-4392-bad0-87ee55126ff3 service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Updating instance_info_cache with network_info: [{"id": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "address": "fa:16:3e:fd:77:e7", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ccbd00-a0", "ovs_interfaceid": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-981e44e1-7c50-4acd-94c5-3015fdece3b2 req-7204f24b-cc5e-4392-bad0-87ee55126ff3 service nova] Releasing lock "refresh_cache-1599e499-12ac-4e25-97a4-17341a03f8c3" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG nova.compute.manager [req-e62be829-da54-484f-a541-7309a63d074c req-9b4ce90a-a93c-4dba-938b-309fcfa1554b service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received event network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e62be829-da54-484f-a541-7309a63d074c req-9b4ce90a-a93c-4dba-938b-309fcfa1554b service nova] Acquiring lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e62be829-da54-484f-a541-7309a63d074c req-9b4ce90a-a93c-4dba-938b-309fcfa1554b service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e62be829-da54-484f-a541-7309a63d074c req-9b4ce90a-a93c-4dba-938b-309fcfa1554b service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG nova.compute.manager [req-e62be829-da54-484f-a541-7309a63d074c req-9b4ce90a-a93c-4dba-938b-309fcfa1554b service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] No waiting events found dispatching network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:15 user nova-compute[74630]: WARNING nova.compute.manager [req-e62be829-da54-484f-a541-7309a63d074c req-9b4ce90a-a93c-4dba-938b-309fcfa1554b service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received unexpected event network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 for instance with vm_state building and task_state spawning.
Oct 26 03:24:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:24:15 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Instance spawned successfully.
Oct 26 03:24:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:15 user nova-compute[74630]: INFO nova.compute.manager [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Took 6.20 seconds to spawn the instance on the hypervisor.
Oct 26 03:24:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:24:15 user nova-compute[74630]: INFO nova.compute.manager [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Took 7.06 seconds to build instance.
Oct 26 03:24:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16fdf4ed-fb99-4d25-afa4-91ffb374a10c tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f5441872-864e-44d9-8632-e05c5d71bd90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.177s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:17 user nova-compute[74630]: DEBUG nova.compute.manager [req-abed30ff-f8b0-459a-9ad1-6caf4d4a6f0d req-f4cecbff-487c-4e46-86f4-8ba8b7a8e4a2 service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Received event network-vif-plugged-27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-abed30ff-f8b0-459a-9ad1-6caf4d4a6f0d req-f4cecbff-487c-4e46-86f4-8ba8b7a8e4a2 service nova] Acquiring lock "1599e499-12ac-4e25-97a4-17341a03f8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-abed30ff-f8b0-459a-9ad1-6caf4d4a6f0d req-f4cecbff-487c-4e46-86f4-8ba8b7a8e4a2 service nova] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-abed30ff-f8b0-459a-9ad1-6caf4d4a6f0d req-f4cecbff-487c-4e46-86f4-8ba8b7a8e4a2 service nova] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:17 user nova-compute[74630]: DEBUG nova.compute.manager [req-abed30ff-f8b0-459a-9ad1-6caf4d4a6f0d req-f4cecbff-487c-4e46-86f4-8ba8b7a8e4a2 service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] No waiting events found dispatching network-vif-plugged-27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:17 user nova-compute[74630]: WARNING nova.compute.manager [req-abed30ff-f8b0-459a-9ad1-6caf4d4a6f0d req-f4cecbff-487c-4e46-86f4-8ba8b7a8e4a2 service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Received unexpected event network-vif-plugged-27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 for instance with vm_state building and task_state spawning.
Oct 26 03:24:17 user nova-compute[74630]: DEBUG nova.compute.manager [req-abed30ff-f8b0-459a-9ad1-6caf4d4a6f0d req-f4cecbff-487c-4e46-86f4-8ba8b7a8e4a2 service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Received event network-vif-plugged-27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-abed30ff-f8b0-459a-9ad1-6caf4d4a6f0d req-f4cecbff-487c-4e46-86f4-8ba8b7a8e4a2 service nova] Acquiring lock "1599e499-12ac-4e25-97a4-17341a03f8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-abed30ff-f8b0-459a-9ad1-6caf4d4a6f0d req-f4cecbff-487c-4e46-86f4-8ba8b7a8e4a2 service nova] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-abed30ff-f8b0-459a-9ad1-6caf4d4a6f0d req-f4cecbff-487c-4e46-86f4-8ba8b7a8e4a2 service nova] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:17 user nova-compute[74630]: DEBUG nova.compute.manager [req-abed30ff-f8b0-459a-9ad1-6caf4d4a6f0d req-f4cecbff-487c-4e46-86f4-8ba8b7a8e4a2 service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] No waiting events found dispatching network-vif-plugged-27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:17 user nova-compute[74630]: WARNING nova.compute.manager [req-abed30ff-f8b0-459a-9ad1-6caf4d4a6f0d req-f4cecbff-487c-4e46-86f4-8ba8b7a8e4a2 service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Received unexpected event network-vif-plugged-27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 for instance with vm_state building and task_state spawning.
Oct 26 03:24:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:24:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:24:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Instance spawned successfully.
Oct 26 03:24:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:24:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:24:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:24:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:24:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:24:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:24:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:24:18 user nova-compute[74630]: INFO nova.compute.manager [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Took 6.05 seconds to spawn the instance on the hypervisor.
Oct 26 03:24:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:24:18 user nova-compute[74630]: INFO nova.compute.manager [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Took 7.10 seconds to build instance.
Oct 26 03:24:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-83fe8971-a131-44dc-81f5-5153589e4304 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.215s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:24:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:24:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:24:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:24:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:24:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:24:19 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Updating instance_info_cache with network_info: [{"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:24:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:24:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:24:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Acquiring lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Acquiring lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:23 user nova-compute[74630]: INFO nova.compute.manager [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Terminating instance
Oct 26 03:24:23 user nova-compute[74630]: DEBUG nova.compute.manager [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-38ffd81c-433e-414c-8be2-1815f13ab594 req-5a0eeb76-42b1-41a3-87a9-1834c2d4aa19 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Received event network-vif-unplugged-f59f8d04-3231-40d4-8e2f-f40517ed0d09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-38ffd81c-433e-414c-8be2-1815f13ab594 req-5a0eeb76-42b1-41a3-87a9-1834c2d4aa19 service nova] Acquiring lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-38ffd81c-433e-414c-8be2-1815f13ab594 req-5a0eeb76-42b1-41a3-87a9-1834c2d4aa19 service nova] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-38ffd81c-433e-414c-8be2-1815f13ab594 req-5a0eeb76-42b1-41a3-87a9-1834c2d4aa19 service nova] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-38ffd81c-433e-414c-8be2-1815f13ab594 req-5a0eeb76-42b1-41a3-87a9-1834c2d4aa19 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] No waiting events found dispatching network-vif-unplugged-f59f8d04-3231-40d4-8e2f-f40517ed0d09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-38ffd81c-433e-414c-8be2-1815f13ab594 req-5a0eeb76-42b1-41a3-87a9-1834c2d4aa19 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Received event network-vif-unplugged-f59f8d04-3231-40d4-8e2f-f40517ed0d09 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:24 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Instance destroyed successfully.
Oct 26 03:24:24 user nova-compute[74630]: DEBUG nova.objects.instance [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lazy-loading 'resources' on Instance uuid 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:21:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-376306411',display_name='tempest-VolumesAssistedSnapshotsTest-server-376306411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-376306411',id=11,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI35lIo7EuEGghCIgN4nejA7atOtkw1+W2ar2Mh261vl6es40QctNNIBYzTQ91yPdFvNXyQD7hJjtLJK9iE1ayr59cbjZ2OUw76nQlNG3qO29D2qu6XZabr6naUs3ePtaQ==',key_name='tempest-keypair-1965963470',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:21:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5438cb807444ca791de9c7070430b88',ramdisk_id='',reservation_id='r-050xu4nd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-784835547',owner_user_name='tempest-VolumesAssistedSnapshotsTest-784835547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:21:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf85228071034c539eb8107fa7215a28',uuid=933f84b6-a3bb-47d7-b82e-f80ec5c15c43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "address": "fa:16:3e:1f:1b:29", "network": {"id": "fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1042679542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5438cb807444ca791de9c7070430b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59f8d04-32", "ovs_interfaceid": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Converting VIF {"id": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "address": "fa:16:3e:1f:1b:29", "network": {"id": "fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1042679542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5438cb807444ca791de9c7070430b88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59f8d04-32", "ovs_interfaceid": "f59f8d04-3231-40d4-8e2f-f40517ed0d09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:1b:29,bridge_name='br-int',has_traffic_filtering=True,id=f59f8d04-3231-40d4-8e2f-f40517ed0d09,network=Network(fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59f8d04-32') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG os_vif [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:1b:29,bridge_name='br-int',has_traffic_filtering=True,id=f59f8d04-3231-40d4-8e2f-f40517ed0d09,network=Network(fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59f8d04-32') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf59f8d04-32, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9060e5bf-e021-4feb-81a1-cc7d2bbd2e22) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:24 user nova-compute[74630]: INFO os_vif [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:1b:29,bridge_name='br-int',has_traffic_filtering=True,id=f59f8d04-3231-40d4-8e2f-f40517ed0d09,network=Network(fa8d6b51-7e3c-4da5-9d4c-561bf0064fa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf59f8d04-32')
Oct 26 03:24:24 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Deleting instance files /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43_del
Oct 26 03:24:24 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Deletion of /opt/stack/data/nova/instances/933f84b6-a3bb-47d7-b82e-f80ec5c15c43_del complete
Oct 26 03:24:24 user nova-compute[74630]: INFO nova.compute.manager [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Took 1.13 seconds to destroy the instance on the hypervisor.
Oct 26 03:24:24 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG nova.compute.manager [req-bfdf6875-a7eb-438f-ad92-da2b910dced6 req-1ff1ebf3-f29a-4eac-a11d-3a1c75909db7 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Received event network-vif-deleted-f59f8d04-3231-40d4-8e2f-f40517ed0d09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:25 user nova-compute[74630]: INFO nova.compute.manager [req-bfdf6875-a7eb-438f-ad92-da2b910dced6 req-1ff1ebf3-f29a-4eac-a11d-3a1c75909db7 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Neutron deleted interface f59f8d04-3231-40d4-8e2f-f40517ed0d09; detaching it from the instance and deleting it from the info cache
Oct 26 03:24:25 user nova-compute[74630]: DEBUG nova.network.neutron [req-bfdf6875-a7eb-438f-ad92-da2b910dced6 req-1ff1ebf3-f29a-4eac-a11d-3a1c75909db7 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG nova.compute.manager [req-bfdf6875-a7eb-438f-ad92-da2b910dced6 req-1ff1ebf3-f29a-4eac-a11d-3a1c75909db7 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Detach interface failed, port_id=f59f8d04-3231-40d4-8e2f-f40517ed0d09, reason: Instance 933f84b6-a3bb-47d7-b82e-f80ec5c15c43 could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 03:24:25 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Took 0.84 seconds to deallocate network for instance.
Oct 26 03:24:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG nova.compute.manager [req-49e3b60c-6ba9-4438-9cae-b398ac2828c9 req-5e12720e-3f25-4196-b8ef-facbc472c9f9 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Received event network-vif-plugged-f59f8d04-3231-40d4-8e2f-f40517ed0d09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-49e3b60c-6ba9-4438-9cae-b398ac2828c9 req-5e12720e-3f25-4196-b8ef-facbc472c9f9 service nova] Acquiring lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-49e3b60c-6ba9-4438-9cae-b398ac2828c9 req-5e12720e-3f25-4196-b8ef-facbc472c9f9 service nova] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-49e3b60c-6ba9-4438-9cae-b398ac2828c9 req-5e12720e-3f25-4196-b8ef-facbc472c9f9 service nova] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:25 user nova-compute[74630]: DEBUG nova.compute.manager [req-49e3b60c-6ba9-4438-9cae-b398ac2828c9 req-5e12720e-3f25-4196-b8ef-facbc472c9f9 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] No waiting events found dispatching network-vif-plugged-f59f8d04-3231-40d4-8e2f-f40517ed0d09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:25 user nova-compute[74630]: WARNING nova.compute.manager [req-49e3b60c-6ba9-4438-9cae-b398ac2828c9 req-5e12720e-3f25-4196-b8ef-facbc472c9f9 service nova] [instance: 933f84b6-a3bb-47d7-b82e-f80ec5c15c43] Received unexpected event network-vif-plugged-f59f8d04-3231-40d4-8e2f-f40517ed0d09 for instance with vm_state deleted and task_state None.
Oct 26 03:24:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:26 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:24:26 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=7357MB free_disk=25.367202758789062GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.165s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.085s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:26 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Deleted allocations for instance 933f84b6-a3bb-47d7-b82e-f80ec5c15c43
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 65ff804f-8b98-406d-8c5c-3d73bb52ff18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f5441872-864e-44d9-8632-e05c5d71bd90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 2d851c9c-c56c-4be0-ac59-ea59ea9304c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 747e596d-d9b3-4af2-be42-0fd494b6ef9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 1599e499-12ac-4e25-97a4-17341a03f8c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d1591088-0892-4aa5-b7ea-3addb083bc69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:24:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-48e53ebe-2043-4824-86a7-7fb45a2c06f0 tempest-VolumesAssistedSnapshotsTest-784835547 tempest-VolumesAssistedSnapshotsTest-784835547-project-member] Lock "933f84b6-a3bb-47d7-b82e-f80ec5c15c43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.497s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:27 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:24:27 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:24:27 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:24:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxkXluOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:24:29 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:24:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:24:29 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:24:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:24:29 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7d5242-d967-45cc-8c7b-2a596ab2d265]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:24:29 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee833f2e-2979-4801-b22a-9cd022b55823]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677] added
Oct 26 03:24:29 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccdbaa8-8678-484d-ae8d-4530f223dd50]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c9015f-8cc5-4b5e-b267-a1b635de2cf7]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxkXluOe {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxkXluOe" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e89fa9-637b-4503-b1c2-17d7d97deefc]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wxkXluOe'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f301c9aa-529b-4781-8efd-7c0fa233ecd0]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2528687-5fca-4014-ad9e-909ce1e39e41]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:24:29 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:24:29 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:24:29 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:24:29 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:24:29 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:24:29 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:24:29 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:24:29 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:24:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[986c4a41-9843-4be9-a9f6-48d917f8e692]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260]
Oct 26 03:24:30 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260] successful.
Oct 26 03:24:30 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f743a63-8142-4686-8d2a-4180ef1c9d84]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3618f4e-7f3a-49bc-a14b-4b6a79819826]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:24:30 user nova-compute[74630]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:24:30 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:24:30 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:24:30 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:24:30 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:24:30 user nova-compute[74630]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:24:30 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:24:30 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:24:30 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:24:30 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] HCTL ('35', '-', '-', 0) found on session 11 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1975521-4ced-4035-affa-84236a8cb2d6]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:30 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:24:31 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:24:31 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxkXluOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:24:31 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:24:31 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23438363938663231', 'path': '/dev/sdd'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:24:31 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438363938663231', 'path': '/dev/sdd'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:24:31 user nova-compute[74630]: DEBUG nova.objects.instance [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lazy-loading 'flavor' on Instance uuid 65ff804f-8b98-406d-8c5c-3d73bb52ff18 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:24:31 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:24:31 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:24:31 user nova-compute[74630]:   <source dev="/dev/sdd"/>
Oct 26 03:24:31 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:24:31 user nova-compute[74630]:   <serial>173e4b04-308c-4ada-b18c-8539105cb677</serial>
Oct 26 03:24:31 user nova-compute[74630]: </disk>
Oct 26 03:24:31 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:24:31 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:24:31 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:24:31 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] No VIF found with MAC fa:16:3e:51:30:8c, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:24:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e905096d-7f5d-41f1-a31a-2c5f5ed17738 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.156s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:34 user nova-compute[74630]: DEBUG nova.compute.manager [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Stashing vm_state: active {{(pid=74630) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 26 03:24:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:34 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:24:34 user nova-compute[74630]: INFO nova.compute.claims [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Claim successful on node user
Oct 26 03:24:34 user nova-compute[74630]: INFO nova.compute.resource_tracker [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updating resource usage from migration 2047908f-d5af-45f5-8a55-68abbbbe7af0
Oct 26 03:24:34 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:35 user nova-compute[74630]: INFO nova.compute.manager [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Terminating instance
Oct 26 03:24:35 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.524s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:35 user nova-compute[74630]: INFO nova.compute.manager [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Migrating
Oct 26 03:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:24:35 user nova-compute[74630]: INFO nova.compute.rpcapi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 26 03:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquired lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG nova.network.neutron [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG nova.compute.manager [req-f6ea85cf-e16e-4030-9061-bbe77045273c req-f180badb-635b-4812-a625-49a1ecb28fa2 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received event network-vif-unplugged-4fb62476-5cff-4ebe-a5fe-4990895d991d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f6ea85cf-e16e-4030-9061-bbe77045273c req-f180badb-635b-4812-a625-49a1ecb28fa2 service nova] Acquiring lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f6ea85cf-e16e-4030-9061-bbe77045273c req-f180badb-635b-4812-a625-49a1ecb28fa2 service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f6ea85cf-e16e-4030-9061-bbe77045273c req-f180badb-635b-4812-a625-49a1ecb28fa2 service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG nova.compute.manager [req-f6ea85cf-e16e-4030-9061-bbe77045273c req-f180badb-635b-4812-a625-49a1ecb28fa2 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] No waiting events found dispatching network-vif-unplugged-4fb62476-5cff-4ebe-a5fe-4990895d991d {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG nova.compute.manager [req-f6ea85cf-e16e-4030-9061-bbe77045273c req-f180badb-635b-4812-a625-49a1ecb28fa2 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received event network-vif-unplugged-4fb62476-5cff-4ebe-a5fe-4990895d991d for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:24:35 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Instance destroyed successfully.
Oct 26 03:24:35 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lazy-loading 'resources' on Instance uuid 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1573607150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1573607150',id=10,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZvVt6JBJwjHuYv5rzAu6BfJiTRPT7gKst00ewuSImGcEAgmFYYyJpfkfMTPoD2yUtdQjdpC1u2VHivVP4deD3aeXnWol8rB/ye8SYwl6D/y52fGTUBa9use//IRHEP+g==',key_name='tempest-keypair-1967708874',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:21:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ee5c011c90e43d7be5ae38812de10e0',ramdisk_id='',reservation_id='r-48ob7np6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-162967180',owner_user_name='tempest-TaggedAttachmentsTest-162967180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad908828808542d88bf198ad10a67ce8',uuid=5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "address": "fa:16:3e:0e:14:6d", "network": {"id": "efa0bf4a-3164-4b5e-8a28-cb55a80bf10b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1237751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb62476-5c", "ovs_interfaceid": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Converting VIF {"id": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "address": "fa:16:3e:0e:14:6d", "network": {"id": "efa0bf4a-3164-4b5e-8a28-cb55a80bf10b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1237751404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee5c011c90e43d7be5ae38812de10e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb62476-5c", "ovs_interfaceid": "4fb62476-5cff-4ebe-a5fe-4990895d991d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:14:6d,bridge_name='br-int',has_traffic_filtering=True,id=4fb62476-5cff-4ebe-a5fe-4990895d991d,network=Network(efa0bf4a-3164-4b5e-8a28-cb55a80bf10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb62476-5c') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG os_vif [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:14:6d,bridge_name='br-int',has_traffic_filtering=True,id=4fb62476-5cff-4ebe-a5fe-4990895d991d,network=Network(efa0bf4a-3164-4b5e-8a28-cb55a80bf10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb62476-5c') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fb62476-5c, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91662f59-85fa-4172-9f14-d99e0aa850d6) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:35 user nova-compute[74630]: INFO os_vif [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:14:6d,bridge_name='br-int',has_traffic_filtering=True,id=4fb62476-5cff-4ebe-a5fe-4990895d991d,network=Network(efa0bf4a-3164-4b5e-8a28-cb55a80bf10b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb62476-5c')
Oct 26 03:24:35 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Deleting instance files /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b_del
Oct 26 03:24:35 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Deletion of /opt/stack/data/nova/instances/5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b_del complete
Oct 26 03:24:36 user nova-compute[74630]: INFO nova.compute.manager [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 26 03:24:36 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:24:36 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:24:36 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:24:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updating instance_info_cache with network_info: [{"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Releasing lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:24:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Starting migrate_disk_and_power_off {{(pid=74630) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 26 03:24:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:37 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Instance destroyed successfully.
Oct 26 03:24:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1501494997',display_name='tempest-ServerActionsTestOtherB-server-1501494997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1501494997',id=5,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFIeBoj6ZVV6vjKZ5C8Qtaf45gZ5VQLu8uYxcKaMISZ7A/ITCT4P2Cxj8DgdsT8tNJFXq2qSIv9+4+e1q0xZrix9FhWGUlPhtxOjh9fvNN5qcQ+ZdFKB+/mBI3I8ldOaQ==',key_name='tempest-keypair-565299267',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:20:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='03fc5bdbf0b947b49f6a6c8d44630ed5',ramdisk_id='',reservation_id='r-4c005us9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-638189769',owner_user_name='tempest-ServerActionsTestOtherB-638189769-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:24:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e27a2c56890d4be0a3fb46bd748fa7cf',uuid=65ff804f-8b98-406d-8c5c-3d73bb52ff18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-120532424-network", "vif_mac": "fa:16:3e:51:30:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converting VIF {"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-120532424-network", "vif_mac": "fa:16:3e:51:30:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_vif [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb965ee06-ed, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b03052d-f9f2-4088-85f8-03ef36f8a5ed) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:37 user nova-compute[74630]: INFO os_vif [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed')
Oct 26 03:24:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxkXluOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:24:37 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af53b56-7955-4b6e-a380-f3b1c895b929]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:24:37 user nova-compute[74630]: No targets found.
Oct 26 03:24:37 user nova-compute[74630]: iSNS:
Oct 26 03:24:37 user nova-compute[74630]: No targets found.
Oct 26 03:24:37 user nova-compute[74630]: STATIC:
Oct 26 03:24:37 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:24:37 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:37 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:37 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677
Oct 26 03:24:37 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:37 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:37 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417
Oct 26 03:24:37 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:37 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:37 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550
Oct 26 03:24:37 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:37 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:37 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea
Oct 26 03:24:37 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:37 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:37 user nova-compute[74630]: FIRMWARE:
Oct 26 03:24:37 user nova-compute[74630]: No targets found.
Oct 26 03:24:37 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:24:37 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:24:37 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[857c452b-67cc-4dca-b5ce-b9860e22210e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2dfc56-d019-4bd6-8836-b280aed38f37]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:24:37 user nova-compute[74630]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:24:37 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:24:37 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:24:37 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:24:37 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:24:37 user nova-compute[74630]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:24:37 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:24:37 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:24:37 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:24:37 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c39bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677'): ({'sdd'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Removing single pathed devices sdd {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c39468-1c91-4ee0-8ba4-d5b49bfebc1d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[05895d2e-f846-4a69-9364-213ef62f930f]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Flushing IO for device /dev/sdd {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd68d78-d306-424d-bb59-0da9ca75fa05]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c39900a-5fcd-4a8f-be68-31d569b641ca]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c585c4-a437-4c28-92fc-f0ac1d8a56fa]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2b12c4-b7f3-4262-9e3d-a605a4cf12b6]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260]
Oct 26 03:24:37 user nova-compute[74630]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260] successful.
Oct 26 03:24:37 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received event network-vif-plugged-4fb62476-5cff-4ebe-a5fe-4990895d991d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] Acquiring lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] No waiting events found dispatching network-vif-plugged-4fb62476-5cff-4ebe-a5fe-4990895d991d {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:37 user nova-compute[74630]: WARNING nova.compute.manager [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received unexpected event network-vif-plugged-4fb62476-5cff-4ebe-a5fe-4990895d991d for instance with vm_state active and task_state deleting.
Oct 26 03:24:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-vif-unplugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] No waiting events found dispatching network-vif-unplugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:37 user nova-compute[74630]: WARNING nova.compute.manager [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received unexpected event network-vif-unplugged-b965ee06-ed93-40fc-9732-974c808f5c36 for instance with vm_state active and task_state resize_migrating.
Oct 26 03:24:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] No waiting events found dispatching network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:37 user nova-compute[74630]: WARNING nova.compute.manager [req-c697f54a-969d-4d8b-9dbd-2991991bbb6f req-c33df09d-84cc-4d47-b99a-7961319f035a service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received unexpected event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 for instance with vm_state active and task_state resize_migrating.
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[00580a94-5533-417d-8b6c-df627e2b2cff]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] <== disconnect_volume: return (404ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-fee2473d-b1b7-4992-91ff-c668ed4ccd7b req-fbf2a555-d3a5-459b-8a1b-553354e0727d service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-changed-bf5f9227-19d4-480f-bdda-d8d839b63030 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-fee2473d-b1b7-4992-91ff-c668ed4ccd7b req-fbf2a555-d3a5-459b-8a1b-553354e0727d service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing instance network info cache due to event network-changed-bf5f9227-19d4-480f-bdda-d8d839b63030. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-fee2473d-b1b7-4992-91ff-c668ed4ccd7b req-fbf2a555-d3a5-459b-8a1b-553354e0727d service nova] Acquiring lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-fee2473d-b1b7-4992-91ff-c668ed4ccd7b req-fbf2a555-d3a5-459b-8a1b-553354e0727d service nova] Acquired lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG nova.network.neutron [req-fee2473d-b1b7-4992-91ff-c668ed4ccd7b req-fbf2a555-d3a5-459b-8a1b-553354e0727d service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Refreshing network info cache for port bf5f9227-19d4-480f-bdda-d8d839b63030 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:37 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Took 1.85 seconds to deallocate network for instance.
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:24:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18_resize/disk /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:38 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:24:38 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:24:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.559s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:38 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Deleted allocations for instance 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b
Oct 26 03:24:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CMD "cp -r /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18_resize/disk /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk" returned: 0 in 0.397s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18_resize/disk.info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk.info {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CMD "cp -r /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18_resize/disk.info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk.info" returned: 0 in 0.070s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:38 user nova-compute[74630]: DEBUG nova.network.neutron [req-fee2473d-b1b7-4992-91ff-c668ed4ccd7b req-fbf2a555-d3a5-459b-8a1b-553354e0727d service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updated VIF entry in instance network info cache for port bf5f9227-19d4-480f-bdda-d8d839b63030. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:24:38 user nova-compute[74630]: DEBUG nova.network.neutron [req-fee2473d-b1b7-4992-91ff-c668ed4ccd7b req-fbf2a555-d3a5-459b-8a1b-553354e0727d service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updating instance_info_cache with network_info: [{"id": "bf5f9227-19d4-480f-bdda-d8d839b63030", "address": "fa:16:3e:99:96:bd", "network": {"id": "dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1333134059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5f9227-19", "ovs_interfaceid": "bf5f9227-19d4-480f-bdda-d8d839b63030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "address": "fa:16:3e:b0:a9:f6", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ed9aa-b6", "ovs_interfaceid": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "address": "fa:16:3e:ad:f4:1d", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap812b7cf9-19", "ovs_interfaceid": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "address": "fa:16:3e:94:57:f1", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03b6f6f-4e", "ovs_interfaceid": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "address": "fa:16:3e:b9:da:9b", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b88a64-c3", "ovs_interfaceid": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6756804-11a1-42a7-a432-bd0829d6dea0", "address": "fa:16:3e:0a:93:81", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6756804-11", "ovs_interfaceid": "d6756804-11a1-42a7-a432-bd0829d6dea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "address": "fa:16:3e:cb:c8:46", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff80c83f-f6", "ovs_interfaceid": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c353725a-5903-416e-a463-3c44e8b58137 tempest-TaggedAttachmentsTest-162967180 tempest-TaggedAttachmentsTest-162967180-project-member] Lock "5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.687s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-fee2473d-b1b7-4992-91ff-c668ed4ccd7b req-fbf2a555-d3a5-459b-8a1b-553354e0727d service nova] Releasing lock "refresh_cache-2d851c9c-c56c-4be0-ac59-ea59ea9304c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:24:39 user nova-compute[74630]: DEBUG nova.compute.manager [req-816ff1a3-a757-4b7a-baee-901b3acd44cc req-b2c5a382-3497-4958-8fed-36fdc6bbcab6 service nova] [instance: 5c3dca6f-42c0-4c82-9e9e-ebffc554ca3b] Received event network-vif-deleted-4fb62476-5cff-4ebe-a5fe-4990895d991d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:40 user nova-compute[74630]: INFO nova.compute.manager [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Terminating instance
Oct 26 03:24:40 user nova-compute[74630]: DEBUG nova.compute.manager [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:24:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-7646ed11-fc32-491c-94f6-ec6d26838041 req-f2f5a560-565e-4931-886f-05181f0f5df4 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-unplugged-bf5f9227-19d4-480f-bdda-d8d839b63030 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7646ed11-fc32-491c-94f6-ec6d26838041 req-f2f5a560-565e-4931-886f-05181f0f5df4 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7646ed11-fc32-491c-94f6-ec6d26838041 req-f2f5a560-565e-4931-886f-05181f0f5df4 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7646ed11-fc32-491c-94f6-ec6d26838041 req-f2f5a560-565e-4931-886f-05181f0f5df4 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-7646ed11-fc32-491c-94f6-ec6d26838041 req-f2f5a560-565e-4931-886f-05181f0f5df4 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-unplugged-bf5f9227-19d4-480f-bdda-d8d839b63030 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-7646ed11-fc32-491c-94f6-ec6d26838041 req-f2f5a560-565e-4931-886f-05181f0f5df4 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-unplugged-bf5f9227-19d4-480f-bdda-d8d839b63030 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-c0c877a4-8906-4056-85b5-36968e719a6b req-d2bf3553-8ec1-497f-bbaa-8f4b5a93dd4d service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-unplugged-07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c0c877a4-8906-4056-85b5-36968e719a6b req-d2bf3553-8ec1-497f-bbaa-8f4b5a93dd4d service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c0c877a4-8906-4056-85b5-36968e719a6b req-d2bf3553-8ec1-497f-bbaa-8f4b5a93dd4d service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c0c877a4-8906-4056-85b5-36968e719a6b req-d2bf3553-8ec1-497f-bbaa-8f4b5a93dd4d service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-c0c877a4-8906-4056-85b5-36968e719a6b req-d2bf3553-8ec1-497f-bbaa-8f4b5a93dd4d service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-unplugged-07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-c0c877a4-8906-4056-85b5-36968e719a6b req-d2bf3553-8ec1-497f-bbaa-8f4b5a93dd4d service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-unplugged-07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-unplugged-209ed9aa-b6ea-4103-8231-7f6380f5d187 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-unplugged-209ed9aa-b6ea-4103-8231-7f6380f5d187 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-unplugged-209ed9aa-b6ea-4103-8231-7f6380f5d187 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-209ed9aa-b6ea-4103-8231-7f6380f5d187 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-209ed9aa-b6ea-4103-8231-7f6380f5d187 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:41 user nova-compute[74630]: WARNING nova.compute.manager [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-209ed9aa-b6ea-4103-8231-7f6380f5d187 for instance with vm_state active and task_state deleting.
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-unplugged-812b7cf9-199e-458a-93f5-3a73dfe4a05a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-unplugged-812b7cf9-199e-458a-93f5-3a73dfe4a05a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-unplugged-812b7cf9-199e-458a-93f5-3a73dfe4a05a for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-812b7cf9-199e-458a-93f5-3a73dfe4a05a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-812b7cf9-199e-458a-93f5-3a73dfe4a05a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:41 user nova-compute[74630]: WARNING nova.compute.manager [req-bd5d8c66-de75-4488-988a-0a67999f4c29 req-17dcd650-387f-41e1-bdc6-ca9596c125fd service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-812b7cf9-199e-458a-93f5-3a73dfe4a05a for instance with vm_state active and task_state deleting.
Oct 26 03:24:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Instance destroyed successfully.
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.objects.instance [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lazy-loading 'resources' on Instance uuid 2d851c9c-c56c-4be0-ac59-ea59ea9304c2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf5f9227-19d4-480f-bdda-d8d839b63030", "address": "fa:16:3e:99:96:bd", "network": {"id": "dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1333134059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5f9227-19", "ovs_interfaceid": "bf5f9227-19d4-480f-bdda-d8d839b63030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "bf5f9227-19d4-480f-bdda-d8d839b63030", "address": "fa:16:3e:99:96:bd", "network": {"id": "dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1333134059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5f9227-19", "ovs_interfaceid": "bf5f9227-19d4-480f-bdda-d8d839b63030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:96:bd,bridge_name='br-int',has_traffic_filtering=True,id=bf5f9227-19d4-480f-bdda-d8d839b63030,network=Network(dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5f9227-19') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG os_vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:96:bd,bridge_name='br-int',has_traffic_filtering=True,id=bf5f9227-19d4-480f-bdda-d8d839b63030,network=Network(dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5f9227-19') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf5f9227-19, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f329360-0298-4836-86d3-b9bc8968f03c) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: INFO os_vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:96:bd,bridge_name='br-int',has_traffic_filtering=True,id=bf5f9227-19d4-480f-bdda-d8d839b63030,network=Network(dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf5f9227-19')
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "address": "fa:16:3e:b0:a9:f6", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ed9aa-b6", "ovs_interfaceid": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "address": "fa:16:3e:b0:a9:f6", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ed9aa-b6", "ovs_interfaceid": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a9:f6,bridge_name='br-int',has_traffic_filtering=True,id=209ed9aa-b6ea-4103-8231-7f6380f5d187,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap209ed9aa-b6') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG os_vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a9:f6,bridge_name='br-int',has_traffic_filtering=True,id=209ed9aa-b6ea-4103-8231-7f6380f5d187,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap209ed9aa-b6') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap209ed9aa-b6, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e151a978-ac42-4ea8-bdce-381fedc81e1f) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: INFO os_vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:a9:f6,bridge_name='br-int',has_traffic_filtering=True,id=209ed9aa-b6ea-4103-8231-7f6380f5d187,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap209ed9aa-b6')
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "address": "fa:16:3e:ad:f4:1d", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap812b7cf9-19", "ovs_interfaceid": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "address": "fa:16:3e:ad:f4:1d", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap812b7cf9-19", "ovs_interfaceid": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f4:1d,bridge_name='br-int',has_traffic_filtering=True,id=812b7cf9-199e-458a-93f5-3a73dfe4a05a,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap812b7cf9-19') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG os_vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f4:1d,bridge_name='br-int',has_traffic_filtering=True,id=812b7cf9-199e-458a-93f5-3a73dfe4a05a,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap812b7cf9-19') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap812b7cf9-19, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67c8b6fe-9bcd-4f7d-8789-e62bc042eb7b) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: INFO os_vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f4:1d,bridge_name='br-int',has_traffic_filtering=True,id=812b7cf9-199e-458a-93f5-3a73dfe4a05a,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap812b7cf9-19')
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "address": "fa:16:3e:94:57:f1", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03b6f6f-4e", "ovs_interfaceid": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "address": "fa:16:3e:94:57:f1", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03b6f6f-4e", "ovs_interfaceid": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:57:f1,bridge_name='br-int',has_traffic_filtering=True,id=d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03b6f6f-4e') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG os_vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:57:f1,bridge_name='br-int',has_traffic_filtering=True,id=d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03b6f6f-4e') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd03b6f6f-4e, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d682eec4-7d82-41ac-9424-afeacdac63a2) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: INFO os_vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:57:f1,bridge_name='br-int',has_traffic_filtering=True,id=d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03b6f6f-4e')
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "address": "fa:16:3e:b9:da:9b", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b88a64-c3", "ovs_interfaceid": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "address": "fa:16:3e:b9:da:9b", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b88a64-c3", "ovs_interfaceid": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:da:9b,bridge_name='br-int',has_traffic_filtering=True,id=07b88a64-c3ce-41e1-a8c5-9a394f06f0a6,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b88a64-c3') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG os_vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:da:9b,bridge_name='br-int',has_traffic_filtering=True,id=07b88a64-c3ce-41e1-a8c5-9a394f06f0a6,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b88a64-c3') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07b88a64-c3, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02e2247c-4045-45ff-b455-46f605ecc137) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: INFO os_vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:da:9b,bridge_name='br-int',has_traffic_filtering=True,id=07b88a64-c3ce-41e1-a8c5-9a394f06f0a6,network=Network(865235f1-8989-4cb4-ab36-9030808c709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07b88a64-c3')
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6756804-11a1-42a7-a432-bd0829d6dea0", "address": "fa:16:3e:0a:93:81", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6756804-11", "ovs_interfaceid": "d6756804-11a1-42a7-a432-bd0829d6dea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "d6756804-11a1-42a7-a432-bd0829d6dea0", "address": "fa:16:3e:0a:93:81", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6756804-11", "ovs_interfaceid": "d6756804-11a1-42a7-a432-bd0829d6dea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:93:81,bridge_name='br-int',has_traffic_filtering=True,id=d6756804-11a1-42a7-a432-bd0829d6dea0,network=Network(d0787d74-357e-438a-9f2c-5246827263ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6756804-11') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG os_vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:93:81,bridge_name='br-int',has_traffic_filtering=True,id=d6756804-11a1-42a7-a432-bd0829d6dea0,network=Network(d0787d74-357e-438a-9f2c-5246827263ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6756804-11') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6756804-11, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=229a6a7f-7b66-4b94-b767-a90dbe12a7e9) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:43 user nova-compute[74630]: INFO os_vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:93:81,bridge_name='br-int',has_traffic_filtering=True,id=d6756804-11a1-42a7-a432-bd0829d6dea0,network=Network(d0787d74-357e-438a-9f2c-5246827263ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6756804-11')
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:21:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-890194570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-890194570',id=12,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD4uxsTsVCV6lTfIW55QhuTXIJftFniM3dT/EynODn4Ly0t0OEO3h8T8RYGb6bQDMAo26XRPNHpBntNS85LIZLi4eMIShppPoNKx0ANhL9GiInLFn3pttF3ZUeAQx/9yQ==',key_name='tempest-keypair-1679491166',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab9f996fcad8409981bf1093a0a48c0c',ramdisk_id='',reservation_id='r-0ux1smli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268455053',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268455053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32312445505b4992826f937b5c080395',uuid=2d851c9c-c56c-4be0-ac59-ea59ea9304c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "address": "fa:16:3e:cb:c8:46", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff80c83f-f6", "ovs_interfaceid": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converting VIF {"id": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "address": "fa:16:3e:cb:c8:46", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff80c83f-f6", "ovs_interfaceid": "ff80c83f-f62c-4f70-a9ca-add8c4a366fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c8:46,bridge_name='br-int',has_traffic_filtering=True,id=ff80c83f-f62c-4f70-a9ca-add8c4a366fd,network=Network(d0787d74-357e-438a-9f2c-5246827263ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff80c83f-f6') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c8:46,bridge_name='br-int',has_traffic_filtering=True,id=ff80c83f-f62c-4f70-a9ca-add8c4a366fd,network=Network(d0787d74-357e-438a-9f2c-5246827263ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff80c83f-f6') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff80c83f-f6, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8f60c64-20e4-490c-ade1-e5335fcfc03c) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:43 user nova-compute[74630]: INFO os_vif [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c8:46,bridge_name='br-int',has_traffic_filtering=True,id=ff80c83f-f62c-4f70-a9ca-add8c4a366fd,network=Network(d0787d74-357e-438a-9f2c-5246827263ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff80c83f-f6')
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Sultmbad', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:24:43 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4241459e-7055-4dc6-b406-fa422b3ba244]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:24:43 user nova-compute[74630]: No targets found.
Oct 26 03:24:43 user nova-compute[74630]: iSNS:
Oct 26 03:24:43 user nova-compute[74630]: No targets found.
Oct 26 03:24:43 user nova-compute[74630]: STATIC:
Oct 26 03:24:43 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:24:43 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:43 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:43 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417
Oct 26 03:24:43 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:43 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:43 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550
Oct 26 03:24:43 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:43 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:43 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea
Oct 26 03:24:43 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:43 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:43 user nova-compute[74630]: FIRMWARE:
Oct 26 03:24:43 user nova-compute[74630]: No targets found.
Oct 26 03:24:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:24:43 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:24:43 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0a7dba-3771-4cf4-916e-adf1b7626641]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-bf5f9227-19d4-480f-bdda-d8d839b63030 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-bf5f9227-19d4-480f-bdda-d8d839b63030 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:43 user nova-compute[74630]: WARNING nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-bf5f9227-19d4-480f-bdda-d8d839b63030 for instance with vm_state active and task_state deleting.
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-unplugged-d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-unplugged-d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-unplugged-d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:43 user nova-compute[74630]: WARNING nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 for instance with vm_state active and task_state deleting.
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-unplugged-d6756804-11a1-42a7-a432-bd0829d6dea0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-unplugged-d6756804-11a1-42a7-a432-bd0829d6dea0 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-unplugged-d6756804-11a1-42a7-a432-bd0829d6dea0 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-d6756804-11a1-42a7-a432-bd0829d6dea0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-d6756804-11a1-42a7-a432-bd0829d6dea0 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:43 user nova-compute[74630]: WARNING nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-d6756804-11a1-42a7-a432-bd0829d6dea0 for instance with vm_state active and task_state deleting.
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-unplugged-ff80c83f-f62c-4f70-a9ca-add8c4a366fd {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-unplugged-ff80c83f-f62c-4f70-a9ca-add8c4a366fd {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-unplugged-ff80c83f-f62c-4f70-a9ca-add8c4a366fd for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-ff80c83f-f62c-4f70-a9ca-add8c4a366fd {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-ff80c83f-f62c-4f70-a9ca-add8c4a366fd {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:43 user nova-compute[74630]: WARNING nova.compute.manager [req-b2ac3fb2-d606-40e3-87ab-0d97121b8c3d req-7187e748-1a9d-4bac-a1d3-e7f65d919ba8 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-ff80c83f-f62c-4f70-a9ca-add8c4a366fd for instance with vm_state active and task_state deleting.
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7228efa2-789f-43b4-a9e3-39d32bc6c8cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:24:43 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:24:43 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:24:43 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:24:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:24:43 user nova-compute[74630]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 (non-flash)
Oct 26 03:24:43 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:24:43 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:24:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c22da20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550'): ({'sdc'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Removing single pathed devices sdc {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a848d0b7-7c78-4d11-9b7f-2eb3accdca57]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc87c3a-c02d-4e3a-911e-c0b1a9c48c7a]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Flushing IO for device /dev/sdc {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ecb3b1-6baf-45d8-8ff1-53b3e69a1a08]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[79807609-a09d-4dd4-a26e-847e2ebbdd92]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.116s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c570cc8-db1d-4204-ab9f-ebfa21ecba21]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f14ced-85fe-417b-a8b0-e9b41c11a4b3]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550, portal: 172.16.0.220,3260]
Oct 26 03:24:43 user nova-compute[74630]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550, portal: 172.16.0.220,3260] successful.
Oct 26 03:24:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fc789f-3bdc-4f37-925a-5e1e646e2550 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77f8958-a0b9-4646-9945-ba18932185ea]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.459s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] <== disconnect_volume: return (461ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oVCNKUvM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:24:43 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.network.neutron [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Port b965ee06-ed93-40fc-9732-974c808f5c36 binding to destination host user is already ACTIVE {{(pid=74630) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4eb07ad-ab50-4cf8-b849-67a16b64c7c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:24:43 user nova-compute[74630]: No targets found.
Oct 26 03:24:43 user nova-compute[74630]: iSNS:
Oct 26 03:24:43 user nova-compute[74630]: No targets found.
Oct 26 03:24:43 user nova-compute[74630]: STATIC:
Oct 26 03:24:43 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:24:43 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:43 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:43 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417
Oct 26 03:24:43 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:43 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:43 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea
Oct 26 03:24:43 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:43 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:43 user nova-compute[74630]: FIRMWARE:
Oct 26 03:24:43 user nova-compute[74630]: No targets found.
Oct 26 03:24:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:24:43 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:24:43 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ec3047-9dbf-4b0f-90c8-46643f833d3a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9210a6-04cd-4f6e-9453-df517b869dc8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:24:43 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:24:43 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:24:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:24:43 user nova-compute[74630]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea (non-flash)
Oct 26 03:24:43 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:24:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f318464f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea'): ({'sdf'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Removing single pathed devices sdf {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-f73524aa-cc23-4e04-a42b-ffffc90cb262 req-ccc9d248-9fff-45d2-af50-b728c0e54bd2 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-plugged-07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f73524aa-cc23-4e04-a42b-ffffc90cb262 req-ccc9d248-9fff-45d2-af50-b728c0e54bd2 service nova] Acquiring lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f73524aa-cc23-4e04-a42b-ffffc90cb262 req-ccc9d248-9fff-45d2-af50-b728c0e54bd2 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f73524aa-cc23-4e04-a42b-ffffc90cb262 req-ccc9d248-9fff-45d2-af50-b728c0e54bd2 service nova] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-f73524aa-cc23-4e04-a42b-ffffc90cb262 req-ccc9d248-9fff-45d2-af50-b728c0e54bd2 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] No waiting events found dispatching network-vif-plugged-07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:24:43 user nova-compute[74630]: WARNING nova.compute.manager [req-f73524aa-cc23-4e04-a42b-ffffc90cb262 req-ccc9d248-9fff-45d2-af50-b728c0e54bd2 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received unexpected event network-vif-plugged-07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 for instance with vm_state active and task_state deleting.
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c070e55e-d344-4889-8bbe-ec7ea83e2912]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e5ec46-f0e7-49ef-8178-82093ddfb0d8]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Flushing IO for device /dev/sdf {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dce4d2-293e-431f-9133-41d4fa80fbea]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aed6b9c-1b36-4208-8f23-850eb22413e2]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] SCSI volumes sdf have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf622ea-9a1c-4051-8abd-65e727974927]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquired lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.network.neutron [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d924d8-1cff-45cb-ab8c-9bba94499c5b]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea, portal: 172.16.0.220,3260]
Oct 26 03:24:43 user nova-compute[74630]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea, portal: 172.16.0.220,3260] successful.
Oct 26 03:24:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b40ba2fd-80b5-4121-88a1-27603fb56fea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9187618c-0564-4ae0-8378-fb41e9d3e55d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] <== disconnect_volume: return (339ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oQxOdzaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:24:43 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a513c9-cef3-43b5-bae8-95db1f6a4683]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:24:43 user nova-compute[74630]: No targets found.
Oct 26 03:24:43 user nova-compute[74630]: iSNS:
Oct 26 03:24:43 user nova-compute[74630]: No targets found.
Oct 26 03:24:43 user nova-compute[74630]: STATIC:
Oct 26 03:24:43 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:24:43 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:43 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:43 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417
Oct 26 03:24:43 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:24:43 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:24:43 user nova-compute[74630]: FIRMWARE:
Oct 26 03:24:43 user nova-compute[74630]: No targets found.
Oct 26 03:24:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:24:43 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:24:43 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84e9ce5-e4cc-4698-92ea-1cfc0d5ee005]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[022faa3e-19d2-4eb9-9703-b6d39937003c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:24:43 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:24:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:24:43 user nova-compute[74630]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 (non-flash)
Oct 26 03:24:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f318464f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417'): ({'sdg'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Removing single pathed devices sdg {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cef79b-fb35-4507-9019-a2ae3811123a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4e72ba-8a9b-463f-b385-6b22b6dc401f]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Flushing IO for device /dev/sdg {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbdfb06-80c0-4248-90ed-5e10a56be23d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:24:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0292f6a-2536-46bf-b6bf-d4517d80d8d3]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] SCSI volumes sdg have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfb45e9-7ce2-4400-9fff-107ed8e4eb94]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f5438c-d01c-4211-8ddb-03362c553dc1]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417, portal: 172.16.0.220,3260]
Oct 26 03:24:44 user nova-compute[74630]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417, portal: 172.16.0.220,3260] successful.
Oct 26 03:24:44 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec4b8394-e12d-48f4-9c06-54b8ef848417 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[44966977-a713-42d4-8eb6-0451c62773ba]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] <== disconnect_volume: return (292ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:24:44 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Deleting instance files /opt/stack/data/nova/instances/2d851c9c-c56c-4be0-ac59-ea59ea9304c2_del
Oct 26 03:24:44 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Deletion of /opt/stack/data/nova/instances/2d851c9c-c56c-4be0-ac59-ea59ea9304c2_del complete
Oct 26 03:24:44 user nova-compute[74630]: INFO nova.compute.manager [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Took 3.59 seconds to destroy the instance on the hypervisor.
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG nova.network.neutron [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updating instance_info_cache with network_info: [{"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Releasing lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG os_brick.utils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22e5782-5e15-468b-ba2e-1f850d6fea43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3883d4-039d-4c01-8a70-9a7afc8c66da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b8f052-825f-4932-9311-1b0b21a04748]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed370e6b-7986-4171-b8e4-e37e6dd23785]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:24:44 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:24:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a16540-2789-4c9b-8877-aa3eecaf7504]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:24:44 user nova-compute[74630]: DEBUG os_brick.utils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:24:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-a9da82ff-1858-4afd-8f02-3cc16a521805 req-5bdf4f9a-a911-4e15-99cb-53b6e35605b4 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-deleted-ff80c83f-f62c-4f70-a9ca-add8c4a366fd {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:46 user nova-compute[74630]: INFO nova.compute.manager [req-a9da82ff-1858-4afd-8f02-3cc16a521805 req-5bdf4f9a-a911-4e15-99cb-53b6e35605b4 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Neutron deleted interface ff80c83f-f62c-4f70-a9ca-add8c4a366fd; detaching it from the instance and deleting it from the info cache
Oct 26 03:24:46 user nova-compute[74630]: DEBUG nova.network.neutron [req-a9da82ff-1858-4afd-8f02-3cc16a521805 req-5bdf4f9a-a911-4e15-99cb-53b6e35605b4 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updating instance_info_cache with network_info: [{"id": "bf5f9227-19d4-480f-bdda-d8d839b63030", "address": "fa:16:3e:99:96:bd", "network": {"id": "dedcc9a6-6646-41dd-aaf9-a9cc1f2ef7b1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1333134059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf5f9227-19", "ovs_interfaceid": "bf5f9227-19d4-480f-bdda-d8d839b63030", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "address": "fa:16:3e:b0:a9:f6", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209ed9aa-b6", "ovs_interfaceid": "209ed9aa-b6ea-4103-8231-7f6380f5d187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "address": "fa:16:3e:ad:f4:1d", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap812b7cf9-19", "ovs_interfaceid": "812b7cf9-199e-458a-93f5-3a73dfe4a05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "address": "fa:16:3e:94:57:f1", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03b6f6f-4e", "ovs_interfaceid": "d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "address": "fa:16:3e:b9:da:9b", "network": {"id": "865235f1-8989-4cb4-ab36-9030808c709c", "bridge": "br-int", "label": "tempest-device-tagging-net1-889560940", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07b88a64-c3", "ovs_interfaceid": "07b88a64-c3ce-41e1-a8c5-9a394f06f0a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6756804-11a1-42a7-a432-bd0829d6dea0", "address": "fa:16:3e:0a:93:81", "network": {"id": "d0787d74-357e-438a-9f2c-5246827263ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624441287", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ab9f996fcad8409981bf1093a0a48c0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6756804-11", "ovs_interfaceid": "d6756804-11a1-42a7-a432-bd0829d6dea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-a9da82ff-1858-4afd-8f02-3cc16a521805 req-5bdf4f9a-a911-4e15-99cb-53b6e35605b4 service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Detach interface failed, port_id=ff80c83f-f62c-4f70-a9ca-add8c4a366fd, reason: Instance 2d851c9c-c56c-4be0-ac59-ea59ea9304c2 could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 03:24:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:47 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:24:47 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Took 3.73 seconds to deallocate network for instance.
Oct 26 03:24:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-6357e634-2719-4292-8875-5f2777408501 req-50717531-e193-497c-ba72-4f3a769c66ff service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-deleted-d03b6f6f-4ee5-4759-ad3b-aca2d8256dd1 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-6357e634-2719-4292-8875-5f2777408501 req-50717531-e193-497c-ba72-4f3a769c66ff service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-deleted-07b88a64-c3ce-41e1-a8c5-9a394f06f0a6 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-6357e634-2719-4292-8875-5f2777408501 req-50717531-e193-497c-ba72-4f3a769c66ff service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-deleted-d6756804-11a1-42a7-a432-bd0829d6dea0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-6357e634-2719-4292-8875-5f2777408501 req-50717531-e193-497c-ba72-4f3a769c66ff service nova] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Received event network-vif-deleted-bf5f9227-19d4-480f-bdda-d8d839b63030 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:24:51 user nova-compute[74630]: INFO nova.compute.manager [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] [instance: 2d851c9c-c56c-4be0-ac59-ea59ea9304c2] Took 3.08 seconds to detach 3 volumes for instance.
Oct 26 03:24:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:24:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:24:51 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:24:51 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:24:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.531s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:51 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Deleted allocations for instance 2d851c9c-c56c-4be0-ac59-ea59ea9304c2
Oct 26 03:24:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-264bae65-4a0c-4405-a370-fb29462745f6 tempest-TaggedBootDevicesTest_v242-1268455053 tempest-TaggedBootDevicesTest_v242-1268455053-project-member] Lock "2d851c9c-c56c-4be0-ac59-ea59ea9304c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.175s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:24:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:24:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:24:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:24:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:24:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:24:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:25:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:25:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:25:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:25:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Starting finish_migration {{(pid=74630) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 26 03:25:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Instance directory exists: not creating {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 03:25:03 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Creating image(s)
Oct 26 03:25:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:03 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk. size=21474836480 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:25:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk 21474836480 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk 21474836480" returned: 0 in 0.056s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Ensure instance console log exists: /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Start _get_guest_xml network_info=[{"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-120532424-network", "vif_mac": "fa:16:3e:51:30:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxkXluOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '65ff804f-8b98-406d-8c5c-3d73bb52ff18', 'attached_at': '2023-10-26T03:25:03.000000', 'detached_at': '', 'volume_id': '173e4b04-308c-4ada-b18c-8539105cb677', 'serial': '173e4b04-308c-4ada-b18c-8539105cb677'}, 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'c088d5bd-a66a-45f6-af1a-a5a8670e410e', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:25:04 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:25:04 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxkXluOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:25:04 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:25:04 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:25:04 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a87d72-b751-4c43-a056-d65e59f5028a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:25:04 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[88658e1e-74d3-4e15-9383-6d7d80351e60]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677] added
Oct 26 03:25:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[67328b37-e22e-4bd7-9c7a-ed48374a65ea]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[717ce45e-850e-471e-bf8e-1fbcb401dedd]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxkXluOe {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxkXluOe" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dd2c3b-a8fd-4360-b9a5-5ccf33d80f19]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wxkXluOe'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[584fce83-d6fa-4709-9623-390e9ff56a59]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c98fe20-45ed-4ef6-ab04-ef069508a958]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:25:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:25:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e007c3-9dd6-4416-8732-fe3ef5ccf64e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260]
Oct 26 03:25:04 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260] successful.
Oct 26 03:25:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3c9b1a-9a1b-4f5b-85a6-e7d7bc7ce983]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[623088c8-4ae5-492d-ba60-188ce152f439]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:25:04 user nova-compute[74630]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:25:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:25:04 user nova-compute[74630]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:25:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8896acba-e4f7-4eee-b025-f8c6ba23c2d8]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:04 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxkXluOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23438363938663231', 'path': '/dev/sdc'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438363938663231', 'path': '/dev/sdc'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1501494997',display_name='tempest-ServerActionsTestOtherB-server-1501494997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1501494997',id=5,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFIeBoj6ZVV6vjKZ5C8Qtaf45gZ5VQLu8uYxcKaMISZ7A/ITCT4P2Cxj8DgdsT8tNJFXq2qSIv9+4+e1q0xZrix9FhWGUlPhtxOjh9fvNN5qcQ+ZdFKB+/mBI3I8ldOaQ==',key_name='tempest-keypair-565299267',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:20:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='03fc5bdbf0b947b49f6a6c8d44630ed5',ramdisk_id='',reservation_id='r-4c005us9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-638189769',owner_user_name='tempest-ServerActionsTestOtherB-638189769-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e27a2c56890d4be0a3fb46bd748fa7cf',uuid=65ff804f-8b98-406d-8c5c-3d73bb52ff18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-120532424-network", "vif_mac": "fa:16:3e:51:30:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converting VIF {"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-120532424-network", "vif_mac": "fa:16:3e:51:30:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:25:05 user nova-compute[74630]:   <uuid>65ff804f-8b98-406d-8c5c-3d73bb52ff18</uuid>
Oct 26 03:25:05 user nova-compute[74630]:   <name>instance-00000005</name>
Oct 26 03:25:05 user nova-compute[74630]:   <memory>2097152</memory>
Oct 26 03:25:05 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:25:05 user nova-compute[74630]:   <metadata>
Oct 26 03:25:05 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:25:05 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:25:05 user nova-compute[74630]:       <nova:name>tempest-ServerActionsTestOtherB-server-1501494997</nova:name>
Oct 26 03:25:05 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:25:04</nova:creationTime>
Oct 26 03:25:05 user nova-compute[74630]:       <nova:flavor name="m1.small">
Oct 26 03:25:05 user nova-compute[74630]:         <nova:memory>2048</nova:memory>
Oct 26 03:25:05 user nova-compute[74630]:         <nova:disk>20</nova:disk>
Oct 26 03:25:05 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:25:05 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:25:05 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:25:05 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:25:05 user nova-compute[74630]:       <nova:owner>
Oct 26 03:25:05 user nova-compute[74630]:         <nova:user uuid="e27a2c56890d4be0a3fb46bd748fa7cf">tempest-ServerActionsTestOtherB-638189769-project-member</nova:user>
Oct 26 03:25:05 user nova-compute[74630]:         <nova:project uuid="03fc5bdbf0b947b49f6a6c8d44630ed5">tempest-ServerActionsTestOtherB-638189769</nova:project>
Oct 26 03:25:05 user nova-compute[74630]:       </nova:owner>
Oct 26 03:25:05 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:25:05 user nova-compute[74630]:       <nova:ports>
Oct 26 03:25:05 user nova-compute[74630]:         <nova:port uuid="b965ee06-ed93-40fc-9732-974c808f5c36">
Oct 26 03:25:05 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 03:25:05 user nova-compute[74630]:         </nova:port>
Oct 26 03:25:05 user nova-compute[74630]:       </nova:ports>
Oct 26 03:25:05 user nova-compute[74630]:     </nova:instance>
Oct 26 03:25:05 user nova-compute[74630]:   </metadata>
Oct 26 03:25:05 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:25:05 user nova-compute[74630]:     <system>
Oct 26 03:25:05 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:25:05 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:25:05 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:25:05 user nova-compute[74630]:       <entry name="serial">65ff804f-8b98-406d-8c5c-3d73bb52ff18</entry>
Oct 26 03:25:05 user nova-compute[74630]:       <entry name="uuid">65ff804f-8b98-406d-8c5c-3d73bb52ff18</entry>
Oct 26 03:25:05 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:25:05 user nova-compute[74630]:     </system>
Oct 26 03:25:05 user nova-compute[74630]:   </sysinfo>
Oct 26 03:25:05 user nova-compute[74630]:   <os>
Oct 26 03:25:05 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:25:05 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:25:05 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:25:05 user nova-compute[74630]:   </os>
Oct 26 03:25:05 user nova-compute[74630]:   <features>
Oct 26 03:25:05 user nova-compute[74630]:     <acpi/>
Oct 26 03:25:05 user nova-compute[74630]:     <apic/>
Oct 26 03:25:05 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:25:05 user nova-compute[74630]:   </features>
Oct 26 03:25:05 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:25:05 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:25:05 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:25:05 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:25:05 user nova-compute[74630]:   </clock>
Oct 26 03:25:05 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:25:05 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:25:05 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:25:05 user nova-compute[74630]:   </cpu>
Oct 26 03:25:05 user nova-compute[74630]:   <devices>
Oct 26 03:25:05 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:25:05 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:25:05 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk"/>
Oct 26 03:25:05 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:25:05 user nova-compute[74630]:     </disk>
Oct 26 03:25:05 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:25:05 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:25:05 user nova-compute[74630]:       <source dev="/dev/sdc"/>
Oct 26 03:25:05 user nova-compute[74630]:       <target dev="vdb" bus="virtio"/>
Oct 26 03:25:05 user nova-compute[74630]:       <serial>173e4b04-308c-4ada-b18c-8539105cb677</serial>
Oct 26 03:25:05 user nova-compute[74630]:     </disk>
Oct 26 03:25:05 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:25:05 user nova-compute[74630]:       <mac address="fa:16:3e:51:30:8c"/>
Oct 26 03:25:05 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:25:05 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:25:05 user nova-compute[74630]:       <target dev="tapb965ee06-ed"/>
Oct 26 03:25:05 user nova-compute[74630]:     </interface>
Oct 26 03:25:05 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:25:05 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/console.log" append="off"/>
Oct 26 03:25:05 user nova-compute[74630]:     </serial>
Oct 26 03:25:05 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:25:05 user nova-compute[74630]:     <video>
Oct 26 03:25:05 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:25:05 user nova-compute[74630]:     </video>
Oct 26 03:25:05 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:25:05 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:25:05 user nova-compute[74630]:     </rng>
Oct 26 03:25:05 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:25:05 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:25:05 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:25:05 user nova-compute[74630]:     </memballoon>
Oct 26 03:25:05 user nova-compute[74630]:   </devices>
Oct 26 03:25:05 user nova-compute[74630]: </domain>
Oct 26 03:25:05 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1501494997',display_name='tempest-ServerActionsTestOtherB-server-1501494997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1501494997',id=5,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFIeBoj6ZVV6vjKZ5C8Qtaf45gZ5VQLu8uYxcKaMISZ7A/ITCT4P2Cxj8DgdsT8tNJFXq2qSIv9+4+e1q0xZrix9FhWGUlPhtxOjh9fvNN5qcQ+ZdFKB+/mBI3I8ldOaQ==',key_name='tempest-keypair-565299267',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:20:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='03fc5bdbf0b947b49f6a6c8d44630ed5',ramdisk_id='',reservation_id='r-4c005us9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-638189769',owner_user_name='tempest-ServerActionsTestOtherB-638189769-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e27a2c56890d4be0a3fb46bd748fa7cf',uuid=65ff804f-8b98-406d-8c5c-3d73bb52ff18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-120532424-network", "vif_mac": "fa:16:3e:51:30:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converting VIF {"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-120532424-network", "vif_mac": "fa:16:3e:51:30:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG os_vif [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c29834d-7144-5988-a814-80e3ec70f777', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb965ee06-ed, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb965ee06-ed, col_values=(('qos', UUID('afb4089e-7385-4db8-aefa-e0be6c34aafc')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb965ee06-ed, col_values=(('external_ids', {'iface-id': 'b965ee06-ed93-40fc-9732-974c808f5c36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:30:8c', 'vm-uuid': '65ff804f-8b98-406d-8c5c-3d73bb52ff18'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:05 user nova-compute[74630]: INFO os_vif [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed')
Oct 26 03:25:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:25:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] No VIF found with MAC fa:16:3e:51:30:8c, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:25:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-76aa26c0-2bbe-4f94-b3c7-6a495ef5f2a5 req-e33f3051-29f7-400a-ab68-1c6bb922ca39 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:25:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-76aa26c0-2bbe-4f94-b3c7-6a495ef5f2a5 req-e33f3051-29f7-400a-ab68-1c6bb922ca39 service nova] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-76aa26c0-2bbe-4f94-b3c7-6a495ef5f2a5 req-e33f3051-29f7-400a-ab68-1c6bb922ca39 service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-76aa26c0-2bbe-4f94-b3c7-6a495ef5f2a5 req-e33f3051-29f7-400a-ab68-1c6bb922ca39 service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-76aa26c0-2bbe-4f94-b3c7-6a495ef5f2a5 req-e33f3051-29f7-400a-ab68-1c6bb922ca39 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] No waiting events found dispatching network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:25:07 user nova-compute[74630]: WARNING nova.compute.manager [req-76aa26c0-2bbe-4f94-b3c7-6a495ef5f2a5 req-e33f3051-29f7-400a-ab68-1c6bb922ca39 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received unexpected event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 for instance with vm_state active and task_state resize_finish.
Oct 26 03:25:07 user nova-compute[74630]: INFO nova.compute.manager [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Rescuing
Oct 26 03:25:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:25:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquired lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:25:07 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:25:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Updating instance_info_cache with network_info: [{"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Releasing lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:25:08 user nova-compute[74630]: INFO nova.compute.manager [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Rescuing
Oct 26 03:25:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquired lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG nova.network.neutron [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG nova.compute.manager [req-e407a303-6917-489c-8181-667de4703ce5 req-2d6282dc-e9c4-4d2e-b3f0-e81f2bcbfcc4 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-unplugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e407a303-6917-489c-8181-667de4703ce5 req-2d6282dc-e9c4-4d2e-b3f0-e81f2bcbfcc4 service nova] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e407a303-6917-489c-8181-667de4703ce5 req-2d6282dc-e9c4-4d2e-b3f0-e81f2bcbfcc4 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e407a303-6917-489c-8181-667de4703ce5 req-2d6282dc-e9c4-4d2e-b3f0-e81f2bcbfcc4 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG nova.compute.manager [req-e407a303-6917-489c-8181-667de4703ce5 req-2d6282dc-e9c4-4d2e-b3f0-e81f2bcbfcc4 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] No waiting events found dispatching network-vif-unplugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:25:08 user nova-compute[74630]: WARNING nova.compute.manager [req-e407a303-6917-489c-8181-667de4703ce5 req-2d6282dc-e9c4-4d2e-b3f0-e81f2bcbfcc4 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received unexpected event network-vif-unplugged-13707b78-ccef-402c-9d27-d6897b1eacf3 for instance with vm_state active and task_state rescuing.
Oct 26 03:25:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG nova.network.neutron [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Updating instance_info_cache with network_info: [{"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:25:08 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Instance destroyed successfully.
Oct 26 03:25:08 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Attempting rescue
Oct 26 03:25:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74630) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Releasing lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Instance directory exists: not creating {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 03:25:08 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Creating image(s)
Oct 26 03:25:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "/opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "/opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "/opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'trusted_certs' on Instance uuid 32264781-acf7-4afa-830a-5469b6a4c744 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.210s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.rescue {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.rescue" returned: 0 in 0.057s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'migration_context' on Instance uuid 32264781-acf7-4afa-830a-5469b6a4c744 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.objects.base [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Object Instance<32264781-acf7-4afa-830a-5469b6a4c744> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Start _get_guest_xml network_info=[{"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "vif_mac": "fa:16:3e:3d:25:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'resources' on Instance uuid 32264781-acf7-4afa-830a-5469b6a4c744 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.objects.base [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Object Instance<32264781-acf7-4afa-830a-5469b6a4c744> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'numa_topology' on Instance uuid 32264781-acf7-4afa-830a-5469b6a4c744 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.objects.base [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Object Instance<32264781-acf7-4afa-830a-5469b6a4c744> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:25:09 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:25:09 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'vcpu_model' on Instance uuid 32264781-acf7-4afa-830a-5469b6a4c744 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.objects.base [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Object Instance<32264781-acf7-4afa-830a-5469b6a4c744> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1719517014',display_name='tempest-ServerRescueNegativeTestJSON-server-1719517014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1719517014',id=4,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:20:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b652c6f02780451b89d51d74178bf6c7',ramdisk_id='',reservation_id='r-q4jggfxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2117587238',owner_user_name='tempest-ServerRescueNegativeTestJSON-2117587238-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:20:38Z,user_data=None,user_id='62370747d10a420b81009d23e3ba324b',uuid=32264781-acf7-4afa-830a-5469b6a4c744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "vif_mac": "fa:16:3e:3d:25:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converting VIF {"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "vif_mac": "fa:16:3e:3d:25:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:25:1b,bridge_name='br-int',has_traffic_filtering=True,id=13707b78-ccef-402c-9d27-d6897b1eacf3,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13707b78-cc') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'pci_devices' on Instance uuid 32264781-acf7-4afa-830a-5469b6a4c744 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.objects.base [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Object Instance<32264781-acf7-4afa-830a-5469b6a4c744> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:25:09 user nova-compute[74630]:   <uuid>32264781-acf7-4afa-830a-5469b6a4c744</uuid>
Oct 26 03:25:09 user nova-compute[74630]:   <name>instance-00000004</name>
Oct 26 03:25:09 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:25:09 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:25:09 user nova-compute[74630]:   <metadata>
Oct 26 03:25:09 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:25:09 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:25:09 user nova-compute[74630]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1719517014</nova:name>
Oct 26 03:25:09 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:25:09</nova:creationTime>
Oct 26 03:25:09 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:25:09 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:25:09 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:25:09 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:25:09 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:25:09 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:25:09 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:25:09 user nova-compute[74630]:       <nova:owner>
Oct 26 03:25:09 user nova-compute[74630]:         <nova:user uuid="62370747d10a420b81009d23e3ba324b">tempest-ServerRescueNegativeTestJSON-2117587238-project-member</nova:user>
Oct 26 03:25:09 user nova-compute[74630]:         <nova:project uuid="b652c6f02780451b89d51d74178bf6c7">tempest-ServerRescueNegativeTestJSON-2117587238</nova:project>
Oct 26 03:25:09 user nova-compute[74630]:       </nova:owner>
Oct 26 03:25:09 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:25:09 user nova-compute[74630]:       <nova:ports>
Oct 26 03:25:09 user nova-compute[74630]:         <nova:port uuid="13707b78-ccef-402c-9d27-d6897b1eacf3">
Oct 26 03:25:09 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 03:25:09 user nova-compute[74630]:         </nova:port>
Oct 26 03:25:09 user nova-compute[74630]:       </nova:ports>
Oct 26 03:25:09 user nova-compute[74630]:     </nova:instance>
Oct 26 03:25:09 user nova-compute[74630]:   </metadata>
Oct 26 03:25:09 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:25:09 user nova-compute[74630]:     <system>
Oct 26 03:25:09 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:25:09 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:25:09 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:25:09 user nova-compute[74630]:       <entry name="serial">32264781-acf7-4afa-830a-5469b6a4c744</entry>
Oct 26 03:25:09 user nova-compute[74630]:       <entry name="uuid">32264781-acf7-4afa-830a-5469b6a4c744</entry>
Oct 26 03:25:09 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:25:09 user nova-compute[74630]:     </system>
Oct 26 03:25:09 user nova-compute[74630]:   </sysinfo>
Oct 26 03:25:09 user nova-compute[74630]:   <os>
Oct 26 03:25:09 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:25:09 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:25:09 user nova-compute[74630]:   </os>
Oct 26 03:25:09 user nova-compute[74630]:   <features>
Oct 26 03:25:09 user nova-compute[74630]:     <acpi/>
Oct 26 03:25:09 user nova-compute[74630]:     <apic/>
Oct 26 03:25:09 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:25:09 user nova-compute[74630]:   </features>
Oct 26 03:25:09 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:25:09 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:25:09 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:25:09 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:25:09 user nova-compute[74630]:   </clock>
Oct 26 03:25:09 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:25:09 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:25:09 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:25:09 user nova-compute[74630]:   </cpu>
Oct 26 03:25:09 user nova-compute[74630]:   <devices>
Oct 26 03:25:09 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:25:09 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:25:09 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.rescue"/>
Oct 26 03:25:09 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:25:09 user nova-compute[74630]:     </disk>
Oct 26 03:25:09 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:25:09 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:25:09 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk"/>
Oct 26 03:25:09 user nova-compute[74630]:       <target dev="vdb" bus="virtio"/>
Oct 26 03:25:09 user nova-compute[74630]:     </disk>
Oct 26 03:25:09 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:25:09 user nova-compute[74630]:       <mac address="fa:16:3e:3d:25:1b"/>
Oct 26 03:25:09 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:25:09 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:25:09 user nova-compute[74630]:       <target dev="tap13707b78-cc"/>
Oct 26 03:25:09 user nova-compute[74630]:     </interface>
Oct 26 03:25:09 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:25:09 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/console.log" append="off"/>
Oct 26 03:25:09 user nova-compute[74630]:     </serial>
Oct 26 03:25:09 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:25:09 user nova-compute[74630]:     <video>
Oct 26 03:25:09 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:25:09 user nova-compute[74630]:     </video>
Oct 26 03:25:09 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:25:09 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:25:09 user nova-compute[74630]:     </rng>
Oct 26 03:25:09 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:25:09 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:25:09 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:25:09 user nova-compute[74630]:     </memballoon>
Oct 26 03:25:09 user nova-compute[74630]:   </devices>
Oct 26 03:25:09 user nova-compute[74630]: </domain>
Oct 26 03:25:09 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:25:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Instance destroyed successfully.
Oct 26 03:25:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No VIF found with MAC fa:16:3e:3d:25:1b, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:25:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Instance running successfully.
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Failed to set time: agent not configured {{(pid=74630) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6e4dd752-fc8e-40ff-a8d4-7da1322731a6 tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] finish_migration finished successfully. {{(pid=74630) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-3ac4391a-82e9-461a-811d-a97a0827aeed req-abd122be-3b66-4df2-8a30-2c99d71cbf4d service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received event network-vif-unplugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3ac4391a-82e9-461a-811d-a97a0827aeed req-abd122be-3b66-4df2-8a30-2c99d71cbf4d service nova] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3ac4391a-82e9-461a-811d-a97a0827aeed req-abd122be-3b66-4df2-8a30-2c99d71cbf4d service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3ac4391a-82e9-461a-811d-a97a0827aeed req-abd122be-3b66-4df2-8a30-2c99d71cbf4d service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-3ac4391a-82e9-461a-811d-a97a0827aeed req-abd122be-3b66-4df2-8a30-2c99d71cbf4d service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] No waiting events found dispatching network-vif-unplugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:25:09 user nova-compute[74630]: WARNING nova.compute.manager [req-3ac4391a-82e9-461a-811d-a97a0827aeed req-abd122be-3b66-4df2-8a30-2c99d71cbf4d service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received unexpected event network-vif-unplugged-09559581-1c5c-4bee-90ea-fb70ae613d86 for instance with vm_state active and task_state rescuing.
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-9a6f7f3c-69bd-4a0d-9e22-75b698f43345 req-262539e1-15ea-4f46-8075-f10b49e47292 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9a6f7f3c-69bd-4a0d-9e22-75b698f43345 req-262539e1-15ea-4f46-8075-f10b49e47292 service nova] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9a6f7f3c-69bd-4a0d-9e22-75b698f43345 req-262539e1-15ea-4f46-8075-f10b49e47292 service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9a6f7f3c-69bd-4a0d-9e22-75b698f43345 req-262539e1-15ea-4f46-8075-f10b49e47292 service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-9a6f7f3c-69bd-4a0d-9e22-75b698f43345 req-262539e1-15ea-4f46-8075-f10b49e47292 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] No waiting events found dispatching network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:25:09 user nova-compute[74630]: WARNING nova.compute.manager [req-9a6f7f3c-69bd-4a0d-9e22-75b698f43345 req-262539e1-15ea-4f46-8075-f10b49e47292 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received unexpected event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 for instance with vm_state active and task_state resize_finish.
Oct 26 03:25:10 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Instance destroyed successfully.
Oct 26 03:25:10 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Attempting a stable device rescue
Oct 26 03:25:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74630) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 03:25:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Instance directory exists: not creating {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 03:25:10 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Creating image(s)
Oct 26 03:25:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "/opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "/opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "/opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:10 user nova-compute[74630]: DEBUG nova.objects.instance [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'trusted_certs' on Instance uuid 40316e54-eee2-4072-b436-4c5bb31724a9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:25:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "70c673dbb9add57fbc24d5ffcb5343901ca2b04b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "70c673dbb9add57fbc24d5ffcb5343901ca2b04b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70c673dbb9add57fbc24d5ffcb5343901ca2b04b.part --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-0eea069d-61b5-47ca-9322-36aa5615b6c5 req-5c98cdb1-3301-4266-8a5b-72c5ba7ddb9e service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0eea069d-61b5-47ca-9322-36aa5615b6c5 req-5c98cdb1-3301-4266-8a5b-72c5ba7ddb9e service nova] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0eea069d-61b5-47ca-9322-36aa5615b6c5 req-5c98cdb1-3301-4266-8a5b-72c5ba7ddb9e service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0eea069d-61b5-47ca-9322-36aa5615b6c5 req-5c98cdb1-3301-4266-8a5b-72c5ba7ddb9e service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-0eea069d-61b5-47ca-9322-36aa5615b6c5 req-5c98cdb1-3301-4266-8a5b-72c5ba7ddb9e service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] No waiting events found dispatching network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:25:11 user nova-compute[74630]: WARNING nova.compute.manager [req-0eea069d-61b5-47ca-9322-36aa5615b6c5 req-5c98cdb1-3301-4266-8a5b-72c5ba7ddb9e service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received unexpected event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 for instance with vm_state active and task_state rescuing.
Oct 26 03:25:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70c673dbb9add57fbc24d5ffcb5343901ca2b04b.part --force-share --output=json" returned: 0 in 0.322s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG nova.virt.images [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] a3542df9-ba1c-4d9c-99bf-16a32648271c was qcow2, converting to raw {{(pid=74630) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/70c673dbb9add57fbc24d5ffcb5343901ca2b04b.part /opt/stack/data/nova/instances/_base/70c673dbb9add57fbc24d5ffcb5343901ca2b04b.converted {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-25b607c8-9040-4b43-98b7-b5c1296a9338 req-e245e5ee-90ae-4d28-994b-6eda14c6ec1e service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-25b607c8-9040-4b43-98b7-b5c1296a9338 req-e245e5ee-90ae-4d28-994b-6eda14c6ec1e service nova] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-25b607c8-9040-4b43-98b7-b5c1296a9338 req-e245e5ee-90ae-4d28-994b-6eda14c6ec1e service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-25b607c8-9040-4b43-98b7-b5c1296a9338 req-e245e5ee-90ae-4d28-994b-6eda14c6ec1e service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-25b607c8-9040-4b43-98b7-b5c1296a9338 req-e245e5ee-90ae-4d28-994b-6eda14c6ec1e service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] No waiting events found dispatching network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:25:11 user nova-compute[74630]: WARNING nova.compute.manager [req-25b607c8-9040-4b43-98b7-b5c1296a9338 req-e245e5ee-90ae-4d28-994b-6eda14c6ec1e service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received unexpected event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 for instance with vm_state active and task_state rescuing.
Oct 26 03:25:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/70c673dbb9add57fbc24d5ffcb5343901ca2b04b.part /opt/stack/data/nova/instances/_base/70c673dbb9add57fbc24d5ffcb5343901ca2b04b.converted" returned: 0 in 0.366s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70c673dbb9add57fbc24d5ffcb5343901ca2b04b.converted --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70c673dbb9add57fbc24d5ffcb5343901ca2b04b.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "70c673dbb9add57fbc24d5ffcb5343901ca2b04b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.005s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "70c673dbb9add57fbc24d5ffcb5343901ca2b04b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "70c673dbb9add57fbc24d5ffcb5343901ca2b04b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70c673dbb9add57fbc24d5ffcb5343901ca2b04b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/70c673dbb9add57fbc24d5ffcb5343901ca2b04b --force-share --output=json" returned: 0 in 0.266s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/70c673dbb9add57fbc24d5ffcb5343901ca2b04b,backing_fmt=raw /opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/disk.rescue {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/70c673dbb9add57fbc24d5ffcb5343901ca2b04b,backing_fmt=raw /opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/disk.rescue" returned: 0 in 0.078s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "70c673dbb9add57fbc24d5ffcb5343901ca2b04b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.352s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.objects.instance [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'migration_context' on Instance uuid 40316e54-eee2-4072-b436-4c5bb31724a9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.objects.base [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Object Instance<40316e54-eee2-4072-b436-4c5bb31724a9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Start _get_guest_xml network_info=[{"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "vif_mac": "fa:16:3e:cb:fe:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a3542df9-ba1c-4d9c-99bf-16a32648271c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZSsQfDla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '40316e54-eee2-4072-b436-4c5bb31724a9', 'attached_at': '', 'detached_at': '', 'volume_id': '89dadf3d-bdf3-448e-9b5c-e2613cc0adee', 'serial': '89dadf3d-bdf3-448e-9b5c-e2613cc0adee'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'ba34519e-1b55-404b-b19f-2738c9b2f2fc', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.objects.instance [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'resources' on Instance uuid 40316e54-eee2-4072-b436-4c5bb31724a9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.objects.base [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Object Instance<40316e54-eee2-4072-b436-4c5bb31724a9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.objects.instance [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'numa_topology' on Instance uuid 40316e54-eee2-4072-b436-4c5bb31724a9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.objects.base [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Object Instance<40316e54-eee2-4072-b436-4c5bb31724a9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.compute.manager [req-bba0342d-1dc3-4c9f-a7d9-6aee1def2774 req-0e8ab73a-c943-428f-99f8-39042a062a63 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bba0342d-1dc3-4c9f-a7d9-6aee1def2774 req-0e8ab73a-c943-428f-99f8-39042a062a63 service nova] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bba0342d-1dc3-4c9f-a7d9-6aee1def2774 req-0e8ab73a-c943-428f-99f8-39042a062a63 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bba0342d-1dc3-4c9f-a7d9-6aee1def2774 req-0e8ab73a-c943-428f-99f8-39042a062a63 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.compute.manager [req-bba0342d-1dc3-4c9f-a7d9-6aee1def2774 req-0e8ab73a-c943-428f-99f8-39042a062a63 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] No waiting events found dispatching network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:25:12 user nova-compute[74630]: WARNING nova.compute.manager [req-bba0342d-1dc3-4c9f-a7d9-6aee1def2774 req-0e8ab73a-c943-428f-99f8-39042a062a63 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received unexpected event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 for instance with vm_state active and task_state rescuing.
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.compute.manager [req-bba0342d-1dc3-4c9f-a7d9-6aee1def2774 req-0e8ab73a-c943-428f-99f8-39042a062a63 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bba0342d-1dc3-4c9f-a7d9-6aee1def2774 req-0e8ab73a-c943-428f-99f8-39042a062a63 service nova] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bba0342d-1dc3-4c9f-a7d9-6aee1def2774 req-0e8ab73a-c943-428f-99f8-39042a062a63 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bba0342d-1dc3-4c9f-a7d9-6aee1def2774 req-0e8ab73a-c943-428f-99f8-39042a062a63 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.compute.manager [req-bba0342d-1dc3-4c9f-a7d9-6aee1def2774 req-0e8ab73a-c943-428f-99f8-39042a062a63 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] No waiting events found dispatching network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:25:12 user nova-compute[74630]: WARNING nova.compute.manager [req-bba0342d-1dc3-4c9f-a7d9-6aee1def2774 req-0e8ab73a-c943-428f-99f8-39042a062a63 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received unexpected event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 for instance with vm_state active and task_state rescuing.
Oct 26 03:25:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:12 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:25:12 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.objects.instance [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'vcpu_model' on Instance uuid 40316e54-eee2-4072-b436-4c5bb31724a9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.objects.base [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Object Instance<40316e54-eee2-4072-b436-4c5bb31724a9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZSsQfDla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:25:12 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:25:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:25:12 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:25:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:25:12 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[450b9ed2-7250-4fcf-b1ce-5a8afb4448ed]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ZSsQfDla\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 03:25:12 user nova-compute[74630]: node.name = iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:25:12 user nova-compute[74630]: node.tpgt = -1
Oct 26 03:25:12 user nova-compute[74630]: node.startup = automatic
Oct 26 03:25:12 user nova-compute[74630]: node.leading_login = No
Oct 26 03:25:12 user nova-compute[74630]: iface.iscsi_ifacename = default
Oct 26 03:25:12 user nova-compute[74630]: iface.net_ifacename = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.ipaddress = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.prefix_len = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.hwaddress = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.transport_name = tcp
Oct 26 03:25:12 user nova-compute[74630]: iface.initiatorname = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.state = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.vlan_id = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.vlan_priority = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.vlan_state = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.iface_num = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.mtu = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.port = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.bootproto = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.subnet_mask = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.gateway = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.dhcp_alt_client_id = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.dhcp_dns = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.dhcp_learn_iqn = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.dhcp_vendor_id_state = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.dhcp_vendor_id = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.dhcp_slp_da = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.fragmentation = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.gratuitous_arp = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.incoming_forwarding = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.tos_state = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.tos = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.ttl = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.delayed_ack = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.tcp_nagle = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.tcp_wsf_state = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.tcp_wsf = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.tcp_timer_scale = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.tcp_timestamp = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.redirect = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.def_task_mgmt_timeout = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.header_digest = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.data_digest = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.immediate_data = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.initial_r2t = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.data_seq_inorder = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.data_pdu_inorder = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.erl = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.max_receive_data_len = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.first_burst_len = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.max_outstanding_r2t = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.max_burst_len = 0
Oct 26 03:25:12 user nova-compute[74630]: iface.chap_auth = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.bidi_chap = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.strict_login_compliance = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.discovery_auth = <empty>
Oct 26 03:25:12 user nova-compute[74630]: iface.discovery_logout = <empty>
Oct 26 03:25:12 user nova-compute[74630]: node.discovery_address = <empty>
Oct 26 03:25:12 user nova-compute[74630]: node.discovery_port = 0
Oct 26 03:25:12 user nova-compute[74630]: node.discovery_type = static
Oct 26 03:25:12 user nova-compute[74630]: node.session.initial_cmdsn = 0
Oct 26 03:25:12 user nova-compute[74630]: node.session.initial_login_retry_max = 8
Oct 26 03:25:12 user nova-compute[74630]: node.session.xmit_thread_priority = -20
Oct 26 03:25:12 user nova-compute[74630]: node.session.cmds_max = 128
Oct 26 03:25:12 user nova-compute[74630]: node.session.queue_depth = 32
Oct 26 03:25:12 user nova-compute[74630]: node.session.nr_sessions = 1
Oct 26 03:25:12 user nova-compute[74630]: node.session.auth.authmethod = CHAP
Oct 26 03:25:12 user nova-compute[74630]: node.session.auth.username = ZSsQfDla
Oct 26 03:25:12 user nova-compute[74630]: node.session.auth.password = ***
Oct 26 03:25:12 user nova-compute[74630]: node.session.auth.username_in = <empty>
Oct 26 03:25:12 user nova-compute[74630]: node.session.auth.password_in = <empty>
Oct 26 03:25:12 user nova-compute[74630]: node.session.auth.chap_algs = MD5
Oct 26 03:25:12 user nova-compute[74630]: node.session.timeo.replacement_timeout = 120
Oct 26 03:25:12 user nova-compute[74630]: node.session.err_timeo.abort_timeout = 15
Oct 26 03:25:12 user nova-compute[74630]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 03:25:12 user nova-compute[74630]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 03:25:12 user nova-compute[74630]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 03:25:12 user nova-compute[74630]: node.session.iscsi.FastAbort = Yes
Oct 26 03:25:12 user nova-compute[74630]: node.session.iscsi.InitialR2T = No
Oct 26 03:25:12 user nova-compute[74630]: node.session.iscsi.ImmediateData = Yes
Oct 26 03:25:12 user nova-compute[74630]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 03:25:12 user nova-compute[74630]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 03:25:12 user nova-compute[74630]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 03:25:12 user nova-compute[74630]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 03:25:12 user nova-compute[74630]: node.session.iscsi.MaxConnections = 1
Oct 26 03:25:12 user nova-compute[74630]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 03:25:12 user nova-compute[74630]: node.session.iscsi.ERL = 0
Oct 26 03:25:12 user nova-compute[74630]: node.session.scan = manual
Oct 26 03:25:12 user nova-compute[74630]: node.session.reopen_max = 0
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].address = 172.16.0.220
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].port = 3260
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].startup = manual
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].tcp.window_size = 524288
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].tcp.type_of_service = 0
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].timeo.logout_timeout = 15
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].timeo.login_timeout = 15
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].timeo.auth_timeout = 45
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].iscsi.DataDigest = None
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].iscsi.IFMarker = No
Oct 26 03:25:12 user nova-compute[74630]: node.conn[0].iscsi.OFMarker = No
Oct 26 03:25:12 user nova-compute[74630]: # END RECORD
Oct 26 03:25:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0810dab6-5c40-4626-be65-924d990f2234]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f9eb1e-3ac0-4c40-ba1d-22e6e613e9ba]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:25:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZSsQfDla {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZSsQfDla" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ddbc36-4826-4d4a-8c5a-e9cf2c0c45d3]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZSsQfDla'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b52701a-284c-4d48-9493-0ccc90eeaf0f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[25120cfb-7ccb-497d-b703-ed30097b238d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:25:13 user nova-compute[74630]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:25:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:25:13 user nova-compute[74630]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:25:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.222s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] HCTL ('33', '0', '0', 0) found on session 10 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[539ec906-024d-4457-8e3c-97744ac1e71b]: (4, ('0 0 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching for a device in session 10 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZSsQfDla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.264s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] <== connect_volume: return (266ms) {'type': 'block', 'scsi_wwn': '26431363436373830', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431363436373830', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-158280684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-158280684',id=14,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:23:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e396316ddc243c594c29f5c434501cb',ramdisk_id='',reservation_id='r-wjqons9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:23:52Z,user_data=None,user_id='f8694c5db6e34f1e88595b55f8e5fe70',uuid=40316e54-eee2-4072-b436-4c5bb31724a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "vif_mac": "fa:16:3e:cb:fe:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converting VIF {"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "vif_mac": "fa:16:3e:cb:fe:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:fe:2f,bridge_name='br-int',has_traffic_filtering=True,id=09559581-1c5c-4bee-90ea-fb70ae613d86,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09559581-1c') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'pci_devices' on Instance uuid 40316e54-eee2-4072-b436-4c5bb31724a9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG nova.objects.base [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Object Instance<40316e54-eee2-4072-b436-4c5bb31724a9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:25:13 user nova-compute[74630]:   <uuid>40316e54-eee2-4072-b436-4c5bb31724a9</uuid>
Oct 26 03:25:13 user nova-compute[74630]:   <name>instance-0000000e</name>
Oct 26 03:25:13 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:25:13 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:25:13 user nova-compute[74630]:   <metadata>
Oct 26 03:25:13 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:25:13 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:25:13 user nova-compute[74630]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-158280684</nova:name>
Oct 26 03:25:13 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:25:12</nova:creationTime>
Oct 26 03:25:13 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:25:13 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:25:13 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:25:13 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:25:13 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:25:13 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:25:13 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:25:13 user nova-compute[74630]:       <nova:owner>
Oct 26 03:25:13 user nova-compute[74630]:         <nova:user uuid="f8694c5db6e34f1e88595b55f8e5fe70">tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member</nova:user>
Oct 26 03:25:13 user nova-compute[74630]:         <nova:project uuid="1e396316ddc243c594c29f5c434501cb">tempest-ServerBootFromVolumeStableRescueTest-1296515996</nova:project>
Oct 26 03:25:13 user nova-compute[74630]:       </nova:owner>
Oct 26 03:25:13 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:25:13 user nova-compute[74630]:       <nova:ports>
Oct 26 03:25:13 user nova-compute[74630]:         <nova:port uuid="09559581-1c5c-4bee-90ea-fb70ae613d86">
Oct 26 03:25:13 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 03:25:13 user nova-compute[74630]:         </nova:port>
Oct 26 03:25:13 user nova-compute[74630]:       </nova:ports>
Oct 26 03:25:13 user nova-compute[74630]:     </nova:instance>
Oct 26 03:25:13 user nova-compute[74630]:   </metadata>
Oct 26 03:25:13 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:25:13 user nova-compute[74630]:     <system>
Oct 26 03:25:13 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:25:13 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:25:13 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:25:13 user nova-compute[74630]:       <entry name="serial">40316e54-eee2-4072-b436-4c5bb31724a9</entry>
Oct 26 03:25:13 user nova-compute[74630]:       <entry name="uuid">40316e54-eee2-4072-b436-4c5bb31724a9</entry>
Oct 26 03:25:13 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:25:13 user nova-compute[74630]:     </system>
Oct 26 03:25:13 user nova-compute[74630]:   </sysinfo>
Oct 26 03:25:13 user nova-compute[74630]:   <os>
Oct 26 03:25:13 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:25:13 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:25:13 user nova-compute[74630]:   </os>
Oct 26 03:25:13 user nova-compute[74630]:   <features>
Oct 26 03:25:13 user nova-compute[74630]:     <acpi/>
Oct 26 03:25:13 user nova-compute[74630]:     <apic/>
Oct 26 03:25:13 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:25:13 user nova-compute[74630]:   </features>
Oct 26 03:25:13 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:25:13 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:25:13 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:25:13 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:25:13 user nova-compute[74630]:   </clock>
Oct 26 03:25:13 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:25:13 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:25:13 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:25:13 user nova-compute[74630]:   </cpu>
Oct 26 03:25:13 user nova-compute[74630]:   <devices>
Oct 26 03:25:13 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:25:13 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:25:13 user nova-compute[74630]:       <source dev="/dev/sdb"/>
Oct 26 03:25:13 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:25:13 user nova-compute[74630]:       <serial>89dadf3d-bdf3-448e-9b5c-e2613cc0adee</serial>
Oct 26 03:25:13 user nova-compute[74630]:     </disk>
Oct 26 03:25:13 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:25:13 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:25:13 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/disk.rescue"/>
Oct 26 03:25:13 user nova-compute[74630]:       <target dev="vdb" bus="virtio"/>
Oct 26 03:25:13 user nova-compute[74630]:       <boot order="1"/>
Oct 26 03:25:13 user nova-compute[74630]:     </disk>
Oct 26 03:25:13 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:25:13 user nova-compute[74630]:       <mac address="fa:16:3e:cb:fe:2f"/>
Oct 26 03:25:13 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:25:13 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:25:13 user nova-compute[74630]:       <target dev="tap09559581-1c"/>
Oct 26 03:25:13 user nova-compute[74630]:     </interface>
Oct 26 03:25:13 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:25:13 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/console.log" append="off"/>
Oct 26 03:25:13 user nova-compute[74630]:     </serial>
Oct 26 03:25:13 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:25:13 user nova-compute[74630]:     <video>
Oct 26 03:25:13 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:25:13 user nova-compute[74630]:     </video>
Oct 26 03:25:13 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:25:13 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:25:13 user nova-compute[74630]:     </rng>
Oct 26 03:25:13 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:25:13 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:25:13 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:25:13 user nova-compute[74630]:     </memballoon>
Oct 26 03:25:13 user nova-compute[74630]:   </devices>
Oct 26 03:25:13 user nova-compute[74630]: </domain>
Oct 26 03:25:13 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:13 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Instance destroyed successfully.
Oct 26 03:25:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:25:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] No VIF found with MAC fa:16:3e:cb:fe:2f, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:25:14 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b22ed85f-0ce2-4003-a781-e629584d6b5e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:25:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:15 user nova-compute[74630]: DEBUG nova.compute.manager [req-f20db243-686b-4f54-bef4-3fabbad13806 req-ca290f21-d3e5-43f8-9ef7-be5f159075f3 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:25:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f20db243-686b-4f54-bef4-3fabbad13806 req-ca290f21-d3e5-43f8-9ef7-be5f159075f3 service nova] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f20db243-686b-4f54-bef4-3fabbad13806 req-ca290f21-d3e5-43f8-9ef7-be5f159075f3 service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f20db243-686b-4f54-bef4-3fabbad13806 req-ca290f21-d3e5-43f8-9ef7-be5f159075f3 service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:15 user nova-compute[74630]: DEBUG nova.compute.manager [req-f20db243-686b-4f54-bef4-3fabbad13806 req-ca290f21-d3e5-43f8-9ef7-be5f159075f3 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] No waiting events found dispatching network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:25:15 user nova-compute[74630]: WARNING nova.compute.manager [req-f20db243-686b-4f54-bef4-3fabbad13806 req-ca290f21-d3e5-43f8-9ef7-be5f159075f3 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received unexpected event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 for instance with vm_state active and task_state rescuing.
Oct 26 03:25:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:17 user nova-compute[74630]: DEBUG nova.compute.manager [req-ce010127-5775-4672-8995-8f700e29ccd9 req-c6f4d3c0-84f8-4867-a344-e6c51eb5f84f service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ce010127-5775-4672-8995-8f700e29ccd9 req-c6f4d3c0-84f8-4867-a344-e6c51eb5f84f service nova] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ce010127-5775-4672-8995-8f700e29ccd9 req-c6f4d3c0-84f8-4867-a344-e6c51eb5f84f service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ce010127-5775-4672-8995-8f700e29ccd9 req-c6f4d3c0-84f8-4867-a344-e6c51eb5f84f service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:17 user nova-compute[74630]: DEBUG nova.compute.manager [req-ce010127-5775-4672-8995-8f700e29ccd9 req-c6f4d3c0-84f8-4867-a344-e6c51eb5f84f service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] No waiting events found dispatching network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:25:17 user nova-compute[74630]: WARNING nova.compute.manager [req-ce010127-5775-4672-8995-8f700e29ccd9 req-c6f4d3c0-84f8-4867-a344-e6c51eb5f84f service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received unexpected event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 for instance with vm_state active and task_state rescuing.
Oct 26 03:25:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-11d608bf-c1b2-4258-b90f-98da10ad6fbf tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:25:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:25:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:25:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:25:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:25:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:25:27 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:25:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updating instance_info_cache with network_info: [{"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:25:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.283s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:31 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:25:31 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:25:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:35 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:25:35 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:25:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=7325MB free_disk=25.26044464111328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:25:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Applying migration context for instance 65ff804f-8b98-406d-8c5c-3d73bb52ff18 as it has an incoming, in-progress migration 2047908f-d5af-45f5-8a55-68abbbbe7af0. Migration status is finished {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 03:25:35 user nova-compute[74630]: INFO nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updating resource usage from migration 2047908f-d5af-45f5-8a55-68abbbbe7af0
Oct 26 03:25:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:25:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 747e596d-d9b3-4af2-be42-0fd494b6ef9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:25:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:25:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:25:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:25:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d1591088-0892-4aa5-b7ea-3addb083bc69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:25:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:25:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f5441872-864e-44d9-8632-e05c5d71bd90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:25:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 1599e499-12ac-4e25-97a4-17341a03f8c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:25:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Migration 2047908f-d5af-45f5-8a55-68abbbbe7af0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 03:25:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 65ff804f-8b98-406d-8c5c-3d73bb52ff18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:25:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:25:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:25:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:36 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:25:36 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:25:36 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:25:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.759s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:44 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:25:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:44 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:25:44 user nova-compute[74630]: INFO nova.compute.claims [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Claim successful on node user
Oct 26 03:25:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:44 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:25:44 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:25:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:44 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:25:44 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:25:44 user nova-compute[74630]: DEBUG nova.network.neutron [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:25:44 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:25:44 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:25:45 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Creating image(s)
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "/opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "/opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "/opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG nova.policy [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e5e3a45981c47488bc2f8718280ebe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15963835048c4d1a9186d63fe8ef8688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.205s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.260s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk 1073741824" returned: 0 in 0.060s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.193s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Cannot resize image /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Ensure instance console log exists: /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:47 user nova-compute[74630]: DEBUG nova.network.neutron [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Successfully created port: 181a6913-fd44-44b4-955e-657f1cc64313 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:25:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.network.neutron [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Successfully updated port: 181a6913-fd44-44b4-955e-657f1cc64313 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "refresh_cache-980e7a2f-b94d-4544-9e50-03f96fd376fe" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquired lock "refresh_cache-980e7a2f-b94d-4544-9e50-03f96fd376fe" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.network.neutron [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.network.neutron [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-45788f4f-e822-4be5-83f0-a338680b3284 req-9366be08-7ab8-432b-ac27-e93a62a5fc5c service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Received event network-changed-181a6913-fd44-44b4-955e-657f1cc64313 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-45788f4f-e822-4be5-83f0-a338680b3284 req-9366be08-7ab8-432b-ac27-e93a62a5fc5c service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Refreshing instance network info cache due to event network-changed-181a6913-fd44-44b4-955e-657f1cc64313. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-45788f4f-e822-4be5-83f0-a338680b3284 req-9366be08-7ab8-432b-ac27-e93a62a5fc5c service nova] Acquiring lock "refresh_cache-980e7a2f-b94d-4544-9e50-03f96fd376fe" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.network.neutron [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Updating instance_info_cache with network_info: [{"id": "181a6913-fd44-44b4-955e-657f1cc64313", "address": "fa:16:3e:8d:c7:e0", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6913-fd", "ovs_interfaceid": "181a6913-fd44-44b4-955e-657f1cc64313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Releasing lock "refresh_cache-980e7a2f-b94d-4544-9e50-03f96fd376fe" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Instance network_info: |[{"id": "181a6913-fd44-44b4-955e-657f1cc64313", "address": "fa:16:3e:8d:c7:e0", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6913-fd", "ovs_interfaceid": "181a6913-fd44-44b4-955e-657f1cc64313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-45788f4f-e822-4be5-83f0-a338680b3284 req-9366be08-7ab8-432b-ac27-e93a62a5fc5c service nova] Acquired lock "refresh_cache-980e7a2f-b94d-4544-9e50-03f96fd376fe" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.network.neutron [req-45788f4f-e822-4be5-83f0-a338680b3284 req-9366be08-7ab8-432b-ac27-e93a62a5fc5c service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Refreshing network info cache for port 181a6913-fd44-44b4-955e-657f1cc64313 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Start _get_guest_xml network_info=[{"id": "181a6913-fd44-44b4-955e-657f1cc64313", "address": "fa:16:3e:8d:c7:e0", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6913-fd", "ovs_interfaceid": "181a6913-fd44-44b4-955e-657f1cc64313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:25:48 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:25:48 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:25:48 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2114068153',display_name='tempest-VolumesSnapshotTestJSON-instance-2114068153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2114068153',id=17,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOCT0vn0YsXb1CkO5Oyw6rixHq17p+AwO9Z0ZFEHClyoamLaL9XT38ZItcm46iSysUijhp3lrvUAglF9CZ/iqwUz792qne9BLD9kf8kNrYtKZwsBTzghaakEEtRUrRHjQ==',key_name='tempest-keypair-652259270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15963835048c4d1a9186d63fe8ef8688',ramdisk_id='',reservation_id='r-ugoudqqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1574923981',owner_user_name='tempest-VolumesSnapshotTestJSON-1574923981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e5e3a45981c47488bc2f8718280ebe4',uuid=980e7a2f-b94d-4544-9e50-03f96fd376fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "181a6913-fd44-44b4-955e-657f1cc64313", "address": "fa:16:3e:8d:c7:e0", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6913-fd", "ovs_interfaceid": "181a6913-fd44-44b4-955e-657f1cc64313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Converting VIF {"id": "181a6913-fd44-44b4-955e-657f1cc64313", "address": "fa:16:3e:8d:c7:e0", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6913-fd", "ovs_interfaceid": "181a6913-fd44-44b4-955e-657f1cc64313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c7:e0,bridge_name='br-int',has_traffic_filtering=True,id=181a6913-fd44-44b4-955e-657f1cc64313,network=Network(9c576755-a619-4934-af03-3b69276b112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6913-fd') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG nova.objects.instance [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lazy-loading 'pci_devices' on Instance uuid 980e7a2f-b94d-4544-9e50-03f96fd376fe {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:25:49 user nova-compute[74630]:   <uuid>980e7a2f-b94d-4544-9e50-03f96fd376fe</uuid>
Oct 26 03:25:49 user nova-compute[74630]:   <name>instance-00000011</name>
Oct 26 03:25:49 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:25:49 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:25:49 user nova-compute[74630]:   <metadata>
Oct 26 03:25:49 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:25:49 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:25:49 user nova-compute[74630]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2114068153</nova:name>
Oct 26 03:25:49 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:25:48</nova:creationTime>
Oct 26 03:25:49 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:25:49 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:25:49 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:25:49 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:25:49 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:25:49 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:25:49 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:25:49 user nova-compute[74630]:       <nova:owner>
Oct 26 03:25:49 user nova-compute[74630]:         <nova:user uuid="0e5e3a45981c47488bc2f8718280ebe4">tempest-VolumesSnapshotTestJSON-1574923981-project-member</nova:user>
Oct 26 03:25:49 user nova-compute[74630]:         <nova:project uuid="15963835048c4d1a9186d63fe8ef8688">tempest-VolumesSnapshotTestJSON-1574923981</nova:project>
Oct 26 03:25:49 user nova-compute[74630]:       </nova:owner>
Oct 26 03:25:49 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:25:49 user nova-compute[74630]:       <nova:ports>
Oct 26 03:25:49 user nova-compute[74630]:         <nova:port uuid="181a6913-fd44-44b4-955e-657f1cc64313">
Oct 26 03:25:49 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 03:25:49 user nova-compute[74630]:         </nova:port>
Oct 26 03:25:49 user nova-compute[74630]:       </nova:ports>
Oct 26 03:25:49 user nova-compute[74630]:     </nova:instance>
Oct 26 03:25:49 user nova-compute[74630]:   </metadata>
Oct 26 03:25:49 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:25:49 user nova-compute[74630]:     <system>
Oct 26 03:25:49 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:25:49 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:25:49 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:25:49 user nova-compute[74630]:       <entry name="serial">980e7a2f-b94d-4544-9e50-03f96fd376fe</entry>
Oct 26 03:25:49 user nova-compute[74630]:       <entry name="uuid">980e7a2f-b94d-4544-9e50-03f96fd376fe</entry>
Oct 26 03:25:49 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:25:49 user nova-compute[74630]:     </system>
Oct 26 03:25:49 user nova-compute[74630]:   </sysinfo>
Oct 26 03:25:49 user nova-compute[74630]:   <os>
Oct 26 03:25:49 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:25:49 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:25:49 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:25:49 user nova-compute[74630]:   </os>
Oct 26 03:25:49 user nova-compute[74630]:   <features>
Oct 26 03:25:49 user nova-compute[74630]:     <acpi/>
Oct 26 03:25:49 user nova-compute[74630]:     <apic/>
Oct 26 03:25:49 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:25:49 user nova-compute[74630]:   </features>
Oct 26 03:25:49 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:25:49 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:25:49 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:25:49 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:25:49 user nova-compute[74630]:   </clock>
Oct 26 03:25:49 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:25:49 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:25:49 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:25:49 user nova-compute[74630]:   </cpu>
Oct 26 03:25:49 user nova-compute[74630]:   <devices>
Oct 26 03:25:49 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:25:49 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:25:49 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk"/>
Oct 26 03:25:49 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:25:49 user nova-compute[74630]:     </disk>
Oct 26 03:25:49 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:25:49 user nova-compute[74630]:       <mac address="fa:16:3e:8d:c7:e0"/>
Oct 26 03:25:49 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:25:49 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:25:49 user nova-compute[74630]:       <target dev="tap181a6913-fd"/>
Oct 26 03:25:49 user nova-compute[74630]:     </interface>
Oct 26 03:25:49 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:25:49 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/console.log" append="off"/>
Oct 26 03:25:49 user nova-compute[74630]:     </serial>
Oct 26 03:25:49 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:25:49 user nova-compute[74630]:     <video>
Oct 26 03:25:49 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:25:49 user nova-compute[74630]:     </video>
Oct 26 03:25:49 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:25:49 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:25:49 user nova-compute[74630]:     </rng>
Oct 26 03:25:49 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:25:49 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:25:49 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:25:49 user nova-compute[74630]:     </memballoon>
Oct 26 03:25:49 user nova-compute[74630]:   </devices>
Oct 26 03:25:49 user nova-compute[74630]: </domain>
Oct 26 03:25:49 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2114068153',display_name='tempest-VolumesSnapshotTestJSON-instance-2114068153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2114068153',id=17,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOCT0vn0YsXb1CkO5Oyw6rixHq17p+AwO9Z0ZFEHClyoamLaL9XT38ZItcm46iSysUijhp3lrvUAglF9CZ/iqwUz792qne9BLD9kf8kNrYtKZwsBTzghaakEEtRUrRHjQ==',key_name='tempest-keypair-652259270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15963835048c4d1a9186d63fe8ef8688',ramdisk_id='',reservation_id='r-ugoudqqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1574923981',owner_user_name='tempest-VolumesSnapshotTestJSON-1574923981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e5e3a45981c47488bc2f8718280ebe4',uuid=980e7a2f-b94d-4544-9e50-03f96fd376fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "181a6913-fd44-44b4-955e-657f1cc64313", "address": "fa:16:3e:8d:c7:e0", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6913-fd", "ovs_interfaceid": "181a6913-fd44-44b4-955e-657f1cc64313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Converting VIF {"id": "181a6913-fd44-44b4-955e-657f1cc64313", "address": "fa:16:3e:8d:c7:e0", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6913-fd", "ovs_interfaceid": "181a6913-fd44-44b4-955e-657f1cc64313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c7:e0,bridge_name='br-int',has_traffic_filtering=True,id=181a6913-fd44-44b4-955e-657f1cc64313,network=Network(9c576755-a619-4934-af03-3b69276b112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6913-fd') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG os_vif [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c7:e0,bridge_name='br-int',has_traffic_filtering=True,id=181a6913-fd44-44b4-955e-657f1cc64313,network=Network(9c576755-a619-4934-af03-3b69276b112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6913-fd') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50075ad8-7ac1-5f9e-bcd8-f227d4c8467d', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap181a6913-fd, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap181a6913-fd, col_values=(('qos', UUID('d3aa0d7a-ad41-4104-b091-34ac3b93c099')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap181a6913-fd, col_values=(('external_ids', {'iface-id': '181a6913-fd44-44b4-955e-657f1cc64313', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:c7:e0', 'vm-uuid': '980e7a2f-b94d-4544-9e50-03f96fd376fe'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:49 user nova-compute[74630]: INFO os_vif [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:c7:e0,bridge_name='br-int',has_traffic_filtering=True,id=181a6913-fd44-44b4-955e-657f1cc64313,network=Network(9c576755-a619-4934-af03-3b69276b112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6913-fd')
Oct 26 03:25:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] No VIF found with MAC fa:16:3e:8d:c7:e0, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG nova.network.neutron [req-45788f4f-e822-4be5-83f0-a338680b3284 req-9366be08-7ab8-432b-ac27-e93a62a5fc5c service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Updated VIF entry in instance network info cache for port 181a6913-fd44-44b4-955e-657f1cc64313. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG nova.network.neutron [req-45788f4f-e822-4be5-83f0-a338680b3284 req-9366be08-7ab8-432b-ac27-e93a62a5fc5c service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Updating instance_info_cache with network_info: [{"id": "181a6913-fd44-44b4-955e-657f1cc64313", "address": "fa:16:3e:8d:c7:e0", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6913-fd", "ovs_interfaceid": "181a6913-fd44-44b4-955e-657f1cc64313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:25:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-45788f4f-e822-4be5-83f0-a338680b3284 req-9366be08-7ab8-432b-ac27-e93a62a5fc5c service nova] Releasing lock "refresh_cache-980e7a2f-b94d-4544-9e50-03f96fd376fe" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:25:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-87cb6ea7-bcff-4231-b69f-35ef2b989226 req-da03c898-cd3c-4dc2-8be2-23b5d895ceb4 service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Received event network-vif-plugged-181a6913-fd44-44b4-955e-657f1cc64313 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:25:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-87cb6ea7-bcff-4231-b69f-35ef2b989226 req-da03c898-cd3c-4dc2-8be2-23b5d895ceb4 service nova] Acquiring lock "980e7a2f-b94d-4544-9e50-03f96fd376fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-87cb6ea7-bcff-4231-b69f-35ef2b989226 req-da03c898-cd3c-4dc2-8be2-23b5d895ceb4 service nova] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-87cb6ea7-bcff-4231-b69f-35ef2b989226 req-da03c898-cd3c-4dc2-8be2-23b5d895ceb4 service nova] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-87cb6ea7-bcff-4231-b69f-35ef2b989226 req-da03c898-cd3c-4dc2-8be2-23b5d895ceb4 service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] No waiting events found dispatching network-vif-plugged-181a6913-fd44-44b4-955e-657f1cc64313 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:25:51 user nova-compute[74630]: WARNING nova.compute.manager [req-87cb6ea7-bcff-4231-b69f-35ef2b989226 req-da03c898-cd3c-4dc2-8be2-23b5d895ceb4 service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Received unexpected event network-vif-plugged-181a6913-fd44-44b4-955e-657f1cc64313 for instance with vm_state building and task_state spawning.
Oct 26 03:25:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:53 user nova-compute[74630]: DEBUG nova.compute.manager [req-9b0caeef-8eeb-4e5b-a65f-a3513c20fcab req-f07d31c3-a453-4ac9-a000-b688081baf1f service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Received event network-vif-plugged-181a6913-fd44-44b4-955e-657f1cc64313 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:25:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9b0caeef-8eeb-4e5b-a65f-a3513c20fcab req-f07d31c3-a453-4ac9-a000-b688081baf1f service nova] Acquiring lock "980e7a2f-b94d-4544-9e50-03f96fd376fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:25:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9b0caeef-8eeb-4e5b-a65f-a3513c20fcab req-f07d31c3-a453-4ac9-a000-b688081baf1f service nova] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:25:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9b0caeef-8eeb-4e5b-a65f-a3513c20fcab req-f07d31c3-a453-4ac9-a000-b688081baf1f service nova] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:53 user nova-compute[74630]: DEBUG nova.compute.manager [req-9b0caeef-8eeb-4e5b-a65f-a3513c20fcab req-f07d31c3-a453-4ac9-a000-b688081baf1f service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] No waiting events found dispatching network-vif-plugged-181a6913-fd44-44b4-955e-657f1cc64313 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:25:53 user nova-compute[74630]: WARNING nova.compute.manager [req-9b0caeef-8eeb-4e5b-a65f-a3513c20fcab req-f07d31c3-a453-4ac9-a000-b688081baf1f service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Received unexpected event network-vif-plugged-181a6913-fd44-44b4-955e-657f1cc64313 for instance with vm_state building and task_state spawning.
Oct 26 03:25:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:25:53 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:25:53 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Instance spawned successfully.
Oct 26 03:25:53 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:25:53 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:25:53 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:25:53 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:25:53 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:25:53 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:25:53 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:25:53 user nova-compute[74630]: INFO nova.compute.manager [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Took 8.70 seconds to spawn the instance on the hypervisor.
Oct 26 03:25:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:25:53 user nova-compute[74630]: INFO nova.compute.manager [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Took 9.68 seconds to build instance.
Oct 26 03:25:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f529f98-8e93-4540-b3d0-b818acbf5a95 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.804s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:25:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:25:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-2922ddc2-b212-477a-af05-3f16847b898b req-eaab3fa3-8424-4f95-8876-f8868c03b9a9 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received event network-changed-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-2922ddc2-b212-477a-af05-3f16847b898b req-eaab3fa3-8424-4f95-8876-f8868c03b9a9 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Refreshing instance network info cache due to event network-changed-add088cb-2d9c-4ad2-a72b-64f1138ddfa2. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:26:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2922ddc2-b212-477a-af05-3f16847b898b req-eaab3fa3-8424-4f95-8876-f8868c03b9a9 service nova] Acquiring lock "refresh_cache-f5441872-864e-44d9-8632-e05c5d71bd90" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2922ddc2-b212-477a-af05-3f16847b898b req-eaab3fa3-8424-4f95-8876-f8868c03b9a9 service nova] Acquired lock "refresh_cache-f5441872-864e-44d9-8632-e05c5d71bd90" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-2922ddc2-b212-477a-af05-3f16847b898b req-eaab3fa3-8424-4f95-8876-f8868c03b9a9 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Refreshing network info cache for port add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:26:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "f5441872-864e-44d9-8632-e05c5d71bd90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f5441872-864e-44d9-8632-e05c5d71bd90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:01 user nova-compute[74630]: DEBUG nova.objects.instance [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lazy-loading 'flavor' on Instance uuid f5441872-864e-44d9-8632-e05c5d71bd90 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:26:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f5441872-864e-44d9-8632-e05c5d71bd90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-2922ddc2-b212-477a-af05-3f16847b898b req-eaab3fa3-8424-4f95-8876-f8868c03b9a9 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Updated VIF entry in instance network info cache for port add088cb-2d9c-4ad2-a72b-64f1138ddfa2. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:26:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-2922ddc2-b212-477a-af05-3f16847b898b req-eaab3fa3-8424-4f95-8876-f8868c03b9a9 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Updating instance_info_cache with network_info: [{"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2922ddc2-b212-477a-af05-3f16847b898b req-eaab3fa3-8424-4f95-8876-f8868c03b9a9 service nova] Releasing lock "refresh_cache-f5441872-864e-44d9-8632-e05c5d71bd90" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "f5441872-864e-44d9-8632-e05c5d71bd90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f5441872-864e-44d9-8632-e05c5d71bd90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:02 user nova-compute[74630]: INFO nova.compute.manager [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Attaching volume 9de496c0-3619-4b18-b4a4-4e490cbfe516 to /dev/vdb
Oct 26 03:26:02 user nova-compute[74630]: DEBUG os_brick.utils [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[804b2286-b5c9-464c-a0c2-53067ab9b592]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b1cad4-9c70-43a7-aa9b-dcefcbab3dd7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[65698a42-9b24-4acc-b7ce-417ef961f3bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b04071-6e97-4ae4-815f-15f6e67ba331]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:26:02 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:26:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c672754-704a-43ba-8fab-06ad5fa1145e]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG os_brick.utils [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Updating existing volume attachment record: 80ae40de-c86a-4ed3-ac00-0fe0741352ac {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:26:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:26:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74630) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 03:26:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:26:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:26:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:26:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquiring lock "7576bf64-216a-4d1a-88a2-b90468e61515" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:14 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:26:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:14 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:26:14 user nova-compute[74630]: INFO nova.compute.claims [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Claim successful on node user
Oct 26 03:26:15 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-7918e3bc-c44b-4be3-871d-e06eb3fd7d49" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-7918e3bc-c44b-4be3-871d-e06eb3fd7d49" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.700s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG nova.network.neutron [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:26:15 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:26:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Updating instance_info_cache with network_info: [{"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-7918e3bc-c44b-4be3-871d-e06eb3fd7d49" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG nova.policy [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9cf888840364a038054291c27c49d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ca6a73040f4f7ea05ee0328535e97d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:26:15 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Creating image(s)
Oct 26 03:26:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquiring lock "/opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "/opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "/opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.214s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk 1073741824" returned: 0 in 0.058s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Cannot resize image /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Ensure instance console log exists: /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:17 user nova-compute[74630]: DEBUG nova.network.neutron [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Successfully created port: 422780a3-5bb4-45a5-9253-eaddfaccd00f {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:26:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:26:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 03:26:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] There are 0 instances to clean {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 03:26:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.network.neutron [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Successfully updated port: 422780a3-5bb4-45a5-9253-eaddfaccd00f {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquiring lock "refresh_cache-7576bf64-216a-4d1a-88a2-b90468e61515" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquired lock "refresh_cache-7576bf64-216a-4d1a-88a2-b90468e61515" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.network.neutron [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-3b85b237-a297-4979-9739-82c092b0a6b3 req-a710f344-b011-45ee-b463-3e4ea694da5a service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Received event network-changed-422780a3-5bb4-45a5-9253-eaddfaccd00f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-3b85b237-a297-4979-9739-82c092b0a6b3 req-a710f344-b011-45ee-b463-3e4ea694da5a service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Refreshing instance network info cache due to event network-changed-422780a3-5bb4-45a5-9253-eaddfaccd00f. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3b85b237-a297-4979-9739-82c092b0a6b3 req-a710f344-b011-45ee-b463-3e4ea694da5a service nova] Acquiring lock "refresh_cache-7576bf64-216a-4d1a-88a2-b90468e61515" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.network.neutron [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.network.neutron [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Updating instance_info_cache with network_info: [{"id": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "address": "fa:16:3e:7e:9f:cb", "network": {"id": "6d913fbd-592b-4127-984e-51f91cbc0e13", "bridge": "br-int", "label": "tempest-TestVolumeSwap-750416158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91ca6a73040f4f7ea05ee0328535e97d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422780a3-5b", "ovs_interfaceid": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Releasing lock "refresh_cache-7576bf64-216a-4d1a-88a2-b90468e61515" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Instance network_info: |[{"id": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "address": "fa:16:3e:7e:9f:cb", "network": {"id": "6d913fbd-592b-4127-984e-51f91cbc0e13", "bridge": "br-int", "label": "tempest-TestVolumeSwap-750416158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91ca6a73040f4f7ea05ee0328535e97d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422780a3-5b", "ovs_interfaceid": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3b85b237-a297-4979-9739-82c092b0a6b3 req-a710f344-b011-45ee-b463-3e4ea694da5a service nova] Acquired lock "refresh_cache-7576bf64-216a-4d1a-88a2-b90468e61515" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.network.neutron [req-3b85b237-a297-4979-9739-82c092b0a6b3 req-a710f344-b011-45ee-b463-3e4ea694da5a service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Refreshing network info cache for port 422780a3-5bb4-45a5-9253-eaddfaccd00f {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Start _get_guest_xml network_info=[{"id": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "address": "fa:16:3e:7e:9f:cb", "network": {"id": "6d913fbd-592b-4127-984e-51f91cbc0e13", "bridge": "br-int", "label": "tempest-TestVolumeSwap-750416158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91ca6a73040f4f7ea05ee0328535e97d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422780a3-5b", "ovs_interfaceid": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:18 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:26:18 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-812708338',display_name='tempest-TestVolumeSwap-server-812708338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-812708338',id=18,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX0JtCXA+l4SNf9HJpSomTUQ2Om6DV42G3Be7Rw6T9RyFbQzh/ly0Y8XfqgoYvJL2Y2riEQ5ZHj0Jf4pMB5G8fYEVkmlFxD7gaNivTAhrzzLUkCNdkTKXpO4A9jmz7Arg==',key_name='tempest-keypair-1647964059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91ca6a73040f4f7ea05ee0328535e97d',ramdisk_id='',reservation_id='r-e0htdtmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1631559412',owner_user_name='tempest-TestVolumeSwap-1631559412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9cf888840364a038054291c27c49d8c',uuid=7576bf64-216a-4d1a-88a2-b90468e61515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "address": "fa:16:3e:7e:9f:cb", "network": {"id": "6d913fbd-592b-4127-984e-51f91cbc0e13", "bridge": "br-int", "label": "tempest-TestVolumeSwap-750416158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91ca6a73040f4f7ea05ee0328535e97d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422780a3-5b", "ovs_interfaceid": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Converting VIF {"id": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "address": "fa:16:3e:7e:9f:cb", "network": {"id": "6d913fbd-592b-4127-984e-51f91cbc0e13", "bridge": "br-int", "label": "tempest-TestVolumeSwap-750416158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91ca6a73040f4f7ea05ee0328535e97d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422780a3-5b", "ovs_interfaceid": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=422780a3-5bb4-45a5-9253-eaddfaccd00f,network=Network(6d913fbd-592b-4127-984e-51f91cbc0e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422780a3-5b') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.objects.instance [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lazy-loading 'pci_devices' on Instance uuid 7576bf64-216a-4d1a-88a2-b90468e61515 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:26:18 user nova-compute[74630]:   <uuid>7576bf64-216a-4d1a-88a2-b90468e61515</uuid>
Oct 26 03:26:18 user nova-compute[74630]:   <name>instance-00000012</name>
Oct 26 03:26:18 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:26:18 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:26:18 user nova-compute[74630]:   <metadata>
Oct 26 03:26:18 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:26:18 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:26:18 user nova-compute[74630]:       <nova:name>tempest-TestVolumeSwap-server-812708338</nova:name>
Oct 26 03:26:18 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:26:18</nova:creationTime>
Oct 26 03:26:18 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:26:18 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:26:18 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:26:18 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:26:18 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:26:18 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:26:18 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:26:18 user nova-compute[74630]:       <nova:owner>
Oct 26 03:26:18 user nova-compute[74630]:         <nova:user uuid="c9cf888840364a038054291c27c49d8c">tempest-TestVolumeSwap-1631559412-project-member</nova:user>
Oct 26 03:26:18 user nova-compute[74630]:         <nova:project uuid="91ca6a73040f4f7ea05ee0328535e97d">tempest-TestVolumeSwap-1631559412</nova:project>
Oct 26 03:26:18 user nova-compute[74630]:       </nova:owner>
Oct 26 03:26:18 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:26:18 user nova-compute[74630]:       <nova:ports>
Oct 26 03:26:18 user nova-compute[74630]:         <nova:port uuid="422780a3-5bb4-45a5-9253-eaddfaccd00f">
Oct 26 03:26:18 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 03:26:18 user nova-compute[74630]:         </nova:port>
Oct 26 03:26:18 user nova-compute[74630]:       </nova:ports>
Oct 26 03:26:18 user nova-compute[74630]:     </nova:instance>
Oct 26 03:26:18 user nova-compute[74630]:   </metadata>
Oct 26 03:26:18 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:26:18 user nova-compute[74630]:     <system>
Oct 26 03:26:18 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:26:18 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:26:18 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:26:18 user nova-compute[74630]:       <entry name="serial">7576bf64-216a-4d1a-88a2-b90468e61515</entry>
Oct 26 03:26:18 user nova-compute[74630]:       <entry name="uuid">7576bf64-216a-4d1a-88a2-b90468e61515</entry>
Oct 26 03:26:18 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:26:18 user nova-compute[74630]:     </system>
Oct 26 03:26:18 user nova-compute[74630]:   </sysinfo>
Oct 26 03:26:18 user nova-compute[74630]:   <os>
Oct 26 03:26:18 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:26:18 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:26:18 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:26:18 user nova-compute[74630]:   </os>
Oct 26 03:26:18 user nova-compute[74630]:   <features>
Oct 26 03:26:18 user nova-compute[74630]:     <acpi/>
Oct 26 03:26:18 user nova-compute[74630]:     <apic/>
Oct 26 03:26:18 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:26:18 user nova-compute[74630]:   </features>
Oct 26 03:26:18 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:26:18 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:26:18 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:26:18 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:26:18 user nova-compute[74630]:   </clock>
Oct 26 03:26:18 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:26:18 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:26:18 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:26:18 user nova-compute[74630]:   </cpu>
Oct 26 03:26:18 user nova-compute[74630]:   <devices>
Oct 26 03:26:18 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:26:18 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:26:18 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk"/>
Oct 26 03:26:18 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:26:18 user nova-compute[74630]:     </disk>
Oct 26 03:26:18 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:26:18 user nova-compute[74630]:       <mac address="fa:16:3e:7e:9f:cb"/>
Oct 26 03:26:18 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:26:18 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:26:18 user nova-compute[74630]:       <target dev="tap422780a3-5b"/>
Oct 26 03:26:18 user nova-compute[74630]:     </interface>
Oct 26 03:26:18 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:26:18 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/console.log" append="off"/>
Oct 26 03:26:18 user nova-compute[74630]:     </serial>
Oct 26 03:26:18 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:26:18 user nova-compute[74630]:     <video>
Oct 26 03:26:18 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:26:18 user nova-compute[74630]:     </video>
Oct 26 03:26:18 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:26:18 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:26:18 user nova-compute[74630]:     </rng>
Oct 26 03:26:18 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:26:18 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:26:18 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:26:18 user nova-compute[74630]:     </memballoon>
Oct 26 03:26:18 user nova-compute[74630]:   </devices>
Oct 26 03:26:18 user nova-compute[74630]: </domain>
Oct 26 03:26:18 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-812708338',display_name='tempest-TestVolumeSwap-server-812708338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-812708338',id=18,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX0JtCXA+l4SNf9HJpSomTUQ2Om6DV42G3Be7Rw6T9RyFbQzh/ly0Y8XfqgoYvJL2Y2riEQ5ZHj0Jf4pMB5G8fYEVkmlFxD7gaNivTAhrzzLUkCNdkTKXpO4A9jmz7Arg==',key_name='tempest-keypair-1647964059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91ca6a73040f4f7ea05ee0328535e97d',ramdisk_id='',reservation_id='r-e0htdtmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1631559412',owner_user_name='tempest-TestVolumeSwap-1631559412-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9cf888840364a038054291c27c49d8c',uuid=7576bf64-216a-4d1a-88a2-b90468e61515,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "address": "fa:16:3e:7e:9f:cb", "network": {"id": "6d913fbd-592b-4127-984e-51f91cbc0e13", "bridge": "br-int", "label": "tempest-TestVolumeSwap-750416158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91ca6a73040f4f7ea05ee0328535e97d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422780a3-5b", "ovs_interfaceid": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Converting VIF {"id": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "address": "fa:16:3e:7e:9f:cb", "network": {"id": "6d913fbd-592b-4127-984e-51f91cbc0e13", "bridge": "br-int", "label": "tempest-TestVolumeSwap-750416158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91ca6a73040f4f7ea05ee0328535e97d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422780a3-5b", "ovs_interfaceid": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=422780a3-5bb4-45a5-9253-eaddfaccd00f,network=Network(6d913fbd-592b-4127-984e-51f91cbc0e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422780a3-5b') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG os_vif [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=422780a3-5bb4-45a5-9253-eaddfaccd00f,network=Network(6d913fbd-592b-4127-984e-51f91cbc0e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422780a3-5b') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ff0d0ab-bc69-580e-ad0a-25a8c3df8291', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap422780a3-5b, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap422780a3-5b, col_values=(('qos', UUID('e13c1bce-9759-43d2-a776-e0e8d68d1f52')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap422780a3-5b, col_values=(('external_ids', {'iface-id': '422780a3-5bb4-45a5-9253-eaddfaccd00f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:9f:cb', 'vm-uuid': '7576bf64-216a-4d1a-88a2-b90468e61515'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:18 user nova-compute[74630]: INFO os_vif [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=422780a3-5bb4-45a5-9253-eaddfaccd00f,network=Network(6d913fbd-592b-4127-984e-51f91cbc0e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422780a3-5b')
Oct 26 03:26:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.238s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:26:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] No VIF found with MAC fa:16:3e:7e:9f:cb, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:19 user nova-compute[74630]: DEBUG nova.network.neutron [req-3b85b237-a297-4979-9739-82c092b0a6b3 req-a710f344-b011-45ee-b463-3e4ea694da5a service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Updated VIF entry in instance network info cache for port 422780a3-5bb4-45a5-9253-eaddfaccd00f. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:26:19 user nova-compute[74630]: DEBUG nova.network.neutron [req-3b85b237-a297-4979-9739-82c092b0a6b3 req-a710f344-b011-45ee-b463-3e4ea694da5a service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Updating instance_info_cache with network_info: [{"id": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "address": "fa:16:3e:7e:9f:cb", "network": {"id": "6d913fbd-592b-4127-984e-51f91cbc0e13", "bridge": "br-int", "label": "tempest-TestVolumeSwap-750416158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91ca6a73040f4f7ea05ee0328535e97d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422780a3-5b", "ovs_interfaceid": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3b85b237-a297-4979-9739-82c092b0a6b3 req-a710f344-b011-45ee-b463-3e4ea694da5a service nova] Releasing lock "refresh_cache-7576bf64-216a-4d1a-88a2-b90468e61515" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-4c1178e2-2b6f-47eb-abed-996eaff83a83 req-d4eec46c-0c02-48cc-ae56-ad3a56a1ac42 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Received event network-vif-plugged-422780a3-5bb4-45a5-9253-eaddfaccd00f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4c1178e2-2b6f-47eb-abed-996eaff83a83 req-d4eec46c-0c02-48cc-ae56-ad3a56a1ac42 service nova] Acquiring lock "7576bf64-216a-4d1a-88a2-b90468e61515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4c1178e2-2b6f-47eb-abed-996eaff83a83 req-d4eec46c-0c02-48cc-ae56-ad3a56a1ac42 service nova] Lock "7576bf64-216a-4d1a-88a2-b90468e61515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4c1178e2-2b6f-47eb-abed-996eaff83a83 req-d4eec46c-0c02-48cc-ae56-ad3a56a1ac42 service nova] Lock "7576bf64-216a-4d1a-88a2-b90468e61515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-4c1178e2-2b6f-47eb-abed-996eaff83a83 req-d4eec46c-0c02-48cc-ae56-ad3a56a1ac42 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] No waiting events found dispatching network-vif-plugged-422780a3-5bb4-45a5-9253-eaddfaccd00f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:26:20 user nova-compute[74630]: WARNING nova.compute.manager [req-4c1178e2-2b6f-47eb-abed-996eaff83a83 req-d4eec46c-0c02-48cc-ae56-ad3a56a1ac42 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Received unexpected event network-vif-plugged-422780a3-5bb4-45a5-9253-eaddfaccd00f for instance with vm_state building and task_state spawning.
Oct 26 03:26:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-dea602d2-a7a4-464e-90fd-7a87925e4b8d req-723036af-5c54-40e4-b94f-06ef14683b1b service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Received event network-vif-plugged-422780a3-5bb4-45a5-9253-eaddfaccd00f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dea602d2-a7a4-464e-90fd-7a87925e4b8d req-723036af-5c54-40e4-b94f-06ef14683b1b service nova] Acquiring lock "7576bf64-216a-4d1a-88a2-b90468e61515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dea602d2-a7a4-464e-90fd-7a87925e4b8d req-723036af-5c54-40e4-b94f-06ef14683b1b service nova] Lock "7576bf64-216a-4d1a-88a2-b90468e61515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dea602d2-a7a4-464e-90fd-7a87925e4b8d req-723036af-5c54-40e4-b94f-06ef14683b1b service nova] Lock "7576bf64-216a-4d1a-88a2-b90468e61515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-dea602d2-a7a4-464e-90fd-7a87925e4b8d req-723036af-5c54-40e4-b94f-06ef14683b1b service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] No waiting events found dispatching network-vif-plugged-422780a3-5bb4-45a5-9253-eaddfaccd00f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:26:22 user nova-compute[74630]: WARNING nova.compute.manager [req-dea602d2-a7a4-464e-90fd-7a87925e4b8d req-723036af-5c54-40e4-b94f-06ef14683b1b service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Received unexpected event network-vif-plugged-422780a3-5bb4-45a5-9253-eaddfaccd00f for instance with vm_state building and task_state spawning.
Oct 26 03:26:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:26:22 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Instance spawned successfully.
Oct 26 03:26:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:22 user nova-compute[74630]: INFO nova.compute.manager [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Took 7.14 seconds to spawn the instance on the hypervisor.
Oct 26 03:26:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZLrARmS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:26:23 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:26:23 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:26:23 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[881743ca-f36a-4746-ad8f-d921eb91dc56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:26:23 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:26:23 user nova-compute[74630]: INFO nova.compute.manager [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Took 8.28 seconds to build instance.
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4643e3ba-efab-40ba-a8e5-0b7ed269877b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516] added
Oct 26 03:26:23 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-16875593-d48a-4f6c-9a15-4ad5d8c03508 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.405s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[75de9045-d888-489e-9ed3-b2f220df508e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52c5c01-e9ee-4b40-8666-c288c7c5de14]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZLrARmS {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZLrARmS" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7656079f-e971-4481-9213-be4c896253ea]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OZLrARmS'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[60418851-0ece-49db-a750-adab557a043c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e194623a-843f-425a-abf4-1809133797dc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:26:23 user nova-compute[74630]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:26:23 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:26:23 user nova-compute[74630]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:26:23 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a4d096-597e-40b0-ac98-bbd3a9480c90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260]
Oct 26 03:26:23 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260] successful.
Oct 26 03:26:23 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca229e33-3ac7-485a-8272-206abdd7e8ae]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdcac33-b4df-4219-b966-e1eb9d3d690d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:26:23 user nova-compute[74630]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:26:23 user nova-compute[74630]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:26:23 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:26:23 user nova-compute[74630]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:26:23 user nova-compute[74630]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:26:23 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8582abb3-f639-479c-a48f-eebd857d7011]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZLrARmS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.928s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:26:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] <== connect_volume: return (1931ms) {'type': 'block', 'scsi_wwn': '26465626636623237', 'path': '/dev/sdd'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:26:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465626636623237', 'path': '/dev/sdd'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:25 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:26:25 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=7199MB free_disk=25.215900421142578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.manager [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.objects.instance [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lazy-loading 'flavor' on Instance uuid f5441872-864e-44d9-8632-e05c5d71bd90 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:26:25 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:26:25 user nova-compute[74630]:   <source dev="/dev/sdd"/>
Oct 26 03:26:25 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:26:25 user nova-compute[74630]:   <serial>9de496c0-3619-4b18-b4a4-4e490cbfe516</serial>
Oct 26 03:26:25 user nova-compute[74630]: </disk>
Oct 26 03:26:25 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.manager [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Applying migration context for instance 65ff804f-8b98-406d-8c5c-3d73bb52ff18 as it has an incoming, in-progress migration 2047908f-d5af-45f5-8a55-68abbbbe7af0. Migration status is reverting {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 03:26:25 user nova-compute[74630]: INFO nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updating resource usage from migration 2047908f-d5af-45f5-8a55-68abbbbe7af0
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.network.neutron [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Port b965ee06-ed93-40fc-9732-974c808f5c36 binding to destination host user is already ACTIVE {{(pid=74630) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquired lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.network.neutron [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 747e596d-d9b3-4af2-be42-0fd494b6ef9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d1591088-0892-4aa5-b7ea-3addb083bc69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f5441872-864e-44d9-8632-e05c5d71bd90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 1599e499-12ac-4e25-97a4-17341a03f8c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Migration 2047908f-d5af-45f5-8a55-68abbbbe7af0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 65ff804f-8b98-406d-8c5c-3d73bb52ff18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 980e7a2f-b94d-4544-9e50-03f96fd376fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7576bf64-216a-4d1a-88a2-b90468e61515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance ab04a3a9-4a73-49d1-898a-547cb961e43f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing inventories for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating ProviderTree inventory for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating inventory in ProviderTree for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] No VIF found with MAC fa:16:3e:3d:9b:96, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing aggregate associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, aggregates: None {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing trait associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, traits: HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.network.neutron [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updating instance_info_cache with network_info: [{"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a174ffd7-ee01-45f5-af54-db87a90f3304 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f5441872-864e-44d9-8632-e05c5d71bd90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.797s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Releasing lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Creating tmpfile /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/tmpoguypm3r to verify with other compute node that the instance is on the same shared storage. {{(pid=74630) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG nova.compute.manager [req-e0e41adc-4981-4111-8a0a-6e701533614f req-d3d4ddec-6b13-46e5-aa91-9227d53f8825 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-vif-unplugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e0e41adc-4981-4111-8a0a-6e701533614f req-d3d4ddec-6b13-46e5-aa91-9227d53f8825 service nova] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e0e41adc-4981-4111-8a0a-6e701533614f req-d3d4ddec-6b13-46e5-aa91-9227d53f8825 service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e0e41adc-4981-4111-8a0a-6e701533614f req-d3d4ddec-6b13-46e5-aa91-9227d53f8825 service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG nova.compute.manager [req-e0e41adc-4981-4111-8a0a-6e701533614f req-d3d4ddec-6b13-46e5-aa91-9227d53f8825 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] No waiting events found dispatching network-vif-unplugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:26:26 user nova-compute[74630]: WARNING nova.compute.manager [req-e0e41adc-4981-4111-8a0a-6e701533614f req-d3d4ddec-6b13-46e5-aa91-9227d53f8825 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received unexpected event network-vif-unplugged-b965ee06-ed93-40fc-9732-974c808f5c36 for instance with vm_state resized and task_state resize_reverting.
Oct 26 03:26:26 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.344s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.923s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:26:26 user nova-compute[74630]: INFO nova.compute.claims [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Claim successful on node user
Oct 26 03:26:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:26 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Instance destroyed successfully.
Oct 26 03:26:26 user nova-compute[74630]: DEBUG nova.objects.instance [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lazy-loading 'resources' on Instance uuid 65ff804f-8b98-406d-8c5c-3d73bb52ff18 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1501494997',display_name='tempest-ServerActionsTestOtherB-server-1501494997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1501494997',id=5,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFIeBoj6ZVV6vjKZ5C8Qtaf45gZ5VQLu8uYxcKaMISZ7A/ITCT4P2Cxj8DgdsT8tNJFXq2qSIv9+4+e1q0xZrix9FhWGUlPhtxOjh9fvNN5qcQ+ZdFKB+/mBI3I8ldOaQ==',key_name='tempest-keypair-565299267',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03fc5bdbf0b947b49f6a6c8d44630ed5',ramdisk_id='',reservation_id='r-4c005us9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-638189769',owner_user_name='tempest-ServerActionsTestOtherB-638189769-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:25:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e27a2c56890d4be0a3fb46bd748fa7cf',uuid=65ff804f-8b98-406d-8c5c-3d73bb52ff18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converting VIF {"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG os_vif [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb965ee06-ed, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afb4089e-7385-4db8-aefa-e0be6c34aafc) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:26:26 user nova-compute[74630]: INFO os_vif [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed')
Oct 26 03:26:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxkXluOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:26:26 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:26:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebe0e78-93f9-4109-b351-4411846f41c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:26:26 user nova-compute[74630]: No targets found.
Oct 26 03:26:26 user nova-compute[74630]: iSNS:
Oct 26 03:26:26 user nova-compute[74630]: No targets found.
Oct 26 03:26:26 user nova-compute[74630]: STATIC:
Oct 26 03:26:26 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:26:26 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:26:26 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:26:26 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677
Oct 26 03:26:26 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:26:26 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:26:26 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:26:26 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:26:26 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:26:26 user nova-compute[74630]: FIRMWARE:
Oct 26 03:26:26 user nova-compute[74630]: No targets found.
Oct 26 03:26:26 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:26:26 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:26:26 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bf848f-4c33-49db-a6f3-f93ab64934f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[08af4800-29cd-487a-b970-63ecd09ba285]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:26:26 user nova-compute[74630]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:26:26 user nova-compute[74630]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:26:26 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:26:26 user nova-compute[74630]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:26:26 user nova-compute[74630]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:26:26 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c796950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677'): ({'sdc'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Removing single pathed devices sdc {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:26:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfaaadb-b451-4afd-9885-4e1965c65316]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7917e972-33dd-43c1-909b-7e4fbee40ac6]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Flushing IO for device /dev/sdc {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc7a93d-d775-4d6c-a015-7e8f40be46d0]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c332fd12-7ea0-4262-b3c5-ccd4cfe7a5e3]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1279ec-74b3-424a-b36c-1f3c0bf4a633]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.918s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.743s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:26:27 user nova-compute[74630]: INFO nova.compute.claims [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Claim successful on node user
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --logout" returned: 0 in 0.163s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[22870128-9133-4d1b-92fe-64f759d7b56b]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260]
Oct 26 03:26:27 user nova-compute[74630]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260] successful.
Oct 26 03:26:27 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[655f2844-0b9a-40a0-b7fe-81346562f5b4]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.493s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] <== disconnect_volume: return (496ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:26:27 user nova-compute[74630]: INFO nova.compute.manager [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Rebuilding instance
Oct 26 03:26:27 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:26:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:26:27 user nova-compute[74630]: INFO nova.virt.block_device [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Booting with volume 512737dd-f70d-4cc3-8a77-936583fa73ed at /dev/vda
Oct 26 03:26:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.utils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad19574e-b5e0-4b01-a082-33573e11ba75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG nova.policy [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a7d636306a941bbbedf02c4ea8edd30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a9993c7e16f451abd29d628bbc78ff2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ee36cf-5230-41b4-ab06-88d81e86d194]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd12b41-7650-4607-b9e6-b2cf16315175]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[84de6a15-51f3-4ac3-9dd3-b0b29644f5cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:26:27 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9569e99a-9ad7-4752-a95c-67368f028255]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG os_brick.utils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] <== get_connector_properties: return (209ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updating existing volume attachment record: 21d07ee3-7ef2-45ff-a166-ec16d1b8e8a3 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-d4323783-bade-4982-b24b-97063804dcd1 req-02547dd8-3b7c-487f-97e2-496ef49a47a8 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received event network-vif-unplugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d4323783-bade-4982-b24b-97063804dcd1 req-02547dd8-3b7c-487f-97e2-496ef49a47a8 service nova] Acquiring lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d4323783-bade-4982-b24b-97063804dcd1 req-02547dd8-3b7c-487f-97e2-496ef49a47a8 service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d4323783-bade-4982-b24b-97063804dcd1 req-02547dd8-3b7c-487f-97e2-496ef49a47a8 service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-d4323783-bade-4982-b24b-97063804dcd1 req-02547dd8-3b7c-487f-97e2-496ef49a47a8 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] No waiting events found dispatching network-vif-unplugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:26:27 user nova-compute[74630]: WARNING nova.compute.manager [req-d4323783-bade-4982-b24b-97063804dcd1 req-02547dd8-3b7c-487f-97e2-496ef49a47a8 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received unexpected event network-vif-unplugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 for instance with vm_state active and task_state rebuilding.
Oct 26 03:26:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.992s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG nova.compute.manager [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-bdf18b3c-2c41-4205-ba0a-f671f64b8e0f req-9e8426a5-37a3-4bf8-8c56-60d43e7d58cc service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bdf18b3c-2c41-4205-ba0a-f671f64b8e0f req-9e8426a5-37a3-4bf8-8c56-60d43e7d58cc service nova] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bdf18b3c-2c41-4205-ba0a-f671f64b8e0f req-9e8426a5-37a3-4bf8-8c56-60d43e7d58cc service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bdf18b3c-2c41-4205-ba0a-f671f64b8e0f req-9e8426a5-37a3-4bf8-8c56-60d43e7d58cc service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-bdf18b3c-2c41-4205-ba0a-f671f64b8e0f req-9e8426a5-37a3-4bf8-8c56-60d43e7d58cc service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] No waiting events found dispatching network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:26:28 user nova-compute[74630]: WARNING nova.compute.manager [req-bdf18b3c-2c41-4205-ba0a-f671f64b8e0f req-9e8426a5-37a3-4bf8-8c56-60d43e7d58cc service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received unexpected event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 for instance with vm_state resized and task_state resize_reverting.
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG nova.compute.manager [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG nova.network.neutron [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:26:28 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:26:28 user nova-compute[74630]: DEBUG nova.compute.manager [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:26:28 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Instance destroyed successfully.
Oct 26 03:26:28 user nova-compute[74630]: DEBUG nova.policy [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61f0a167683a42fcacac8fd8532812ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9079bef72e74a65956113a03d158599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:26:28 user nova-compute[74630]: INFO nova.virt.block_device [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Booting with volume ba36f137-d667-483f-9b08-7b0193c3f550 at /dev/vda
Oct 26 03:26:28 user nova-compute[74630]: INFO nova.compute.manager [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Detaching volume 9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.utils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c021ff63-66f6-48bc-baaf-08c63371a814]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Successfully created port: 47b60220-f566-48bd-8309-1f01ac44210f {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:26:28 user nova-compute[74630]: INFO nova.virt.block_device [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Attempting to driver detach volume 9de496c0-3619-4b18-b4a4-4e490cbfe516 from mountpoint /dev/vdb
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d266197-1213-42af-b1b3-857a768719f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Attempting to detach device vdb from instance f5441872-864e-44d9-8632-e05c5d71bd90 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:26:28 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:26:28 user nova-compute[74630]:   <source dev="/dev/sdd"/>
Oct 26 03:26:28 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:26:28 user nova-compute[74630]:   <serial>9de496c0-3619-4b18-b4a4-4e490cbfe516</serial>
Oct 26 03:26:28 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:26:28 user nova-compute[74630]: </disk>
Oct 26 03:26:28 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed183632-59ee-4eda-8c87-a4fe10eddabd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcc16f1-1305-4962-a862-ac2354361c3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:28 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Successfully detached device vdb from instance f5441872-864e-44d9-8632-e05c5d71bd90 from the persistent domain config.
Oct 26 03:26:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZLrARmS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:26:28 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:26:28 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60f0537-cf79-4f19-8d85-e71fe4a11261]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.utils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Updating existing volume attachment record: 0b7055d1-76ef-4136-8ac2-f0380a3ec2d7 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a49f939-87d6-4a2b-a84e-b6f728eea3dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:26:28 user nova-compute[74630]: No targets found.
Oct 26 03:26:28 user nova-compute[74630]: iSNS:
Oct 26 03:26:28 user nova-compute[74630]: No targets found.
Oct 26 03:26:28 user nova-compute[74630]: STATIC:
Oct 26 03:26:28 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:26:28 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:26:28 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:26:28 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:26:28 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:26:28 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:26:28 user nova-compute[74630]: FIRMWARE:
Oct 26 03:26:28 user nova-compute[74630]: No targets found.
Oct 26 03:26:28 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:26:28 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:26:28 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e0fc0e-0d19-4489-bb11-22b18f531ad6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f313f44a-7352-43df-a4e7-9658900e2a89]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:26:28 user nova-compute[74630]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:26:28 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:26:28 user nova-compute[74630]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:26:28 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c0fd5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516'): ({'sdd'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Removing single pathed devices sdd {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:26:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7a688a-aee3-4dd5-8ca9-0e5648f3a16c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e451c19-b21f-4fc0-b0f3-2f3bf1be82f1]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Flushing IO for device /dev/sdd {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f8005a-cd27-431e-be02-b65f67156626]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[127d2b50-b53a-4c92-8bd1-dbf1a6df36f7]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08a1bd7-6068-4097-9eba-16761758692e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e538c3-eb98-41dd-a731-27bd069986df]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260]
Oct 26 03:26:29 user nova-compute[74630]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260] successful.
Oct 26 03:26:29 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:29 user nova-compute[74630]: WARNING nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] While synchronizing instance power states, found 14 instances in the database and 11 instances on the hypervisor.
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid fa1dd816-9dc1-4d48-b608-aa0218f22369 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 747e596d-d9b3-4af2-be42-0fd494b6ef9a {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 32264781-acf7-4afa-830a-5469b6a4c744 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 65ff804f-8b98-406d-8c5c-3d73bb52ff18 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid f9890dde-e678-41d4-8447-24bf626c2983 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid d1591088-0892-4aa5-b7ea-3addb083bc69 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 40316e54-eee2-4072-b436-4c5bb31724a9 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid f5441872-864e-44d9-8632-e05c5d71bd90 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 1599e499-12ac-4e25-97a4-17341a03f8c3 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 980e7a2f-b94d-4544-9e50-03f96fd376fe {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 7576bf64-216a-4d1a-88a2-b90468e61515 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid ab04a3a9-4a73-49d1-898a-547cb961e43f {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[69857966-4799-4d3f-93eb-18238145902b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "fa1dd816-9dc1-4d48-b608-aa0218f22369" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "32264781-acf7-4afa-830a-5469b6a4c744" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:29 user nova-compute[74630]: INFO nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "f9890dde-e678-41d4-8447-24bf626c2983" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "f9890dde-e678-41d4-8447-24bf626c2983" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "d1591088-0892-4aa5-b7ea-3addb083bc69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "40316e54-eee2-4072-b436-4c5bb31724a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "f5441872-864e-44d9-8632-e05c5d71bd90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "f5441872-864e-44d9-8632-e05c5d71bd90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:29 user nova-compute[74630]: INFO nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] During sync_power_state the instance has a pending task (rebuilding). Skip.
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "f5441872-864e-44d9-8632-e05c5d71bd90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "1599e499-12ac-4e25-97a4-17341a03f8c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "7576bf64-216a-4d1a-88a2-b90468e61515" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] <== disconnect_volume: return (415ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "40316e54-eee2-4072-b436-4c5bb31724a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.171s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.180s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "f9890dde-e678-41d4-8447-24bf626c2983" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.178s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.189s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.193s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.192s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.201s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Successfully created port: 3c706397-f0b9-4d1c-9f03-d7808255fc57 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "32264781-acf7-4afa-830a-5469b6a4c744" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.225s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:29 user nova-compute[74630]: DEBUG nova.network.neutron [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Successfully created port: 3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:26:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-4714488c-436a-4b16-bc2e-33556bf0c481 req-53972a95-bbbf-4129-bd87-99e0fecefa52 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received event network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4714488c-436a-4b16-bc2e-33556bf0c481 req-53972a95-bbbf-4129-bd87-99e0fecefa52 service nova] Acquiring lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4714488c-436a-4b16-bc2e-33556bf0c481 req-53972a95-bbbf-4129-bd87-99e0fecefa52 service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4714488c-436a-4b16-bc2e-33556bf0c481 req-53972a95-bbbf-4129-bd87-99e0fecefa52 service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-4714488c-436a-4b16-bc2e-33556bf0c481 req-53972a95-bbbf-4129-bd87-99e0fecefa52 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] No waiting events found dispatching network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:26:30 user nova-compute[74630]: WARNING nova.compute.manager [req-4714488c-436a-4b16-bc2e-33556bf0c481 req-53972a95-bbbf-4129-bd87-99e0fecefa52 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received unexpected event network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 for instance with vm_state active and task_state rebuilding.
Oct 26 03:26:30 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Successfully created port: 2c3acfbe-013e-4bf0-bb79-c84f9898353c {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:26:30 user nova-compute[74630]: DEBUG nova.network.neutron [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Successfully updated port: 3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:26:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "refresh_cache-90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquired lock "refresh_cache-90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:30 user nova-compute[74630]: DEBUG nova.network.neutron [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:26:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-ba3cdb23-df04-490a-9abd-a645ec997cb3 req-0b728415-0600-4883-aef7-cf956256298b service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received event network-changed-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-ba3cdb23-df04-490a-9abd-a645ec997cb3 req-0b728415-0600-4883-aef7-cf956256298b service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Refreshing instance network info cache due to event network-changed-3918526e-3b7f-40b0-a4fa-e3960470392b. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:26:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ba3cdb23-df04-490a-9abd-a645ec997cb3 req-0b728415-0600-4883-aef7-cf956256298b service nova] Acquiring lock "refresh_cache-90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:30 user nova-compute[74630]: DEBUG nova.network.neutron [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:26:30 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Successfully created port: a2fd53b1-5769-4dea-960f-1797d60e8099 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:26:31 user nova-compute[74630]: DEBUG nova.network.neutron [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Updating instance_info_cache with network_info: [{"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Releasing lock "refresh_cache-90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:31 user nova-compute[74630]: DEBUG nova.compute.manager [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Instance network_info: |[{"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:26:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ba3cdb23-df04-490a-9abd-a645ec997cb3 req-0b728415-0600-4883-aef7-cf956256298b service nova] Acquired lock "refresh_cache-90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:31 user nova-compute[74630]: DEBUG nova.network.neutron [req-ba3cdb23-df04-490a-9abd-a645ec997cb3 req-0b728415-0600-4883-aef7-cf956256298b service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Refreshing network info cache for port 3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:26:31 user nova-compute[74630]: DEBUG nova.network.neutron [req-ba3cdb23-df04-490a-9abd-a645ec997cb3 req-0b728415-0600-4883-aef7-cf956256298b service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Updated VIF entry in instance network info cache for port 3918526e-3b7f-40b0-a4fa-e3960470392b. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:26:31 user nova-compute[74630]: DEBUG nova.network.neutron [req-ba3cdb23-df04-490a-9abd-a645ec997cb3 req-0b728415-0600-4883-aef7-cf956256298b service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Updating instance_info_cache with network_info: [{"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:31 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Successfully created port: b956c51e-f736-461f-956a-29b585d0e31f {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:26:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ba3cdb23-df04-490a-9abd-a645ec997cb3 req-0b728415-0600-4883-aef7-cf956256298b service nova] Releasing lock "refresh_cache-90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:32 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Successfully updated port: 47b60220-f566-48bd-8309-1f01ac44210f {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:26:32 user nova-compute[74630]: DEBUG nova.compute.manager [req-1010d7f9-f622-44a5-be7c-e6e119569d48 req-8f1cc853-85a5-4bee-9be4-6ac8580bdfd5 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-changed-47b60220-f566-48bd-8309-1f01ac44210f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:32 user nova-compute[74630]: DEBUG nova.compute.manager [req-1010d7f9-f622-44a5-be7c-e6e119569d48 req-8f1cc853-85a5-4bee-9be4-6ac8580bdfd5 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing instance network info cache due to event network-changed-47b60220-f566-48bd-8309-1f01ac44210f. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:26:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1010d7f9-f622-44a5-be7c-e6e119569d48 req-8f1cc853-85a5-4bee-9be4-6ac8580bdfd5 service nova] Acquiring lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1010d7f9-f622-44a5-be7c-e6e119569d48 req-8f1cc853-85a5-4bee-9be4-6ac8580bdfd5 service nova] Acquired lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:32 user nova-compute[74630]: DEBUG nova.network.neutron [req-1010d7f9-f622-44a5-be7c-e6e119569d48 req-8f1cc853-85a5-4bee-9be4-6ac8580bdfd5 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing network info cache for port 47b60220-f566-48bd-8309-1f01ac44210f {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:26:32 user nova-compute[74630]: DEBUG nova.network.neutron [req-1010d7f9-f622-44a5-be7c-e6e119569d48 req-8f1cc853-85a5-4bee-9be4-6ac8580bdfd5 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:26:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:32 user nova-compute[74630]: DEBUG nova.network.neutron [req-1010d7f9-f622-44a5-be7c-e6e119569d48 req-8f1cc853-85a5-4bee-9be4-6ac8580bdfd5 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1010d7f9-f622-44a5-be7c-e6e119569d48 req-8f1cc853-85a5-4bee-9be4-6ac8580bdfd5 service nova] Releasing lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:33 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Successfully updated port: 44bdc530-6e50-4fff-b4fc-4fac53dff73a {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:26:34 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Successfully updated port: 35ac986d-579c-4dcb-bee5-536a729a415c {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:26:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-changed-44bdc530-6e50-4fff-b4fc-4fac53dff73a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing instance network info cache due to event network-changed-44bdc530-6e50-4fff-b4fc-4fac53dff73a. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:26:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] Acquiring lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] Acquired lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:34 user nova-compute[74630]: DEBUG nova.network.neutron [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing network info cache for port 44bdc530-6e50-4fff-b4fc-4fac53dff73a {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:26:34 user nova-compute[74630]: DEBUG nova.network.neutron [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:26:34 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Successfully updated port: 3c706397-f0b9-4d1c-9f03-d7808255fc57 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:26:35 user nova-compute[74630]: DEBUG nova.network.neutron [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] Releasing lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:35 user nova-compute[74630]: DEBUG nova.compute.manager [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-changed-35ac986d-579c-4dcb-bee5-536a729a415c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:35 user nova-compute[74630]: DEBUG nova.compute.manager [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing instance network info cache due to event network-changed-35ac986d-579c-4dcb-bee5-536a729a415c. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:26:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] Acquiring lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] Acquired lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:35 user nova-compute[74630]: DEBUG nova.network.neutron [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing network info cache for port 35ac986d-579c-4dcb-bee5-536a729a415c {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:26:35 user nova-compute[74630]: DEBUG nova.network.neutron [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:26:35 user nova-compute[74630]: DEBUG nova.network.neutron [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f00cb219-4019-4edf-bc19-e6350498ada2 req-5f957f6a-9c9d-4b96-9426-9d6987452461 service nova] Releasing lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:35 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Successfully updated port: 2c3acfbe-013e-4bf0-bb79-c84f9898353c {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:26:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Successfully updated port: a2fd53b1-5769-4dea-960f-1797d60e8099 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:26:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Successfully updated port: b956c51e-f736-461f-956a-29b585d0e31f {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:26:36 user nova-compute[74630]: DEBUG nova.compute.manager [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-changed-3c706397-f0b9-4d1c-9f03-d7808255fc57 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:36 user nova-compute[74630]: DEBUG nova.compute.manager [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing instance network info cache due to event network-changed-3c706397-f0b9-4d1c-9f03-d7808255fc57. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:26:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] Acquiring lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] Acquired lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:36 user nova-compute[74630]: DEBUG nova.network.neutron [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing network info cache for port 3c706397-f0b9-4d1c-9f03-d7808255fc57 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:26:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:36 user nova-compute[74630]: DEBUG nova.network.neutron [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:26:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG nova.network.neutron [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] Releasing lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-changed-2c3acfbe-013e-4bf0-bb79-c84f9898353c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing instance network info cache due to event network-changed-2c3acfbe-013e-4bf0-bb79-c84f9898353c. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] Acquiring lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] Acquired lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG nova.network.neutron [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing network info cache for port 2c3acfbe-013e-4bf0-bb79-c84f9898353c {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG nova.network.neutron [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG nova.network.neutron [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] Releasing lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-changed-a2fd53b1-5769-4dea-960f-1797d60e8099 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing instance network info cache due to event network-changed-a2fd53b1-5769-4dea-960f-1797d60e8099. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] Acquiring lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] Acquired lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG nova.network.neutron [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing network info cache for port a2fd53b1-5769-4dea-960f-1797d60e8099 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG nova.network.neutron [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG nova.network.neutron [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-05cce61e-cea3-4551-bcda-76a3f352a1ad req-b54837f5-beb1-42c3-b483-a33bf317c563 service nova] Releasing lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquired lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:26:37 user nova-compute[74630]: DEBUG nova.objects.instance [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lazy-loading 'migration_context' on Instance uuid 65ff804f-8b98-406d-8c5c-3d73bb52ff18 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "1599e499-12ac-4e25-97a4-17341a03f8c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "1599e499-12ac-4e25-97a4-17341a03f8c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:38 user nova-compute[74630]: INFO nova.compute.manager [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Terminating instance
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.compute.manager [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.objects.base [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Object Instance<65ff804f-8b98-406d-8c5c-3d73bb52ff18> lazy-loaded attributes: resources,migration_context {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-bf9de363-125e-4beb-9716-604dfc8ba467 req-76a212d0-ec5d-479e-8248-bc5e8aefa5bb service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Received event network-vif-unplugged-27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bf9de363-125e-4beb-9716-604dfc8ba467 req-76a212d0-ec5d-479e-8248-bc5e8aefa5bb service nova] Acquiring lock "1599e499-12ac-4e25-97a4-17341a03f8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bf9de363-125e-4beb-9716-604dfc8ba467 req-76a212d0-ec5d-479e-8248-bc5e8aefa5bb service nova] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bf9de363-125e-4beb-9716-604dfc8ba467 req-76a212d0-ec5d-479e-8248-bc5e8aefa5bb service nova] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-bf9de363-125e-4beb-9716-604dfc8ba467 req-76a212d0-ec5d-479e-8248-bc5e8aefa5bb service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] No waiting events found dispatching network-vif-unplugged-27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-bf9de363-125e-4beb-9716-604dfc8ba467 req-76a212d0-ec5d-479e-8248-bc5e8aefa5bb service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Received event network-vif-unplugged-27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.717s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:38 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Instance destroyed successfully.
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.objects.instance [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lazy-loading 'resources' on Instance uuid 1599e499-12ac-4e25-97a4-17341a03f8c3 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:24:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-415712306',display_name='tempest-VolumesAdminNegativeTest-server-415712306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-415712306',id=16,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:24:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eccd4345949848cba29e4c991b6cb3b6',ramdisk_id='',reservation_id='r-1vvu4sft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-741862100',owner_user_name='tempest-VolumesAdminNegativeTest-741862100-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:24:18Z,user_data=None,user_id='accb78f69ef64c9bacb02969887c3aa2',uuid=1599e499-12ac-4e25-97a4-17341a03f8c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "address": "fa:16:3e:fd:77:e7", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ccbd00-a0", "ovs_interfaceid": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Converting VIF {"id": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "address": "fa:16:3e:fd:77:e7", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27ccbd00-a0", "ovs_interfaceid": "27ccbd00-a0dd-4ff0-80d7-03e165b5cd43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:77:e7,bridge_name='br-int',has_traffic_filtering=True,id=27ccbd00-a0dd-4ff0-80d7-03e165b5cd43,network=Network(2ebb9b88-a9a3-4efd-a6e3-be76353d6be5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ccbd00-a0') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG os_vif [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:77:e7,bridge_name='br-int',has_traffic_filtering=True,id=27ccbd00-a0dd-4ff0-80d7-03e165b5cd43,network=Network(2ebb9b88-a9a3-4efd-a6e3-be76353d6be5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ccbd00-a0') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27ccbd00-a0, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-29e87ff7-74ce-48ee-ba12-2109c8c22406 req-dffc0c2c-17f7-4e1b-83ce-74e10a94647d service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-changed-b956c51e-f736-461f-956a-29b585d0e31f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-29e87ff7-74ce-48ee-ba12-2109c8c22406 req-dffc0c2c-17f7-4e1b-83ce-74e10a94647d service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing instance network info cache due to event network-changed-b956c51e-f736-461f-956a-29b585d0e31f. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-29e87ff7-74ce-48ee-ba12-2109c8c22406 req-dffc0c2c-17f7-4e1b-83ce-74e10a94647d service nova] Acquiring lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e921cf24-7c5f-46f5-8cf2-060dadd3d16a) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:38 user nova-compute[74630]: INFO os_vif [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:77:e7,bridge_name='br-int',has_traffic_filtering=True,id=27ccbd00-a0dd-4ff0-80d7-03e165b5cd43,network=Network(2ebb9b88-a9a3-4efd-a6e3-be76353d6be5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27ccbd00-a0')
Oct 26 03:26:38 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Deleting instance files /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3_del
Oct 26 03:26:38 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Deletion of /opt/stack/data/nova/instances/1599e499-12ac-4e25-97a4-17341a03f8c3_del complete
Oct 26 03:26:38 user nova-compute[74630]: INFO nova.compute.manager [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Swapping old allocation on dict_keys(['2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5']) held by migration 2047908f-d5af-45f5-8a55-68abbbbe7af0 for instance
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Overwriting current allocation {'allocations': {'2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 24}}, 'project_id': '03fc5bdbf0b947b49f6a6c8d44630ed5', 'user_id': 'e27a2c56890d4be0a3fb46bd748fa7cf', 'consumer_generation': 1} on consumer 65ff804f-8b98-406d-8c5c-3d73bb52ff18 {{(pid=74630) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 26 03:26:38 user nova-compute[74630]: INFO nova.compute.manager [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 26 03:26:38 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:26:38 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:26:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquired lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:39 user nova-compute[74630]: DEBUG nova.network.neutron [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:26:39 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:39 user nova-compute[74630]: DEBUG nova.compute.manager [req-11595abf-2aec-4ec4-b19a-47cc9076da4f req-92c6b0ea-1521-4716-999b-4bb951c61b8a service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Received event network-vif-deleted-27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:39 user nova-compute[74630]: INFO nova.compute.manager [req-11595abf-2aec-4ec4-b19a-47cc9076da4f req-92c6b0ea-1521-4716-999b-4bb951c61b8a service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Neutron deleted interface 27ccbd00-a0dd-4ff0-80d7-03e165b5cd43; detaching it from the instance and deleting it from the info cache
Oct 26 03:26:39 user nova-compute[74630]: DEBUG nova.network.neutron [req-11595abf-2aec-4ec4-b19a-47cc9076da4f req-92c6b0ea-1521-4716-999b-4bb951c61b8a service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:39 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Took 0.47 seconds to deallocate network for instance.
Oct 26 03:26:39 user nova-compute[74630]: DEBUG nova.compute.manager [req-11595abf-2aec-4ec4-b19a-47cc9076da4f req-92c6b0ea-1521-4716-999b-4bb951c61b8a service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Detach interface failed, port_id=27ccbd00-a0dd-4ff0-80d7-03e165b5cd43, reason: Instance 1599e499-12ac-4e25-97a4-17341a03f8c3 could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 03:26:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:39 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:26:39 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:26:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:39 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Deleted allocations for instance 1599e499-12ac-4e25-97a4-17341a03f8c3
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9637f9e7-26fe-42c5-a312-f0cf043d0040 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.100s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG nova.network.neutron [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updating instance_info_cache with network_info: [{"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Releasing lock "refresh_cache-65ff804f-8b98-406d-8c5c-3d73bb52ff18" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG os_brick.utils [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fd659b-68c2-4d76-bbca-b787f81912a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a778e61c-7758-4898-9e48-00f76c6297c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8390b606-e667-4606-b97c-2872a2cc2e0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d010de-2129-4700-bc15-01e61b47900d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:26:40 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fdd873-314e-44af-90a1-1b95149b64c1]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG os_brick.utils [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG nova.network.neutron [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updating instance_info_cache with network_info: [{"id": "47b60220-f566-48bd-8309-1f01ac44210f", "address": "fa:16:3e:5c:90:01", "network": {"id": "60b1d36a-bbd2-490b-aee0-e81b6501a8e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-631511684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b60220-f5", "ovs_interfaceid": "47b60220-f566-48bd-8309-1f01ac44210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "address": "fa:16:3e:d4:5b:5e", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bdc530-6e", "ovs_interfaceid": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35ac986d-579c-4dcb-bee5-536a729a415c", "address": "fa:16:3e:4f:75:e2", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac986d-57", "ovs_interfaceid": "35ac986d-579c-4dcb-bee5-536a729a415c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "address": "fa:16:3e:db:93:52", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c706397-f0", "ovs_interfaceid": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3acfbe-01", "ovs_interfaceid": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2fd53b1-5769-4dea-960f-1797d60e8099", "address": "fa:16:3e:81:96:39", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fd53b1-57", "ovs_interfaceid": "a2fd53b1-5769-4dea-960f-1797d60e8099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b956c51e-f736-461f-956a-29b585d0e31f", "address": "fa:16:3e:a3:a3:f3", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb956c51e-f7", "ovs_interfaceid": "b956c51e-f736-461f-956a-29b585d0e31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-181cd553-001c-46d4-bbf9-9f53d1d8f6c7 req-4f514b0f-cba7-4957-a810-b63f00a00230 service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Received event network-vif-plugged-27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-181cd553-001c-46d4-bbf9-9f53d1d8f6c7 req-4f514b0f-cba7-4957-a810-b63f00a00230 service nova] Acquiring lock "1599e499-12ac-4e25-97a4-17341a03f8c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-181cd553-001c-46d4-bbf9-9f53d1d8f6c7 req-4f514b0f-cba7-4957-a810-b63f00a00230 service nova] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-181cd553-001c-46d4-bbf9-9f53d1d8f6c7 req-4f514b0f-cba7-4957-a810-b63f00a00230 service nova] Lock "1599e499-12ac-4e25-97a4-17341a03f8c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-181cd553-001c-46d4-bbf9-9f53d1d8f6c7 req-4f514b0f-cba7-4957-a810-b63f00a00230 service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] No waiting events found dispatching network-vif-plugged-27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:26:40 user nova-compute[74630]: WARNING nova.compute.manager [req-181cd553-001c-46d4-bbf9-9f53d1d8f6c7 req-4f514b0f-cba7-4957-a810-b63f00a00230 service nova] [instance: 1599e499-12ac-4e25-97a4-17341a03f8c3] Received unexpected event network-vif-plugged-27ccbd00-a0dd-4ff0-80d7-03e165b5cd43 for instance with vm_state deleted and task_state None.
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Releasing lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG nova.compute.manager [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Instance network_info: |[{"id": "47b60220-f566-48bd-8309-1f01ac44210f", "address": "fa:16:3e:5c:90:01", "network": {"id": "60b1d36a-bbd2-490b-aee0-e81b6501a8e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-631511684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b60220-f5", "ovs_interfaceid": "47b60220-f566-48bd-8309-1f01ac44210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "address": "fa:16:3e:d4:5b:5e", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bdc530-6e", "ovs_interfaceid": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35ac986d-579c-4dcb-bee5-536a729a415c", "address": "fa:16:3e:4f:75:e2", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac986d-57", "ovs_interfaceid": "35ac986d-579c-4dcb-bee5-536a729a415c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "address": "fa:16:3e:db:93:52", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c706397-f0", "ovs_interfaceid": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3acfbe-01", "ovs_interfaceid": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2fd53b1-5769-4dea-960f-1797d60e8099", "address": "fa:16:3e:81:96:39", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fd53b1-57", "ovs_interfaceid": "a2fd53b1-5769-4dea-960f-1797d60e8099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b956c51e-f736-461f-956a-29b585d0e31f", "address": "fa:16:3e:a3:a3:f3", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb956c51e-f7", "ovs_interfaceid": "b956c51e-f736-461f-956a-29b585d0e31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-29e87ff7-74ce-48ee-ba12-2109c8c22406 req-dffc0c2c-17f7-4e1b-83ce-74e10a94647d service nova] Acquired lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG nova.network.neutron [req-29e87ff7-74ce-48ee-ba12-2109c8c22406 req-dffc0c2c-17f7-4e1b-83ce-74e10a94647d service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing network info cache for port b956c51e-f736-461f-956a-29b585d0e31f {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG nova.network.neutron [req-29e87ff7-74ce-48ee-ba12-2109c8c22406 req-dffc0c2c-17f7-4e1b-83ce-74e10a94647d service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updated VIF entry in instance network info cache for port b956c51e-f736-461f-956a-29b585d0e31f. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG nova.network.neutron [req-29e87ff7-74ce-48ee-ba12-2109c8c22406 req-dffc0c2c-17f7-4e1b-83ce-74e10a94647d service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updating instance_info_cache with network_info: [{"id": "47b60220-f566-48bd-8309-1f01ac44210f", "address": "fa:16:3e:5c:90:01", "network": {"id": "60b1d36a-bbd2-490b-aee0-e81b6501a8e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-631511684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b60220-f5", "ovs_interfaceid": "47b60220-f566-48bd-8309-1f01ac44210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "address": "fa:16:3e:d4:5b:5e", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bdc530-6e", "ovs_interfaceid": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35ac986d-579c-4dcb-bee5-536a729a415c", "address": "fa:16:3e:4f:75:e2", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac986d-57", "ovs_interfaceid": "35ac986d-579c-4dcb-bee5-536a729a415c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "address": "fa:16:3e:db:93:52", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c706397-f0", "ovs_interfaceid": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3acfbe-01", "ovs_interfaceid": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2fd53b1-5769-4dea-960f-1797d60e8099", "address": "fa:16:3e:81:96:39", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fd53b1-57", "ovs_interfaceid": "a2fd53b1-5769-4dea-960f-1797d60e8099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b956c51e-f736-461f-956a-29b585d0e31f", "address": "fa:16:3e:a3:a3:f3", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb956c51e-f7", "ovs_interfaceid": "b956c51e-f736-461f-956a-29b585d0e31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-29e87ff7-74ce-48ee-ba12-2109c8c22406 req-dffc0c2c-17f7-4e1b-83ce-74e10a94647d service nova] Releasing lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:51 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Instance destroyed successfully.
Oct 26 03:26:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-408750285',display_name='tempest-ServerActionsTestOtherA-server-1153489039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-408750285',id=15,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRQj+j0h8s5l5/c9Kzf5LlZUmn49bhrlJ3uSCaWTItfHpDtTlIsJ4WHGZJvTY9PtPQoKpGGVmQzLPcnzgoq3B+7cpI6c0xMS0qeeWXVorHztRqAqFqwFVzyTc7R0LLXqA==',key_name='tempest-keypair-1000691134',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51542ffdf7a84ac5a61f14e124eb2087',ramdisk_id='',reservation_id='r-6oe0n30b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-41539930',owner_user_name='tempest-ServerActionsTestOtherA-41539930-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a419737713f4797ab27db62d5aa746c',uuid=f5441872-864e-44d9-8632-e05c5d71bd90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converting VIF {"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:9b:96,bridge_name='br-int',has_traffic_filtering=True,id=add088cb-2d9c-4ad2-a72b-64f1138ddfa2,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd088cb-2d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_vif [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:9b:96,bridge_name='br-int',has_traffic_filtering=True,id=add088cb-2d9c-4ad2-a72b-64f1138ddfa2,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd088cb-2d') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadd088cb-2d, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4881815-4be1-46b2-b837-b3087a5546ea) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:51 user nova-compute[74630]: INFO os_vif [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:9b:96,bridge_name='br-int',has_traffic_filtering=True,id=add088cb-2d9c-4ad2-a72b-64f1138ddfa2,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd088cb-2d')
Oct 26 03:26:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZLrARmS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:26:51 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[729ce45a-c85f-481b-964f-12b988f2330c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:26:51 user nova-compute[74630]: No targets found.
Oct 26 03:26:51 user nova-compute[74630]: iSNS:
Oct 26 03:26:51 user nova-compute[74630]: No targets found.
Oct 26 03:26:51 user nova-compute[74630]: STATIC:
Oct 26 03:26:51 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:26:51 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:26:51 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:26:51 user nova-compute[74630]: FIRMWARE:
Oct 26 03:26:51 user nova-compute[74630]: No targets found.
Oct 26 03:26:51 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:26:51 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:26:51 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:51 user nova-compute[74630]: INFO nova.virt.block_device [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Booting with volume 371afae4-ff7a-483d-aeea-94b83bcb16d6 at /dev/vdb
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[843e441f-2754-4b00-8c78-a53e07741dda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf08755-d56c-4410-ba90-f8f77d0314c7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:26:51 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:26:51 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f318d7a9bd0>, {}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Disconnecting from: [] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] <== disconnect_volume: return (87ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:26:51 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Deleting instance files /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90_del
Oct 26 03:26:51 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Deletion of /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90_del complete
Oct 26 03:26:51 user nova-compute[74630]: INFO nova.virt.block_device [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Booting with volume 9de496c0-3619-4b18-b4a4-4e490cbfe516 at /dev/vdb
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.utils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[592dea2f-5bbe-48f5-83a1-eb48a66a1e68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[009013db-f938-4f57-94b7-029be932bcae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[822d5304-62ce-497a-8858-42f10498933b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ea788f-670d-4d31-a42e-cc4be30ef85f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.utils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c1d002-3e6a-4b24-a4d1-a5db96b28a6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:26:51 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6acd68-e7e7-40e5-9a38-774d1244dfb0]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.utils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updating existing volume attachment record: cc348f63-23ab-4a7f-9475-860c6296d7dd {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0326910f-2650-4c1a-94ee-88479402f7fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7356c8ca-1cec-40f5-8f35-bc76c1fdf3c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9c5cb4-6157-4078-aad7-b282bd5cb3b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:26:51 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:26:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ac27ef-2c9e-49fa-ba03-94c8dac8abf5]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG os_brick.utils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:26:51 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Updating existing volume attachment record: 6fe51949-5fb3-4724-8d3d-d9b0259dc27e {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:26:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:58 user nova-compute[74630]: INFO nova.compute.manager [None req-8797294c-fc62-4a5c-8b1c-a7555c39231f tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Unrescuing
Oct 26 03:26:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8797294c-fc62-4a5c-8b1c-a7555c39231f tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8797294c-fc62-4a5c-8b1c-a7555c39231f tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquired lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:58 user nova-compute[74630]: DEBUG nova.network.neutron [None req-8797294c-fc62-4a5c-8b1c-a7555c39231f tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:26:59 user nova-compute[74630]: DEBUG nova.network.neutron [None req-8797294c-fc62-4a5c-8b1c-a7555c39231f tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Updating instance_info_cache with network_info: [{"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:26:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8797294c-fc62-4a5c-8b1c-a7555c39231f tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Releasing lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:26:59 user nova-compute[74630]: DEBUG nova.objects.instance [None req-8797294c-fc62-4a5c-8b1c-a7555c39231f tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'flavor' on Instance uuid 32264781-acf7-4afa-830a-5469b6a4c744 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:26:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:59 user nova-compute[74630]: INFO nova.compute.manager [None req-bf0e6d5b-1995-423b-a55e-3577dcf44bd6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Unrescuing
Oct 26 03:26:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bf0e6d5b-1995-423b-a55e-3577dcf44bd6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:26:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bf0e6d5b-1995-423b-a55e-3577dcf44bd6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquired lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:26:59 user nova-compute[74630]: DEBUG nova.network.neutron [None req-bf0e6d5b-1995-423b-a55e-3577dcf44bd6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:26:59 user nova-compute[74630]: DEBUG nova.compute.manager [req-b6cec61b-a7ec-47b9-8ca7-6f67456d3736 req-721652c9-a4ec-4339-ad6a-8994d92e8097 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-unplugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:26:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b6cec61b-a7ec-47b9-8ca7-6f67456d3736 req-721652c9-a4ec-4339-ad6a-8994d92e8097 service nova] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:26:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b6cec61b-a7ec-47b9-8ca7-6f67456d3736 req-721652c9-a4ec-4339-ad6a-8994d92e8097 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:26:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b6cec61b-a7ec-47b9-8ca7-6f67456d3736 req-721652c9-a4ec-4339-ad6a-8994d92e8097 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:26:59 user nova-compute[74630]: DEBUG nova.compute.manager [req-b6cec61b-a7ec-47b9-8ca7-6f67456d3736 req-721652c9-a4ec-4339-ad6a-8994d92e8097 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] No waiting events found dispatching network-vif-unplugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:26:59 user nova-compute[74630]: WARNING nova.compute.manager [req-b6cec61b-a7ec-47b9-8ca7-6f67456d3736 req-721652c9-a4ec-4339-ad6a-8994d92e8097 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received unexpected event network-vif-unplugged-13707b78-ccef-402c-9d27-d6897b1eacf3 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:26:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:26:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:00 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Instance destroyed successfully.
Oct 26 03:27:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-bf0e6d5b-1995-423b-a55e-3577dcf44bd6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Updating instance_info_cache with network_info: [{"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:27:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bf0e6d5b-1995-423b-a55e-3577dcf44bd6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Releasing lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:27:00 user nova-compute[74630]: DEBUG nova.objects.instance [None req-bf0e6d5b-1995-423b-a55e-3577dcf44bd6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'flavor' on Instance uuid 40316e54-eee2-4072-b436-4c5bb31724a9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:27:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-0749f0c4-8653-4416-8dea-65f87f67ceb7 req-4b3061d4-4eb0-4442-899b-be1afa92ddc3 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received event network-vif-unplugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:27:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0749f0c4-8653-4416-8dea-65f87f67ceb7 req-4b3061d4-4eb0-4442-899b-be1afa92ddc3 service nova] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0749f0c4-8653-4416-8dea-65f87f67ceb7 req-4b3061d4-4eb0-4442-899b-be1afa92ddc3 service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0749f0c4-8653-4416-8dea-65f87f67ceb7 req-4b3061d4-4eb0-4442-899b-be1afa92ddc3 service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-0749f0c4-8653-4416-8dea-65f87f67ceb7 req-4b3061d4-4eb0-4442-899b-be1afa92ddc3 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] No waiting events found dispatching network-vif-unplugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:27:00 user nova-compute[74630]: WARNING nova.compute.manager [req-0749f0c4-8653-4416-8dea-65f87f67ceb7 req-4b3061d4-4eb0-4442-899b-be1afa92ddc3 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received unexpected event network-vif-unplugged-09559581-1c5c-4bee-90ea-fb70ae613d86 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:27:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-3ebe6931-64b5-4899-b8b7-0453110b3961 req-dc48f2f5-c632-4513-a7ad-efd443645f77 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3ebe6931-64b5-4899-b8b7-0453110b3961 req-dc48f2f5-c632-4513-a7ad-efd443645f77 service nova] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3ebe6931-64b5-4899-b8b7-0453110b3961 req-dc48f2f5-c632-4513-a7ad-efd443645f77 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3ebe6931-64b5-4899-b8b7-0453110b3961 req-dc48f2f5-c632-4513-a7ad-efd443645f77 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-3ebe6931-64b5-4899-b8b7-0453110b3961 req-dc48f2f5-c632-4513-a7ad-efd443645f77 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] No waiting events found dispatching network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:27:01 user nova-compute[74630]: WARNING nova.compute.manager [req-3ebe6931-64b5-4899-b8b7-0453110b3961 req-dc48f2f5-c632-4513-a7ad-efd443645f77 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received unexpected event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:27:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-3ebe6931-64b5-4899-b8b7-0453110b3961 req-dc48f2f5-c632-4513-a7ad-efd443645f77 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3ebe6931-64b5-4899-b8b7-0453110b3961 req-dc48f2f5-c632-4513-a7ad-efd443645f77 service nova] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3ebe6931-64b5-4899-b8b7-0453110b3961 req-dc48f2f5-c632-4513-a7ad-efd443645f77 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3ebe6931-64b5-4899-b8b7-0453110b3961 req-dc48f2f5-c632-4513-a7ad-efd443645f77 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-3ebe6931-64b5-4899-b8b7-0453110b3961 req-dc48f2f5-c632-4513-a7ad-efd443645f77 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] No waiting events found dispatching network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:27:01 user nova-compute[74630]: WARNING nova.compute.manager [req-3ebe6931-64b5-4899-b8b7-0453110b3961 req-dc48f2f5-c632-4513-a7ad-efd443645f77 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received unexpected event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:27:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:02 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Instance destroyed successfully.
Oct 26 03:27:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-d3c8124b-3de6-4fb0-bd8f-29b13e74f756 req-0b25c0bc-ebdc-4221-9db2-508c2547bc97 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:27:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d3c8124b-3de6-4fb0-bd8f-29b13e74f756 req-0b25c0bc-ebdc-4221-9db2-508c2547bc97 service nova] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d3c8124b-3de6-4fb0-bd8f-29b13e74f756 req-0b25c0bc-ebdc-4221-9db2-508c2547bc97 service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d3c8124b-3de6-4fb0-bd8f-29b13e74f756 req-0b25c0bc-ebdc-4221-9db2-508c2547bc97 service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-d3c8124b-3de6-4fb0-bd8f-29b13e74f756 req-0b25c0bc-ebdc-4221-9db2-508c2547bc97 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] No waiting events found dispatching network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:27:02 user nova-compute[74630]: WARNING nova.compute.manager [req-d3c8124b-3de6-4fb0-bd8f-29b13e74f756 req-0b25c0bc-ebdc-4221-9db2-508c2547bc97 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received unexpected event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:27:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-a298884e-60fe-4218-beab-364d936f0c1f req-59572e1d-16c2-421e-832a-5e36884c5a93 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:27:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a298884e-60fe-4218-beab-364d936f0c1f req-59572e1d-16c2-421e-832a-5e36884c5a93 service nova] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a298884e-60fe-4218-beab-364d936f0c1f req-59572e1d-16c2-421e-832a-5e36884c5a93 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a298884e-60fe-4218-beab-364d936f0c1f req-59572e1d-16c2-421e-832a-5e36884c5a93 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-a298884e-60fe-4218-beab-364d936f0c1f req-59572e1d-16c2-421e-832a-5e36884c5a93 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] No waiting events found dispatching network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:27:03 user nova-compute[74630]: WARNING nova.compute.manager [req-a298884e-60fe-4218-beab-364d936f0c1f req-59572e1d-16c2-421e-832a-5e36884c5a93 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received unexpected event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:27:04 user nova-compute[74630]: DEBUG nova.compute.manager [None req-8797294c-fc62-4a5c-8b1c-a7555c39231f tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:27:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-8996e240-341c-4330-bcfd-22a5afab8cf1 req-dba1b2cb-ec94-4f00-bac4-c2f0be19d223 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:27:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8996e240-341c-4330-bcfd-22a5afab8cf1 req-dba1b2cb-ec94-4f00-bac4-c2f0be19d223 service nova] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8996e240-341c-4330-bcfd-22a5afab8cf1 req-dba1b2cb-ec94-4f00-bac4-c2f0be19d223 service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8996e240-341c-4330-bcfd-22a5afab8cf1 req-dba1b2cb-ec94-4f00-bac4-c2f0be19d223 service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-8996e240-341c-4330-bcfd-22a5afab8cf1 req-dba1b2cb-ec94-4f00-bac4-c2f0be19d223 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] No waiting events found dispatching network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:27:05 user nova-compute[74630]: WARNING nova.compute.manager [req-8996e240-341c-4330-bcfd-22a5afab8cf1 req-dba1b2cb-ec94-4f00-bac4-c2f0be19d223 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received unexpected event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:27:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-8996e240-341c-4330-bcfd-22a5afab8cf1 req-dba1b2cb-ec94-4f00-bac4-c2f0be19d223 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:27:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8996e240-341c-4330-bcfd-22a5afab8cf1 req-dba1b2cb-ec94-4f00-bac4-c2f0be19d223 service nova] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8996e240-341c-4330-bcfd-22a5afab8cf1 req-dba1b2cb-ec94-4f00-bac4-c2f0be19d223 service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8996e240-341c-4330-bcfd-22a5afab8cf1 req-dba1b2cb-ec94-4f00-bac4-c2f0be19d223 service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-8996e240-341c-4330-bcfd-22a5afab8cf1 req-dba1b2cb-ec94-4f00-bac4-c2f0be19d223 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] No waiting events found dispatching network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:27:05 user nova-compute[74630]: WARNING nova.compute.manager [req-8996e240-341c-4330-bcfd-22a5afab8cf1 req-dba1b2cb-ec94-4f00-bac4-c2f0be19d223 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received unexpected event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:27:05 user nova-compute[74630]: DEBUG nova.compute.manager [None req-bf0e6d5b-1995-423b-a55e-3577dcf44bd6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:27:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:15 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:27:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:27:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:27:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:27:15 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:27:15 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Updating instance_info_cache with network_info: [{"id": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "address": "fa:16:3e:1c:d5:8f", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f91f921-53", "ovs_interfaceid": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:27:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:27:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:27:15 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:27:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:16 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:27:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:27:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:27:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:27:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:27:18 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:27:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:18 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:27:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:22 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:27:22 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=7683MB free_disk=25.230560302734375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 747e596d-d9b3-4af2-be42-0fd494b6ef9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d1591088-0892-4aa5-b7ea-3addb083bc69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f5441872-864e-44d9-8632-e05c5d71bd90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 65ff804f-8b98-406d-8c5c-3d73bb52ff18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 980e7a2f-b94d-4544-9e50-03f96fd376fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7576bf64-216a-4d1a-88a2-b90468e61515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance ab04a3a9-4a73-49d1-898a-547cb961e43f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.534s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:24 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:27:24 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:27:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-8cc00633-982d-4147-b065-e16b14574cec req-4250ee7f-5ee7-4b58-8a3d-31d0c9445622 service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Received event network-changed-181a6913-fd44-44b4-955e-657f1cc64313 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:27:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-8cc00633-982d-4147-b065-e16b14574cec req-4250ee7f-5ee7-4b58-8a3d-31d0c9445622 service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Refreshing instance network info cache due to event network-changed-181a6913-fd44-44b4-955e-657f1cc64313. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:27:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8cc00633-982d-4147-b065-e16b14574cec req-4250ee7f-5ee7-4b58-8a3d-31d0c9445622 service nova] Acquiring lock "refresh_cache-980e7a2f-b94d-4544-9e50-03f96fd376fe" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:27:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8cc00633-982d-4147-b065-e16b14574cec req-4250ee7f-5ee7-4b58-8a3d-31d0c9445622 service nova] Acquired lock "refresh_cache-980e7a2f-b94d-4544-9e50-03f96fd376fe" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:27:34 user nova-compute[74630]: DEBUG nova.network.neutron [req-8cc00633-982d-4147-b065-e16b14574cec req-4250ee7f-5ee7-4b58-8a3d-31d0c9445622 service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Refreshing network info cache for port 181a6913-fd44-44b4-955e-657f1cc64313 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:27:35 user nova-compute[74630]: DEBUG nova.network.neutron [req-8cc00633-982d-4147-b065-e16b14574cec req-4250ee7f-5ee7-4b58-8a3d-31d0c9445622 service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Updated VIF entry in instance network info cache for port 181a6913-fd44-44b4-955e-657f1cc64313. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:27:35 user nova-compute[74630]: DEBUG nova.network.neutron [req-8cc00633-982d-4147-b065-e16b14574cec req-4250ee7f-5ee7-4b58-8a3d-31d0c9445622 service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Updating instance_info_cache with network_info: [{"id": "181a6913-fd44-44b4-955e-657f1cc64313", "address": "fa:16:3e:8d:c7:e0", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6913-fd", "ovs_interfaceid": "181a6913-fd44-44b4-955e-657f1cc64313", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:27:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8cc00633-982d-4147-b065-e16b14574cec req-4250ee7f-5ee7-4b58-8a3d-31d0c9445622 service nova] Releasing lock "refresh_cache-980e7a2f-b94d-4544-9e50-03f96fd376fe" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:27:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.objects.instance [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lazy-loading 'flavor' on Instance uuid 980e7a2f-b94d-4544-9e50-03f96fd376fe {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:27:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Ignoring supplied device name: /dev/vdb
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:42 user nova-compute[74630]: INFO nova.virt.block_device [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Booting with volume 6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 at /dev/vdc
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Starting finish_revert_migration {{(pid=74630) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:27:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Creating image(s)
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Ensure instance console log exists: /opt/stack/data/nova/instances/90dc2dc2-0ea2-4a8c-b4c9-794523df32f0/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Start _get_guest_xml network_info=[{"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxqRWiIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '90dc2dc2-0ea2-4a8c-b4c9-794523df32f0', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba36f137-d667-483f-9b08-7b0193c3f550', 'serial': 'ba36f137-d667-483f-9b08-7b0193c3f550'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '0b7055d1-76ef-4136-8ac2-f0380a3ec2d7', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.utils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Start _get_guest_xml network_info=[{"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxkXluOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '65ff804f-8b98-406d-8c5c-3d73bb52ff18', 'attached_at': '2023-10-26T03:27:42.000000', 'detached_at': '', 'volume_id': '173e4b04-308c-4ada-b18c-8539105cb677', 'serial': '173e4b04-308c-4ada-b18c-8539105cb677'}, 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '2893b145-73e5-4e6e-aa1e-ce9ecb95a1a8', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ec0032-21ca-4b3e-a173-ee7cc21c3e01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8050f862-abaa-436d-bf84-82cebf969a3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:42 user nova-compute[74630]: INFO nova.compute.manager [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Attaching volume f24e78ee-fa99-4bfe-8a91-cbdf1f484719 to /dev/vdb
Oct 26 03:27:42 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:27:42 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a28273-1da3-4b29-83aa-7914a6a9eb91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:27:42 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda20e49-bc94-475d-b7ea-0828ba54fede]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.utils [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:27:42 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9848770-f590-4836-b1a0-cf7b4bdc17b1]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.utils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updating existing volume attachment record: 2ed28a96-fce5-45de-a2cb-972252f12bb6 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxqRWiIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:27:42 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:27:42 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:27:42 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a787c5c-cddb-4de2-b451-5e97f0c546a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.objects.instance [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lazy-loading 'vcpu_model' on Instance uuid 65ff804f-8b98-406d-8c5c-3d73bb52ff18 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53fa3c1-8107-405e-8a27-8440830b3f09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a885d814-f17f-423a-80f2-bb70795e8060]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:27:42 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxkXluOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:27:42 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa08d5fc-fa75-4f77-be3c-c12a19b7c024]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a06043-afb2-4286-9835-629ce4dd27f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550] added
Oct 26 03:27:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f692df-d484-4b28-9640-9226cede4e1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec1ba2b-dae1-4cab-bf8a-4cb607a42bd7]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:27:42 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a716921-cd98-49fd-91ab-2d985fe0e48a]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.utils [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] <== get_connector_properties: return (240ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Updating existing volume attachment record: 72e80e5d-7f3e-46be-90a7-d0616071568c {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbae202-450f-47df-93e0-04d159964f2a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NxqRWiIC {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NxqRWiIC" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bb67ef-f1f5-46b0-87df-da388ac86a17]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NxqRWiIC'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd97e47-4f60-495a-8999-2d02410126be]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc75cbcc-efdb-4d22-be28-386340d6ce64]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:27:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:27:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[283f418c-b28e-4ee8-8915-e1f5d53c3088]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260]
Oct 26 03:27:42 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260] successful.
Oct 26 03:27:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edb8eec-2e41-4019-a081-049f41ef3df3]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3a6e0f-4d6c-450b-9b1a-d83b68311d1f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:27:42 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:27:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:27:42 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:27:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:27:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b81f89-ee21-44c2-8f79-777f95d9b333]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:27:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxqRWiIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:27:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Acquiring lock "a7484e47-3d75-4913-970b-41f8ff66eb93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "a7484e47-3d75-4913-970b-41f8ff66eb93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:43 user nova-compute[74630]: DEBUG nova.compute.manager [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:27:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:43 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:27:43 user nova-compute[74630]: INFO nova.compute.claims [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Claim successful on node user
Oct 26 03:27:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23165333036653935', 'path': '/dev/sdc'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165333036653935', 'path': '/dev/sdc'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.332s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:27:44 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:27:44 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1756e3-3486-4a97-9cd5-cf1246932773]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:27:44 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:26:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-415578365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-415578365',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJud6mpHVea5l3TmFMj7TUo36YSkBpoQyMbTjtpYD/dGU90azzgcRr8MHCroAaS2zs20gbK6yileVVDApGs2uHRxNL2W5M/4qgb3zIJ0sK0u5dluv9CMLCmmumrj5e/PUA==',key_name='tempest-keypair-1033500048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9079bef72e74a65956113a03d158599',ramdisk_id='',reservation_id='r-ye3e7o2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-310127885',owner_user_name='tempest-ServerActionsV293TestJSON-310127885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61f0a167683a42fcacac8fd8532812ba',uuid=90dc2dc2-0ea2-4a8c-b4c9-794523df32f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Converting VIF {"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:dc:ae,bridge_name='br-int',has_traffic_filtering=True,id=3918526e-3b7f-40b0-a4fa-e3960470392b,network=Network(9282a8c0-6bcd-433f-a357-1c399e425972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3918526e-3b') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.objects.instance [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lazy-loading 'pci_devices' on Instance uuid 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d07c5e7-1abc-43dc-b6e7-0a47468345f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677] added
Oct 26 03:27:44 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:27:44 user nova-compute[74630]:   <uuid>90dc2dc2-0ea2-4a8c-b4c9-794523df32f0</uuid>
Oct 26 03:27:44 user nova-compute[74630]:   <name>instance-00000014</name>
Oct 26 03:27:44 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:27:44 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:27:44 user nova-compute[74630]:   <metadata>
Oct 26 03:27:44 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:27:44 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:27:44 user nova-compute[74630]:       <nova:name>tempest-ServerActionsV293TestJSON-server-415578365</nova:name>
Oct 26 03:27:44 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:27:42</nova:creationTime>
Oct 26 03:27:44 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:27:44 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:27:44 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:27:44 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:27:44 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:27:44 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:27:44 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:27:44 user nova-compute[74630]:       <nova:owner>
Oct 26 03:27:44 user nova-compute[74630]:         <nova:user uuid="61f0a167683a42fcacac8fd8532812ba">tempest-ServerActionsV293TestJSON-310127885-project-member</nova:user>
Oct 26 03:27:44 user nova-compute[74630]:         <nova:project uuid="a9079bef72e74a65956113a03d158599">tempest-ServerActionsV293TestJSON-310127885</nova:project>
Oct 26 03:27:44 user nova-compute[74630]:       </nova:owner>
Oct 26 03:27:44 user nova-compute[74630]:       <nova:ports>
Oct 26 03:27:44 user nova-compute[74630]:         <nova:port uuid="3918526e-3b7f-40b0-a4fa-e3960470392b">
Oct 26 03:27:44 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 03:27:44 user nova-compute[74630]:         </nova:port>
Oct 26 03:27:44 user nova-compute[74630]:       </nova:ports>
Oct 26 03:27:44 user nova-compute[74630]:     </nova:instance>
Oct 26 03:27:44 user nova-compute[74630]:   </metadata>
Oct 26 03:27:44 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:27:44 user nova-compute[74630]:     <system>
Oct 26 03:27:44 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:27:44 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:27:44 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:27:44 user nova-compute[74630]:       <entry name="serial">90dc2dc2-0ea2-4a8c-b4c9-794523df32f0</entry>
Oct 26 03:27:44 user nova-compute[74630]:       <entry name="uuid">90dc2dc2-0ea2-4a8c-b4c9-794523df32f0</entry>
Oct 26 03:27:44 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:27:44 user nova-compute[74630]:     </system>
Oct 26 03:27:44 user nova-compute[74630]:   </sysinfo>
Oct 26 03:27:44 user nova-compute[74630]:   <os>
Oct 26 03:27:44 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:27:44 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:27:44 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:27:44 user nova-compute[74630]:   </os>
Oct 26 03:27:44 user nova-compute[74630]:   <features>
Oct 26 03:27:44 user nova-compute[74630]:     <acpi/>
Oct 26 03:27:44 user nova-compute[74630]:     <apic/>
Oct 26 03:27:44 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:27:44 user nova-compute[74630]:   </features>
Oct 26 03:27:44 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:27:44 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:27:44 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:27:44 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:27:44 user nova-compute[74630]:   </clock>
Oct 26 03:27:44 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:27:44 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:27:44 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:27:44 user nova-compute[74630]:   </cpu>
Oct 26 03:27:44 user nova-compute[74630]:   <devices>
Oct 26 03:27:44 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:27:44 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:27:44 user nova-compute[74630]:       <source dev="/dev/sdc"/>
Oct 26 03:27:44 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:27:44 user nova-compute[74630]:       <serial>ba36f137-d667-483f-9b08-7b0193c3f550</serial>
Oct 26 03:27:44 user nova-compute[74630]:     </disk>
Oct 26 03:27:44 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:27:44 user nova-compute[74630]:       <mac address="fa:16:3e:26:dc:ae"/>
Oct 26 03:27:44 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:27:44 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:27:44 user nova-compute[74630]:       <target dev="tap3918526e-3b"/>
Oct 26 03:27:44 user nova-compute[74630]:     </interface>
Oct 26 03:27:44 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:27:44 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/90dc2dc2-0ea2-4a8c-b4c9-794523df32f0/console.log" append="off"/>
Oct 26 03:27:44 user nova-compute[74630]:     </serial>
Oct 26 03:27:44 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:27:44 user nova-compute[74630]:     <video>
Oct 26 03:27:44 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:27:44 user nova-compute[74630]:     </video>
Oct 26 03:27:44 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:27:44 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:27:44 user nova-compute[74630]:     </rng>
Oct 26 03:27:44 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:27:44 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:27:44 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:27:44 user nova-compute[74630]:     </memballoon>
Oct 26 03:27:44 user nova-compute[74630]:   </devices>
Oct 26 03:27:44 user nova-compute[74630]: </domain>
Oct 26 03:27:44 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:26:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-415578365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-415578365',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJud6mpHVea5l3TmFMj7TUo36YSkBpoQyMbTjtpYD/dGU90azzgcRr8MHCroAaS2zs20gbK6yileVVDApGs2uHRxNL2W5M/4qgb3zIJ0sK0u5dluv9CMLCmmumrj5e/PUA==',key_name='tempest-keypair-1033500048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9079bef72e74a65956113a03d158599',ramdisk_id='',reservation_id='r-ye3e7o2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-310127885',owner_user_name='tempest-ServerActionsV293TestJSON-310127885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61f0a167683a42fcacac8fd8532812ba',uuid=90dc2dc2-0ea2-4a8c-b4c9-794523df32f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Converting VIF {"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:dc:ae,bridge_name='br-int',has_traffic_filtering=True,id=3918526e-3b7f-40b0-a4fa-e3960470392b,network=Network(9282a8c0-6bcd-433f-a357-1c399e425972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3918526e-3b') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_vif [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:dc:ae,bridge_name='br-int',has_traffic_filtering=True,id=3918526e-3b7f-40b0-a4fa-e3960470392b,network=Network(9282a8c0-6bcd-433f-a357-1c399e425972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3918526e-3b') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64c2a095-9f75-5be0-97d1-47781e1fe7a2', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2eff04-e833-4886-ad0b-6fc638a1230d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3918526e-3b, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3918526e-3b, col_values=(('qos', UUID('d8b9b205-bd90-42b7-b571-83e229df84c9')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3918526e-3b, col_values=(('external_ids', {'iface-id': '3918526e-3b7f-40b0-a4fa-e3960470392b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:dc:ae', 'vm-uuid': '90dc2dc2-0ea2-4a8c-b4c9-794523df32f0'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:44 user nova-compute[74630]: INFO os_vif [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:dc:ae,bridge_name='br-int',has_traffic_filtering=True,id=3918526e-3b7f-40b0-a4fa-e3960470392b,network=Network(9282a8c0-6bcd-433f-a357-1c399e425972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3918526e-3b')
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9533dd-f493-42ef-aa69-ab4b185210da]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.compute.manager [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxkXluOe {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxkXluOe" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8ecb49-f307-43dd-be77-c7acc99075c8]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wxkXluOe'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cbc4d6-9c3d-4b48-a735-e5a23698db9f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e8eca-8495-473e-812b-5c678acadeb7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:27:44 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:27:44 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:27:44 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:27:44 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] No VIF found with MAC fa:16:3e:26:dc:ae, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.compute.manager [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.network.neutron [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c043992-c742-4d68-b915-063942a8f00a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260]
Oct 26 03:27:44 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260] successful.
Oct 26 03:27:44 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:44 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[899525e0-a6a4-420f-abba-4b11657245fe]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.compute.manager [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0a65a5-f312-4e2b-897e-1c6f16f2cc29]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:27:44 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:27:44 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:27:44 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:27:44 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:27:44 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:27:44 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[071e4579-d126-4d27-acb1-93b87a5fa007]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.policy [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7616d76f2daa4aa8ab85e663b5a01e3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6da1ec8d94f24b5a9e07f8836f228a83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.compute.manager [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:27:44 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Creating image(s)
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "/opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "/opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.195s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk 1073741824" returned: 0 in 0.061s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.235s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG nova.network.neutron [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Successfully created port: d0ee15a8-0622-4c30-99fc-d18cc5d192cc {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxkXluOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] <== connect_volume: return (2730ms) {'type': 'block', 'scsi_wwn': '23438363938663231', 'path': '/dev/sdd'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438363938663231', 'path': '/dev/sdd'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Cannot resize image /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Ensure instance console log exists: /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1501494997',display_name='tempest-ServerActionsTestOtherB-server-1501494997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1501494997',id=5,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFIeBoj6ZVV6vjKZ5C8Qtaf45gZ5VQLu8uYxcKaMISZ7A/ITCT4P2Cxj8DgdsT8tNJFXq2qSIv9+4+e1q0xZrix9FhWGUlPhtxOjh9fvNN5qcQ+ZdFKB+/mBI3I8ldOaQ==',key_name='tempest-keypair-565299267',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='03fc5bdbf0b947b49f6a6c8d44630ed5',ramdisk_id='',reservation_id='r-4c005us9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-638189769',owner_user_name='tempest-ServerActionsTestOtherB-638189769-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:26:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e27a2c56890d4be0a3fb46bd748fa7cf',uuid=65ff804f-8b98-406d-8c5c-3d73bb52ff18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converting VIF {"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:27:45 user nova-compute[74630]:   <uuid>65ff804f-8b98-406d-8c5c-3d73bb52ff18</uuid>
Oct 26 03:27:45 user nova-compute[74630]:   <name>instance-00000005</name>
Oct 26 03:27:45 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:27:45 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:27:45 user nova-compute[74630]:   <metadata>
Oct 26 03:27:45 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:27:45 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:27:45 user nova-compute[74630]:       <nova:name>tempest-ServerActionsTestOtherB-server-1501494997</nova:name>
Oct 26 03:27:45 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:27:42</nova:creationTime>
Oct 26 03:27:45 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:27:45 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:27:45 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:27:45 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:27:45 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:27:45 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:27:45 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:27:45 user nova-compute[74630]:       <nova:owner>
Oct 26 03:27:45 user nova-compute[74630]:         <nova:user uuid="e27a2c56890d4be0a3fb46bd748fa7cf">tempest-ServerActionsTestOtherB-638189769-project-member</nova:user>
Oct 26 03:27:45 user nova-compute[74630]:         <nova:project uuid="03fc5bdbf0b947b49f6a6c8d44630ed5">tempest-ServerActionsTestOtherB-638189769</nova:project>
Oct 26 03:27:45 user nova-compute[74630]:       </nova:owner>
Oct 26 03:27:45 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:27:45 user nova-compute[74630]:       <nova:ports>
Oct 26 03:27:45 user nova-compute[74630]:         <nova:port uuid="b965ee06-ed93-40fc-9732-974c808f5c36">
Oct 26 03:27:45 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 03:27:45 user nova-compute[74630]:         </nova:port>
Oct 26 03:27:45 user nova-compute[74630]:       </nova:ports>
Oct 26 03:27:45 user nova-compute[74630]:     </nova:instance>
Oct 26 03:27:45 user nova-compute[74630]:   </metadata>
Oct 26 03:27:45 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:27:45 user nova-compute[74630]:     <system>
Oct 26 03:27:45 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:27:45 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:27:45 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:27:45 user nova-compute[74630]:       <entry name="serial">65ff804f-8b98-406d-8c5c-3d73bb52ff18</entry>
Oct 26 03:27:45 user nova-compute[74630]:       <entry name="uuid">65ff804f-8b98-406d-8c5c-3d73bb52ff18</entry>
Oct 26 03:27:45 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:27:45 user nova-compute[74630]:     </system>
Oct 26 03:27:45 user nova-compute[74630]:   </sysinfo>
Oct 26 03:27:45 user nova-compute[74630]:   <os>
Oct 26 03:27:45 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:27:45 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:27:45 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:27:45 user nova-compute[74630]:   </os>
Oct 26 03:27:45 user nova-compute[74630]:   <features>
Oct 26 03:27:45 user nova-compute[74630]:     <acpi/>
Oct 26 03:27:45 user nova-compute[74630]:     <apic/>
Oct 26 03:27:45 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:27:45 user nova-compute[74630]:   </features>
Oct 26 03:27:45 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:27:45 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:27:45 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:27:45 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:27:45 user nova-compute[74630]:   </clock>
Oct 26 03:27:45 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:27:45 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:27:45 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:27:45 user nova-compute[74630]:   </cpu>
Oct 26 03:27:45 user nova-compute[74630]:   <devices>
Oct 26 03:27:45 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:27:45 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:27:45 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk"/>
Oct 26 03:27:45 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:27:45 user nova-compute[74630]:     </disk>
Oct 26 03:27:45 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:27:45 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:27:45 user nova-compute[74630]:       <source dev="/dev/sdd"/>
Oct 26 03:27:45 user nova-compute[74630]:       <target dev="vdb" bus="virtio"/>
Oct 26 03:27:45 user nova-compute[74630]:       <serial>173e4b04-308c-4ada-b18c-8539105cb677</serial>
Oct 26 03:27:45 user nova-compute[74630]:     </disk>
Oct 26 03:27:45 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:27:45 user nova-compute[74630]:       <mac address="fa:16:3e:51:30:8c"/>
Oct 26 03:27:45 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:27:45 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:27:45 user nova-compute[74630]:       <target dev="tapb965ee06-ed"/>
Oct 26 03:27:45 user nova-compute[74630]:     </interface>
Oct 26 03:27:45 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:27:45 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/console.log" append="off"/>
Oct 26 03:27:45 user nova-compute[74630]:     </serial>
Oct 26 03:27:45 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:27:45 user nova-compute[74630]:     <video>
Oct 26 03:27:45 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:27:45 user nova-compute[74630]:     </video>
Oct 26 03:27:45 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:27:45 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:27:45 user nova-compute[74630]:     </rng>
Oct 26 03:27:45 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:27:45 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:27:45 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:27:45 user nova-compute[74630]:     </memballoon>
Oct 26 03:27:45 user nova-compute[74630]:   </devices>
Oct 26 03:27:45 user nova-compute[74630]: </domain>
Oct 26 03:27:45 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1501494997',display_name='tempest-ServerActionsTestOtherB-server-1501494997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1501494997',id=5,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFIeBoj6ZVV6vjKZ5C8Qtaf45gZ5VQLu8uYxcKaMISZ7A/ITCT4P2Cxj8DgdsT8tNJFXq2qSIv9+4+e1q0xZrix9FhWGUlPhtxOjh9fvNN5qcQ+ZdFKB+/mBI3I8ldOaQ==',key_name='tempest-keypair-565299267',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='03fc5bdbf0b947b49f6a6c8d44630ed5',ramdisk_id='',reservation_id='r-4c005us9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-638189769',owner_user_name='tempest-ServerActionsTestOtherB-638189769-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:26:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e27a2c56890d4be0a3fb46bd748fa7cf',uuid=65ff804f-8b98-406d-8c5c-3d73bb52ff18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converting VIF {"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG os_vif [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c29834d-7144-5988-a814-80e3ec70f777', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb965ee06-ed, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb965ee06-ed, col_values=(('qos', UUID('d6f87aa0-191a-4fb7-91f8-0c9feac1b5b1')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb965ee06-ed, col_values=(('external_ids', {'iface-id': 'b965ee06-ed93-40fc-9732-974c808f5c36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:30:8c', 'vm-uuid': '65ff804f-8b98-406d-8c5c-3d73bb52ff18'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:45 user nova-compute[74630]: INFO os_vif [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed')
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-3eb8b39b-845c-4cb3-b962-2ef6cdfc3436 req-a60c92eb-aa9a-4bda-b978-73ec33be2ee4 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received event network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3eb8b39b-845c-4cb3-b962-2ef6cdfc3436 req-a60c92eb-aa9a-4bda-b978-73ec33be2ee4 service nova] Acquiring lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3eb8b39b-845c-4cb3-b962-2ef6cdfc3436 req-a60c92eb-aa9a-4bda-b978-73ec33be2ee4 service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3eb8b39b-845c-4cb3-b962-2ef6cdfc3436 req-a60c92eb-aa9a-4bda-b978-73ec33be2ee4 service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-3eb8b39b-845c-4cb3-b962-2ef6cdfc3436 req-a60c92eb-aa9a-4bda-b978-73ec33be2ee4 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] No waiting events found dispatching network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:27:46 user nova-compute[74630]: WARNING nova.compute.manager [req-3eb8b39b-845c-4cb3-b962-2ef6cdfc3436 req-a60c92eb-aa9a-4bda-b978-73ec33be2ee4 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received unexpected event network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b for instance with vm_state building and task_state spawning.
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.network.neutron [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Successfully updated port: d0ee15a8-0622-4c30-99fc-d18cc5d192cc {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Acquiring lock "refresh_cache-a7484e47-3d75-4913-970b-41f8ff66eb93" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Acquired lock "refresh_cache-a7484e47-3d75-4913-970b-41f8ff66eb93" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.network.neutron [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-b600e9d2-7a86-46b5-8483-e7e46fa28476 req-bfa15656-655c-440e-aa23-932705030ff2 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Received event network-changed-d0ee15a8-0622-4c30-99fc-d18cc5d192cc {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-b600e9d2-7a86-46b5-8483-e7e46fa28476 req-bfa15656-655c-440e-aa23-932705030ff2 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Refreshing instance network info cache due to event network-changed-d0ee15a8-0622-4c30-99fc-d18cc5d192cc. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b600e9d2-7a86-46b5-8483-e7e46fa28476 req-bfa15656-655c-440e-aa23-932705030ff2 service nova] Acquiring lock "refresh_cache-a7484e47-3d75-4913-970b-41f8ff66eb93" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.network.neutron [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.network.neutron [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Updating instance_info_cache with network_info: [{"id": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "address": "fa:16:3e:96:ce:67", "network": {"id": "995297ce-f2c1-4f27-8a1a-1654ed656e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "353df6cf0134444f8bcf2604c1eceaa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ee15a8-06", "ovs_interfaceid": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Releasing lock "refresh_cache-a7484e47-3d75-4913-970b-41f8ff66eb93" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.compute.manager [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Instance network_info: |[{"id": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "address": "fa:16:3e:96:ce:67", "network": {"id": "995297ce-f2c1-4f27-8a1a-1654ed656e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "353df6cf0134444f8bcf2604c1eceaa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ee15a8-06", "ovs_interfaceid": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b600e9d2-7a86-46b5-8483-e7e46fa28476 req-bfa15656-655c-440e-aa23-932705030ff2 service nova] Acquired lock "refresh_cache-a7484e47-3d75-4913-970b-41f8ff66eb93" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.network.neutron [req-b600e9d2-7a86-46b5-8483-e7e46fa28476 req-bfa15656-655c-440e-aa23-932705030ff2 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Refreshing network info cache for port d0ee15a8-0622-4c30-99fc-d18cc5d192cc {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Start _get_guest_xml network_info=[{"id": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "address": "fa:16:3e:96:ce:67", "network": {"id": "995297ce-f2c1-4f27-8a1a-1654ed656e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "353df6cf0134444f8bcf2604c1eceaa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ee15a8-06", "ovs_interfaceid": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:27:46 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:27:46 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:27:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2128438755',display_name='tempest-VolumesNegativeTest-instance-2128438755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2128438755',id=21,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6da1ec8d94f24b5a9e07f8836f228a83',ramdisk_id='',reservation_id='r-2kz96w6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1151908457',owner_user_name='tempest-VolumesNegativeTest-1151908457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:27:44Z,user_data=None,user_id='7616d76f2daa4aa8ab85e663b5a01e3c',uuid=a7484e47-3d75-4913-970b-41f8ff66eb93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "address": "fa:16:3e:96:ce:67", "network": {"id": "995297ce-f2c1-4f27-8a1a-1654ed656e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "353df6cf0134444f8bcf2604c1eceaa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ee15a8-06", "ovs_interfaceid": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Converting VIF {"id": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "address": "fa:16:3e:96:ce:67", "network": {"id": "995297ce-f2c1-4f27-8a1a-1654ed656e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "353df6cf0134444f8bcf2604c1eceaa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ee15a8-06", "ovs_interfaceid": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ce:67,bridge_name='br-int',has_traffic_filtering=True,id=d0ee15a8-0622-4c30-99fc-d18cc5d192cc,network=Network(995297ce-f2c1-4f27-8a1a-1654ed656e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ee15a8-06') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.objects.instance [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lazy-loading 'pci_devices' on Instance uuid a7484e47-3d75-4913-970b-41f8ff66eb93 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:27:46 user nova-compute[74630]:   <uuid>a7484e47-3d75-4913-970b-41f8ff66eb93</uuid>
Oct 26 03:27:46 user nova-compute[74630]:   <name>instance-00000015</name>
Oct 26 03:27:46 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:27:46 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:27:46 user nova-compute[74630]:   <metadata>
Oct 26 03:27:46 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:27:46 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:27:46 user nova-compute[74630]:       <nova:name>tempest-VolumesNegativeTest-instance-2128438755</nova:name>
Oct 26 03:27:46 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:27:46</nova:creationTime>
Oct 26 03:27:46 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:27:46 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:27:46 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:27:46 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:27:46 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:27:46 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:27:46 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:27:46 user nova-compute[74630]:       <nova:owner>
Oct 26 03:27:46 user nova-compute[74630]:         <nova:user uuid="7616d76f2daa4aa8ab85e663b5a01e3c">tempest-VolumesNegativeTest-1151908457-project-member</nova:user>
Oct 26 03:27:46 user nova-compute[74630]:         <nova:project uuid="6da1ec8d94f24b5a9e07f8836f228a83">tempest-VolumesNegativeTest-1151908457</nova:project>
Oct 26 03:27:46 user nova-compute[74630]:       </nova:owner>
Oct 26 03:27:46 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:27:46 user nova-compute[74630]:       <nova:ports>
Oct 26 03:27:46 user nova-compute[74630]:         <nova:port uuid="d0ee15a8-0622-4c30-99fc-d18cc5d192cc">
Oct 26 03:27:46 user nova-compute[74630]:           <nova:ip type="fixed" address="192.168.233.25" ipVersion="4"/>
Oct 26 03:27:46 user nova-compute[74630]:         </nova:port>
Oct 26 03:27:46 user nova-compute[74630]:       </nova:ports>
Oct 26 03:27:46 user nova-compute[74630]:     </nova:instance>
Oct 26 03:27:46 user nova-compute[74630]:   </metadata>
Oct 26 03:27:46 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:27:46 user nova-compute[74630]:     <system>
Oct 26 03:27:46 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:27:46 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:27:46 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:27:46 user nova-compute[74630]:       <entry name="serial">a7484e47-3d75-4913-970b-41f8ff66eb93</entry>
Oct 26 03:27:46 user nova-compute[74630]:       <entry name="uuid">a7484e47-3d75-4913-970b-41f8ff66eb93</entry>
Oct 26 03:27:46 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:27:46 user nova-compute[74630]:     </system>
Oct 26 03:27:46 user nova-compute[74630]:   </sysinfo>
Oct 26 03:27:46 user nova-compute[74630]:   <os>
Oct 26 03:27:46 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:27:46 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:27:46 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:27:46 user nova-compute[74630]:   </os>
Oct 26 03:27:46 user nova-compute[74630]:   <features>
Oct 26 03:27:46 user nova-compute[74630]:     <acpi/>
Oct 26 03:27:46 user nova-compute[74630]:     <apic/>
Oct 26 03:27:46 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:27:46 user nova-compute[74630]:   </features>
Oct 26 03:27:46 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:27:46 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:27:46 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:27:46 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:27:46 user nova-compute[74630]:   </clock>
Oct 26 03:27:46 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:27:46 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:27:46 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:27:46 user nova-compute[74630]:   </cpu>
Oct 26 03:27:46 user nova-compute[74630]:   <devices>
Oct 26 03:27:46 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:27:46 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:27:46 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk"/>
Oct 26 03:27:46 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:27:46 user nova-compute[74630]:     </disk>
Oct 26 03:27:46 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:27:46 user nova-compute[74630]:       <mac address="fa:16:3e:96:ce:67"/>
Oct 26 03:27:46 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:27:46 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:27:46 user nova-compute[74630]:       <target dev="tapd0ee15a8-06"/>
Oct 26 03:27:46 user nova-compute[74630]:     </interface>
Oct 26 03:27:46 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:27:46 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/console.log" append="off"/>
Oct 26 03:27:46 user nova-compute[74630]:     </serial>
Oct 26 03:27:46 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:27:46 user nova-compute[74630]:     <video>
Oct 26 03:27:46 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:27:46 user nova-compute[74630]:     </video>
Oct 26 03:27:46 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:27:46 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:27:46 user nova-compute[74630]:     </rng>
Oct 26 03:27:46 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:27:46 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:27:46 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:27:46 user nova-compute[74630]:     </memballoon>
Oct 26 03:27:46 user nova-compute[74630]:   </devices>
Oct 26 03:27:46 user nova-compute[74630]: </domain>
Oct 26 03:27:46 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:27:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2128438755',display_name='tempest-VolumesNegativeTest-instance-2128438755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2128438755',id=21,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6da1ec8d94f24b5a9e07f8836f228a83',ramdisk_id='',reservation_id='r-2kz96w6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1151908457',owner_user_name='tempest-VolumesNegativeTest-1151908457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:27:44Z,user_data=None,user_id='7616d76f2daa4aa8ab85e663b5a01e3c',uuid=a7484e47-3d75-4913-970b-41f8ff66eb93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "address": "fa:16:3e:96:ce:67", "network": {"id": "995297ce-f2c1-4f27-8a1a-1654ed656e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "353df6cf0134444f8bcf2604c1eceaa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ee15a8-06", "ovs_interfaceid": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Converting VIF {"id": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "address": "fa:16:3e:96:ce:67", "network": {"id": "995297ce-f2c1-4f27-8a1a-1654ed656e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "353df6cf0134444f8bcf2604c1eceaa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ee15a8-06", "ovs_interfaceid": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ce:67,bridge_name='br-int',has_traffic_filtering=True,id=d0ee15a8-0622-4c30-99fc-d18cc5d192cc,network=Network(995297ce-f2c1-4f27-8a1a-1654ed656e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ee15a8-06') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG os_vif [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ce:67,bridge_name='br-int',has_traffic_filtering=True,id=d0ee15a8-0622-4c30-99fc-d18cc5d192cc,network=Network(995297ce-f2c1-4f27-8a1a-1654ed656e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ee15a8-06') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fa2b3d7-d8a6-59af-9ecb-d8f62fb6ef69', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0ee15a8-06, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0ee15a8-06, col_values=(('qos', UUID('4ee72835-9f06-4d30-9179-c2012dd46bf3')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0ee15a8-06, col_values=(('external_ids', {'iface-id': 'd0ee15a8-0622-4c30-99fc-d18cc5d192cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:ce:67', 'vm-uuid': 'a7484e47-3d75-4913-970b-41f8ff66eb93'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:46 user nova-compute[74630]: INFO os_vif [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ce:67,bridge_name='br-int',has_traffic_filtering=True,id=d0ee15a8-0622-4c30-99fc-d18cc5d192cc,network=Network(995297ce-f2c1-4f27-8a1a-1654ed656e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ee15a8-06')
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] No VIF found with MAC fa:16:3e:96:ce:67, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.network.neutron [req-b600e9d2-7a86-46b5-8483-e7e46fa28476 req-bfa15656-655c-440e-aa23-932705030ff2 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Updated VIF entry in instance network info cache for port d0ee15a8-0622-4c30-99fc-d18cc5d192cc. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG nova.network.neutron [req-b600e9d2-7a86-46b5-8483-e7e46fa28476 req-bfa15656-655c-440e-aa23-932705030ff2 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Updating instance_info_cache with network_info: [{"id": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "address": "fa:16:3e:96:ce:67", "network": {"id": "995297ce-f2c1-4f27-8a1a-1654ed656e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "353df6cf0134444f8bcf2604c1eceaa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ee15a8-06", "ovs_interfaceid": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:27:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b600e9d2-7a86-46b5-8483-e7e46fa28476 req-bfa15656-655c-440e-aa23-932705030ff2 service nova] Releasing lock "refresh_cache-a7484e47-3d75-4913-970b-41f8ff66eb93" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:27:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-b8508426-80b2-42b0-8577-d30a3bb51633 req-b627f7c7-0081-4cd1-aaed-d7f9676561ad service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received event network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:27:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8508426-80b2-42b0-8577-d30a3bb51633 req-b627f7c7-0081-4cd1-aaed-d7f9676561ad service nova] Acquiring lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8508426-80b2-42b0-8577-d30a3bb51633 req-b627f7c7-0081-4cd1-aaed-d7f9676561ad service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8508426-80b2-42b0-8577-d30a3bb51633 req-b627f7c7-0081-4cd1-aaed-d7f9676561ad service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-b8508426-80b2-42b0-8577-d30a3bb51633 req-b627f7c7-0081-4cd1-aaed-d7f9676561ad service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] No waiting events found dispatching network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:27:48 user nova-compute[74630]: WARNING nova.compute.manager [req-b8508426-80b2-42b0-8577-d30a3bb51633 req-b627f7c7-0081-4cd1-aaed-d7f9676561ad service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received unexpected event network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b for instance with vm_state building and task_state spawning.
Oct 26 03:27:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-0f7065f8-cd86-48d6-bbf5-466ce97503a7 req-2b170e2a-770f-43b4-8e66-8d8412a7c357 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Received event network-vif-plugged-d0ee15a8-0622-4c30-99fc-d18cc5d192cc {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:27:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0f7065f8-cd86-48d6-bbf5-466ce97503a7 req-2b170e2a-770f-43b4-8e66-8d8412a7c357 service nova] Acquiring lock "a7484e47-3d75-4913-970b-41f8ff66eb93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0f7065f8-cd86-48d6-bbf5-466ce97503a7 req-2b170e2a-770f-43b4-8e66-8d8412a7c357 service nova] Lock "a7484e47-3d75-4913-970b-41f8ff66eb93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0f7065f8-cd86-48d6-bbf5-466ce97503a7 req-2b170e2a-770f-43b4-8e66-8d8412a7c357 service nova] Lock "a7484e47-3d75-4913-970b-41f8ff66eb93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-0f7065f8-cd86-48d6-bbf5-466ce97503a7 req-2b170e2a-770f-43b4-8e66-8d8412a7c357 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] No waiting events found dispatching network-vif-plugged-d0ee15a8-0622-4c30-99fc-d18cc5d192cc {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:27:49 user nova-compute[74630]: WARNING nova.compute.manager [req-0f7065f8-cd86-48d6-bbf5-466ce97503a7 req-2b170e2a-770f-43b4-8e66-8d8412a7c357 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Received unexpected event network-vif-plugged-d0ee15a8-0622-4c30-99fc-d18cc5d192cc for instance with vm_state building and task_state spawning.
Oct 26 03:27:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-ac1375b6-9697-461b-b0da-73e284c3bda5 req-6631ba73-50a3-402c-b220-9659b16a0090 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ac1375b6-9697-461b-b0da-73e284c3bda5 req-6631ba73-50a3-402c-b220-9659b16a0090 service nova] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ac1375b6-9697-461b-b0da-73e284c3bda5 req-6631ba73-50a3-402c-b220-9659b16a0090 service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ac1375b6-9697-461b-b0da-73e284c3bda5 req-6631ba73-50a3-402c-b220-9659b16a0090 service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-ac1375b6-9697-461b-b0da-73e284c3bda5 req-6631ba73-50a3-402c-b220-9659b16a0090 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] No waiting events found dispatching network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:27:50 user nova-compute[74630]: WARNING nova.compute.manager [req-ac1375b6-9697-461b-b0da-73e284c3bda5 req-6631ba73-50a3-402c-b220-9659b16a0090 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received unexpected event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 for instance with vm_state resized and task_state resize_reverting.
Oct 26 03:27:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-ac1375b6-9697-461b-b0da-73e284c3bda5 req-6631ba73-50a3-402c-b220-9659b16a0090 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ac1375b6-9697-461b-b0da-73e284c3bda5 req-6631ba73-50a3-402c-b220-9659b16a0090 service nova] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ac1375b6-9697-461b-b0da-73e284c3bda5 req-6631ba73-50a3-402c-b220-9659b16a0090 service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ac1375b6-9697-461b-b0da-73e284c3bda5 req-6631ba73-50a3-402c-b220-9659b16a0090 service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-ac1375b6-9697-461b-b0da-73e284c3bda5 req-6631ba73-50a3-402c-b220-9659b16a0090 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] No waiting events found dispatching network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:27:50 user nova-compute[74630]: WARNING nova.compute.manager [req-ac1375b6-9697-461b-b0da-73e284c3bda5 req-6631ba73-50a3-402c-b220-9659b16a0090 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received unexpected event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 for instance with vm_state resized and task_state resize_reverting.
Oct 26 03:27:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG nova.compute.manager [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:27:50 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Instance spawned successfully.
Oct 26 03:27:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:27:50 user nova-compute[74630]: INFO nova.compute.manager [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Took 8.31 seconds to spawn the instance on the hypervisor.
Oct 26 03:27:50 user nova-compute[74630]: DEBUG nova.compute.manager [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:27:50 user nova-compute[74630]: INFO nova.compute.manager [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Took 85.50 seconds to build instance.
Oct 26 03:27:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-943dd616-d431-4525-bd17-39fa54e1a642 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 85.666s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 81.537s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:50 user nova-compute[74630]: INFO nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 26 03:27:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-3e2bb98f-ab4d-4828-945b-c86985281eac req-0b47551c-69cb-4f75-aa8a-0a9a79751f49 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Received event network-vif-plugged-d0ee15a8-0622-4c30-99fc-d18cc5d192cc {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:27:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3e2bb98f-ab4d-4828-945b-c86985281eac req-0b47551c-69cb-4f75-aa8a-0a9a79751f49 service nova] Acquiring lock "a7484e47-3d75-4913-970b-41f8ff66eb93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:27:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3e2bb98f-ab4d-4828-945b-c86985281eac req-0b47551c-69cb-4f75-aa8a-0a9a79751f49 service nova] Lock "a7484e47-3d75-4913-970b-41f8ff66eb93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:27:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3e2bb98f-ab4d-4828-945b-c86985281eac req-0b47551c-69cb-4f75-aa8a-0a9a79751f49 service nova] Lock "a7484e47-3d75-4913-970b-41f8ff66eb93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-3e2bb98f-ab4d-4828-945b-c86985281eac req-0b47551c-69cb-4f75-aa8a-0a9a79751f49 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] No waiting events found dispatching network-vif-plugged-d0ee15a8-0622-4c30-99fc-d18cc5d192cc {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:27:51 user nova-compute[74630]: WARNING nova.compute.manager [req-3e2bb98f-ab4d-4828-945b-c86985281eac req-0b47551c-69cb-4f75-aa8a-0a9a79751f49 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Received unexpected event network-vif-plugged-d0ee15a8-0622-4c30-99fc-d18cc5d192cc for instance with vm_state building and task_state spawning.
Oct 26 03:27:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:27:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:27:51 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Instance spawned successfully.
Oct 26 03:27:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:27:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:27:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:27:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:27:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:27:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:27:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:27:51 user nova-compute[74630]: INFO nova.compute.manager [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Took 7.44 seconds to spawn the instance on the hypervisor.
Oct 26 03:27:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:27:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:27:51 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Instance running successfully.
Oct 26 03:27:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] finish_revert_migration finished successfully. {{(pid=74630) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 26 03:27:52 user nova-compute[74630]: INFO nova.compute.manager [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Took 8.51 seconds to build instance.
Oct 26 03:27:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-02616fdd-36f9-4b18-8f33-3b2eb4e518d3 tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "a7484e47-3d75-4913-970b-41f8ff66eb93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.612s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:27:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:27:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cWMvFshi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:28:04 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:28:04 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:28:04 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b417f31b-9df4-4313-8816-54b4a30c3330]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:28:04 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d905863-da5b-450e-a44b-88d5ce7afc97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719] added
Oct 26 03:28:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[88113ae6-0118-4431-8511-830743837c9b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd92096-f28e-4d66-a829-9fd43e5ed796]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cWMvFshi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cWMvFshi" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dc79ba-c56b-4db8-aec7-4ebf45b00268]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cWMvFshi'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8bf0d3-ec30-4041-bc20-fe1da645b7eb]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9972cb-4bba-4917-b50c-e58147479908]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:04 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:04 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:04 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:04 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:04 user nova-compute[74630]: INFO nova.compute.manager [None req-69cb5c41-ec7a-4008-a069-6839524f7bda tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updating instance to original state: 'active'
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --login" returned: 0 in 0.705s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[42190c8b-6a30-49d1-91a5-21ca6d28c628]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719, portal: 172.16.0.220,3260]
Oct 26 03:28:04 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719, portal: 172.16.0.220,3260] successful.
Oct 26 03:28:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[74732e52-ecf3-4faf-8449-0f98bae7293e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd625bff-9a0a-4f5f-9cf1-a4400e6ec239]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:04 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:04 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:04 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:04 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:04 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:04 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.966s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:28:04 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:28:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:05 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa33a4fb-eba2-4345-9bef-e3fb3c163392]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:05 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:28:05 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cWMvFshi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:28:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-206c3cde-d5e5-470e-966f-507d6c8ba1f3 req-8b543c94-57db-4544-8798-b5e85c7da501 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Received event network-changed-422780a3-5bb4-45a5-9253-eaddfaccd00f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-206c3cde-d5e5-470e-966f-507d6c8ba1f3 req-8b543c94-57db-4544-8798-b5e85c7da501 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Refreshing instance network info cache due to event network-changed-422780a3-5bb4-45a5-9253-eaddfaccd00f. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:28:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-206c3cde-d5e5-470e-966f-507d6c8ba1f3 req-8b543c94-57db-4544-8798-b5e85c7da501 service nova] Acquiring lock "refresh_cache-7576bf64-216a-4d1a-88a2-b90468e61515" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:28:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-206c3cde-d5e5-470e-966f-507d6c8ba1f3 req-8b543c94-57db-4544-8798-b5e85c7da501 service nova] Acquired lock "refresh_cache-7576bf64-216a-4d1a-88a2-b90468e61515" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:28:05 user nova-compute[74630]: DEBUG nova.network.neutron [req-206c3cde-d5e5-470e-966f-507d6c8ba1f3 req-8b543c94-57db-4544-8798-b5e85c7da501 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Refreshing network info cache for port 422780a3-5bb4-45a5-9253-eaddfaccd00f {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquiring lock "7576bf64-216a-4d1a-88a2-b90468e61515" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG nova.objects.instance [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lazy-loading 'flavor' on Instance uuid 7576bf64-216a-4d1a-88a2-b90468e61515 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.030s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] <== connect_volume: return (2033ms) {'type': 'block', 'scsi_wwn': '23035306238303536', 'path': '/dev/sde'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035306238303536', 'path': '/dev/sde'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG nova.objects.instance [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lazy-loading 'flavor' on Instance uuid 980e7a2f-b94d-4544-9e50-03f96fd376fe {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:28:06 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:28:06 user nova-compute[74630]:   <source dev="/dev/sde"/>
Oct 26 03:28:06 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:28:06 user nova-compute[74630]:   <serial>f24e78ee-fa99-4bfe-8a91-cbdf1f484719</serial>
Oct 26 03:28:06 user nova-compute[74630]: </disk>
Oct 26 03:28:06 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquiring lock "7576bf64-216a-4d1a-88a2-b90468e61515" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:06 user nova-compute[74630]: INFO nova.compute.manager [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Attaching volume 70059a1a-e77c-467d-885b-6a7378b50c25 to /dev/vdb
Oct 26 03:28:06 user nova-compute[74630]: DEBUG os_brick.utils [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG nova.network.neutron [req-206c3cde-d5e5-470e-966f-507d6c8ba1f3 req-8b543c94-57db-4544-8798-b5e85c7da501 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Updated VIF entry in instance network info cache for port 422780a3-5bb4-45a5-9253-eaddfaccd00f. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG nova.network.neutron [req-206c3cde-d5e5-470e-966f-507d6c8ba1f3 req-8b543c94-57db-4544-8798-b5e85c7da501 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Updating instance_info_cache with network_info: [{"id": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "address": "fa:16:3e:7e:9f:cb", "network": {"id": "6d913fbd-592b-4127-984e-51f91cbc0e13", "bridge": "br-int", "label": "tempest-TestVolumeSwap-750416158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91ca6a73040f4f7ea05ee0328535e97d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422780a3-5b", "ovs_interfaceid": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e08b0c-6c27-481b-ac1c-1c3cec2bf2ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-206c3cde-d5e5-470e-966f-507d6c8ba1f3 req-8b543c94-57db-4544-8798-b5e85c7da501 service nova] Releasing lock "refresh_cache-7576bf64-216a-4d1a-88a2-b90468e61515" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cd7e5b-60cf-4a44-932a-477c5667162a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd27de9c-ce3a-43fe-9e91-4f9f451028bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a517e5-728e-4974-bd77-d71bf392991a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:28:06 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:28:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc90b05-811a-4e3c-989e-a6149191251c]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG os_brick.utils [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Updating existing volume attachment record: c6638cd9-fdfa-4769-99c9-607d61711305 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:28:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] No VIF found with MAC fa:16:3e:8d:c7:e0, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:28:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:16 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:28:16 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:28:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:28:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:28:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-d1591088-0892-4aa5-b7ea-3addb083bc69" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:28:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-d1591088-0892-4aa5-b7ea-3addb083bc69" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:28:17 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:28:17 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Updating instance_info_cache with network_info: [{"id": "eb33c5f5-8500-42cc-997d-94069fc454a6", "address": "fa:16:3e:eb:7c:ee", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33c5f5-85", "ovs_interfaceid": "eb33c5f5-8500-42cc-997d-94069fc454a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:28:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-d1591088-0892-4aa5-b7ea-3addb083bc69" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:28:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:28:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:28:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:28:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:18 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:28:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:18 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:28:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:28:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:28:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:28:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:28:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:23 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:28:23 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=7202MB free_disk=25.226516723632812GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 747e596d-d9b3-4af2-be42-0fd494b6ef9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d1591088-0892-4aa5-b7ea-3addb083bc69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f5441872-864e-44d9-8632-e05c5d71bd90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 65ff804f-8b98-406d-8c5c-3d73bb52ff18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 980e7a2f-b94d-4544-9e50-03f96fd376fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7576bf64-216a-4d1a-88a2-b90468e61515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance ab04a3a9-4a73-49d1-898a-547cb961e43f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance a7484e47-3d75-4913-970b-41f8ff66eb93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:28:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:24 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:28:24 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:28:24 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:28:24 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:28:24 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HokzwZVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:28:26 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:28:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:28:26 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:28:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:28:26 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[907c4970-3b1b-4a57-9c8a-cdfb94b9bba2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:28:26 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e8ae94-1df3-4938-919d-42ddb1910dee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25] added
Oct 26 03:28:26 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-873cf60c-6458-4994-bc19-9bf408b694d6 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.308s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d594fe5-0ea4-4ff9-9086-e6450daf89f1]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f965f32a-c28c-455d-a981-4c7f6995bcdf]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HokzwZVL {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HokzwZVL" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36d26b6-7685-4691-9a60-b9e4aadb87e4]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HokzwZVL'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.066s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec6d3a0-6836-4f42-9db9-30250a8bc23f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[274c4a73-6b04-4299-965c-66528cef5b1e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:27 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:27 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:27 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:27 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:27 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:27 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:27 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:27 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a59813-4d0f-42aa-96b7-f26c25aaf3c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260]
Oct 26 03:28:27 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260] successful.
Oct 26 03:28:27 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "d1591088-0892-4aa5-b7ea-3addb083bc69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "d1591088-0892-4aa5-b7ea-3addb083bc69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:27 user nova-compute[74630]: INFO nova.compute.manager [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Terminating instance
Oct 26 03:28:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13b6ef2-d115-4605-a328-6b535b948b1f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe9fdbd-b25e-4db1-80cd-eb3621e0e1e6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:27 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:27 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:27 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:27 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:27 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:27 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:27 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:27 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:27 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:27 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.545s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8ba969-f0ba-4f80-9b7a-b5b5cca5a2b5]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HokzwZVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-f5883b97-eeb1-4fef-adbe-22a07307ea8d req-7ee7b0e4-0eb8-4905-a6f3-b8b57ad6cb88 service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Received event network-vif-unplugged-eb33c5f5-8500-42cc-997d-94069fc454a6 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f5883b97-eeb1-4fef-adbe-22a07307ea8d req-7ee7b0e4-0eb8-4905-a6f3-b8b57ad6cb88 service nova] Acquiring lock "d1591088-0892-4aa5-b7ea-3addb083bc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f5883b97-eeb1-4fef-adbe-22a07307ea8d req-7ee7b0e4-0eb8-4905-a6f3-b8b57ad6cb88 service nova] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f5883b97-eeb1-4fef-adbe-22a07307ea8d req-7ee7b0e4-0eb8-4905-a6f3-b8b57ad6cb88 service nova] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-f5883b97-eeb1-4fef-adbe-22a07307ea8d req-7ee7b0e4-0eb8-4905-a6f3-b8b57ad6cb88 service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] No waiting events found dispatching network-vif-unplugged-eb33c5f5-8500-42cc-997d-94069fc454a6 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-f5883b97-eeb1-4fef-adbe-22a07307ea8d req-7ee7b0e4-0eb8-4905-a6f3-b8b57ad6cb88 service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Received event network-vif-unplugged-eb33c5f5-8500-42cc-997d-94069fc454a6 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:28:27 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Instance destroyed successfully.
Oct 26 03:28:27 user nova-compute[74630]: DEBUG nova.objects.instance [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lazy-loading 'resources' on Instance uuid d1591088-0892-4aa5-b7ea-3addb083bc69 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-8264532',display_name='tempest-VolumesAdminNegativeTest-server-8264532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-8264532',id=8,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMMrmN6anav/GY0c8u6UNeNMLH6oEhOquvZrRIkRn8UNcNk0VjiPbmXDgYedJL47/S+BCzo5XYBm37hIfQzW4IKhvF7lta8wARD8RV9ERqB1l02lsqF9piw1vzQCWPscw==',key_name='tempest-keypair-643861528',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:20:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eccd4345949848cba29e4c991b6cb3b6',ramdisk_id='',reservation_id='r-tl68zqfz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-741862100',owner_user_name='tempest-VolumesAdminNegativeTest-741862100-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:20:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='accb78f69ef64c9bacb02969887c3aa2',uuid=d1591088-0892-4aa5-b7ea-3addb083bc69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb33c5f5-8500-42cc-997d-94069fc454a6", "address": "fa:16:3e:eb:7c:ee", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33c5f5-85", "ovs_interfaceid": "eb33c5f5-8500-42cc-997d-94069fc454a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Converting VIF {"id": "eb33c5f5-8500-42cc-997d-94069fc454a6", "address": "fa:16:3e:eb:7c:ee", "network": {"id": "2ebb9b88-a9a3-4efd-a6e3-be76353d6be5", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1540222794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eccd4345949848cba29e4c991b6cb3b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb33c5f5-85", "ovs_interfaceid": "eb33c5f5-8500-42cc-997d-94069fc454a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:7c:ee,bridge_name='br-int',has_traffic_filtering=True,id=eb33c5f5-8500-42cc-997d-94069fc454a6,network=Network(2ebb9b88-a9a3-4efd-a6e3-be76353d6be5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb33c5f5-85') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:27 user nova-compute[74630]: DEBUG os_vif [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:7c:ee,bridge_name='br-int',has_traffic_filtering=True,id=eb33c5f5-8500-42cc-997d-94069fc454a6,network=Network(2ebb9b88-a9a3-4efd-a6e3-be76353d6be5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb33c5f5-85') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb33c5f5-85, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0aea5820-abf6-493c-984e-a772898164ee) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:28 user nova-compute[74630]: INFO os_vif [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:7c:ee,bridge_name='br-int',has_traffic_filtering=True,id=eb33c5f5-8500-42cc-997d-94069fc454a6,network=Network(2ebb9b88-a9a3-4efd-a6e3-be76353d6be5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb33c5f5-85')
Oct 26 03:28:28 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Deleting instance files /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69_del
Oct 26 03:28:28 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Deletion of /opt/stack/data/nova/instances/d1591088-0892-4aa5-b7ea-3addb083bc69_del complete
Oct 26 03:28:28 user nova-compute[74630]: INFO nova.compute.manager [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 26 03:28:28 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.596s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] <== connect_volume: return (1599ms) {'type': 'block', 'scsi_wwn': '23565353537386365', 'path': '/dev/sdf'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565353537386365', 'path': '/dev/sdf'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG nova.objects.instance [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lazy-loading 'flavor' on Instance uuid 7576bf64-216a-4d1a-88a2-b90468e61515 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:28:28 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:28:28 user nova-compute[74630]:   <source dev="/dev/sdf"/>
Oct 26 03:28:28 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:28:28 user nova-compute[74630]:   <serial>70059a1a-e77c-467d-885b-6a7378b50c25</serial>
Oct 26 03:28:28 user nova-compute[74630]: </disk>
Oct 26 03:28:28 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] No VIF found with MAC fa:16:3e:7e:9f:cb, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-25bad35c-3531-4bec-9f74-b960092381b2 tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.527s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:28:28 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Took 0.84 seconds to deallocate network for instance.
Oct 26 03:28:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-721297b0-5cc0-486e-81ed-576ce165bdb2 req-9e0095f1-4340-4f6b-9592-a2307e587ba1 service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Received event network-vif-deleted-eb33c5f5-8500-42cc-997d-94069fc454a6 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:28 user nova-compute[74630]: INFO nova.compute.manager [req-721297b0-5cc0-486e-81ed-576ce165bdb2 req-9e0095f1-4340-4f6b-9592-a2307e587ba1 service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Neutron deleted interface eb33c5f5-8500-42cc-997d-94069fc454a6; detaching it from the instance and deleting it from the info cache
Oct 26 03:28:28 user nova-compute[74630]: DEBUG nova.network.neutron [req-721297b0-5cc0-486e-81ed-576ce165bdb2 req-9e0095f1-4340-4f6b-9592-a2307e587ba1 service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:28:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-721297b0-5cc0-486e-81ed-576ce165bdb2 req-9e0095f1-4340-4f6b-9592-a2307e587ba1 service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Detach interface failed, port_id=eb33c5f5-8500-42cc-997d-94069fc454a6, reason: Instance d1591088-0892-4aa5-b7ea-3addb083bc69 could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:29 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Deleted allocations for instance d1591088-0892-4aa5-b7ea-3addb083bc69
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Acquiring lock "7576bf64-216a-4d1a-88a2-b90468e61515" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-faf65348-7ee8-4ad2-ae70-50675b057828 tempest-VolumesAdminNegativeTest-741862100 tempest-VolumesAdminNegativeTest-741862100-project-member] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.422s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG os_brick.utils [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[19260651-929e-41ec-9653-fa22d4678d4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a26f79b-1dc9-4e9c-8493-03423dc97992]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7e53a1-49ca-4a7b-8de2-83af14af66e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ef9aca-4eac-488c-8f33-be34d815e618]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-853768e1-8619-406b-aa4d-deade0c4770a req-09393474-ba93-48f0-9c52-9e6cd84d0aa7 service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Received event network-vif-plugged-eb33c5f5-8500-42cc-997d-94069fc454a6 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-853768e1-8619-406b-aa4d-deade0c4770a req-09393474-ba93-48f0-9c52-9e6cd84d0aa7 service nova] Acquiring lock "d1591088-0892-4aa5-b7ea-3addb083bc69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-853768e1-8619-406b-aa4d-deade0c4770a req-09393474-ba93-48f0-9c52-9e6cd84d0aa7 service nova] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-853768e1-8619-406b-aa4d-deade0c4770a req-09393474-ba93-48f0-9c52-9e6cd84d0aa7 service nova] Lock "d1591088-0892-4aa5-b7ea-3addb083bc69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-853768e1-8619-406b-aa4d-deade0c4770a req-09393474-ba93-48f0-9c52-9e6cd84d0aa7 service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] No waiting events found dispatching network-vif-plugged-eb33c5f5-8500-42cc-997d-94069fc454a6 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:29 user nova-compute[74630]: WARNING nova.compute.manager [req-853768e1-8619-406b-aa4d-deade0c4770a req-09393474-ba93-48f0-9c52-9e6cd84d0aa7 service nova] [instance: d1591088-0892-4aa5-b7ea-3addb083bc69] Received unexpected event network-vif-plugged-eb33c5f5-8500-42cc-997d-94069fc454a6 for instance with vm_state deleted and task_state None.
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:28:29 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:28:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e73bbe-d678-4daf-937b-47c3b8cc22cd]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:28:29 user nova-compute[74630]: DEBUG os_brick.utils [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:28:29 user nova-compute[74630]: INFO nova.compute.manager [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Swapping volume 70059a1a-e77c-467d-885b-6a7378b50c25 for 1dc98834-709f-46e3-8e76-06da464f1086
Oct 26 03:28:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:28:33 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Creating image(s)
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "/opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "/opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.compute.manager [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:28:33 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Creating image(s)
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Ensure instance console log exists: /opt/stack/data/nova/instances/ab04a3a9-4a73-49d1-898a-547cb961e43f/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Start _get_guest_xml network_info=[{"id": "47b60220-f566-48bd-8309-1f01ac44210f", "address": "fa:16:3e:5c:90:01", "network": {"id": "60b1d36a-bbd2-490b-aee0-e81b6501a8e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-631511684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b60220-f5", "ovs_interfaceid": "47b60220-f566-48bd-8309-1f01ac44210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "address": "fa:16:3e:d4:5b:5e", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bdc530-6e", "ovs_interfaceid": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35ac986d-579c-4dcb-bee5-536a729a415c", "address": "fa:16:3e:4f:75:e2", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac986d-57", "ovs_interfaceid": "35ac986d-579c-4dcb-bee5-536a729a415c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "address": "fa:16:3e:db:93:52", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c706397-f0", "ovs_interfaceid": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3acfbe-01", "ovs_interfaceid": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2fd53b1-5769-4dea-960f-1797d60e8099", "address": "fa:16:3e:81:96:39", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fd53b1-57", "ovs_interfaceid": "a2fd53b1-5769-4dea-960f-1797d60e8099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b956c51e-f736-461f-956a-29b585d0e31f", "address": "fa:16:3e:a3:a3:f3", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb956c51e-f7", "ovs_interfaceid": "b956c51e-f736-461f-956a-29b585d0e31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJGprSUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab04a3a9-4a73-49d1-898a-547cb961e43f', 'attached_at': '', 'detached_at': '', 'volume_id': '512737dd-f70d-4cc3-8a77-936583fa73ed', 'serial': '512737dd-f70d-4cc3-8a77-936583fa73ed'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '21d07ee3-7ef2-45ff-a166-ec16d1b8e8a3', 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLpbacSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab04a3a9-4a73-49d1-898a-547cb961e43f', 'attached_at': '', 'detached_at': '', 'volume_id': '371afae4-ff7a-483d-aeea-94b83bcb16d6', 'serial': '371afae4-ff7a-483d-aeea-94b83bcb16d6'}, 'boot_index': 1, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'cc348f63-23ab-4a7f-9475-860c6296d7dd', 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozixcMYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab04a3a9-4a73-49d1-898a-547cb961e43f', 'attached_at': '', 'detached_at': '', 'volume_id': '6ac062cb-4adf-4b35-8b4c-dc4fb71e6665', 'serial': '6ac062cb-4adf-4b35-8b4c-dc4fb71e6665'}, 'boot_index': 2, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '2ed28a96-fce5-45de-a2cb-972252f12bb6', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:28:33 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:28:33 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJGprSUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:28:33 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:28:33 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:28:33 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[028259c6-a7e7-407d-9f36-dc7114a9c6fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:28:33 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[407cfe2a-f0ea-4b39-b8ef-3c0c6611c0db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed] added
Oct 26 03:28:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.184s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb81f5e-86bc-4b77-81fa-7ebc5d0e8888]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b7fa3c-d97c-4872-8a74-483dd34bbfba]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJGprSUW {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJGprSUW" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[081a27f3-f2e0-461f-b909-6812470b96f2]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zJGprSUW'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d0d58e-5380-48a8-b291-02340c82337a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b7b080-b267-479b-8a03-d855bb7d253a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk 1073741824" returned: 0 in 0.056s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --login" returned: 0 in 0.155s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[532421c7-02a4-4088-90db-37be4c4e5567]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed, portal: 172.16.0.220,3260]
Oct 26 03:28:33 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed, portal: 172.16.0.220,3260] successful.
Oct 26 03:28:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28199dd-f45d-4961-9e3a-86033e29233d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2011c19-83e6-4955-b096-81e5fa6a8571]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:28:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:33 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:28:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.441s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] HCTL ('38', '-', '-', 0) found on session 18 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bc6a4e-22eb-4183-a41c-b0966bb01667]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:33 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.222s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Cannot resize image /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Ensure instance console log exists: /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Start _get_guest_xml network_info=[{"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZLrARmS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5441872-864e-44d9-8632-e05c5d71bd90', 'attached_at': '', 'detached_at': '', 'volume_id': '9de496c0-3619-4b18-b4a4-4e490cbfe516', 'serial': '9de496c0-3619-4b18-b4a4-4e490cbfe516'}, 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '6fe51949-5fb3-4724-8d3d-d9b0259dc27e', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:28:34 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 03:28:34 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.objects.instance [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lazy-loading 'vcpu_model' on Instance uuid f5441872-864e-44d9-8632-e05c5d71bd90 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZLrARmS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:28:34 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 03:28:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJGprSUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.472s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] <== connect_volume: return (1474ms) {'type': 'block', 'scsi_wwn': '26636663335393166', 'path': '/dev/sdg'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636663335393166', 'path': '/dev/sdg'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.615s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:28:34 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 03:28:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:28:34 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:28:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfabba4e-e7b9-4147-94f7-e9c31b51463e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:28:34 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:28:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLpbacSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:28:34 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:28:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa075a1e-261c-4ad2-a5e0-b226abb088c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516] added
Oct 26 03:28:35 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a015ae-a223-44f8-9ec9-bf2c6cc4405b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[84246133-7316-42e1-8395-4937ca2f0c95]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZLrARmS {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZLrARmS" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7b757f-9bc2-4530-baf7-47ceb3306711]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OZLrARmS'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f0cbd5-fdb9-403f-b0e3-2e9d093acd75]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[198d0a60-6390-4af6-92e0-9aabe5516b32]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:28:35 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:28:35 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a49e127-6653-4a42-bd9d-f9cad3cdc6df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260]
Oct 26 03:28:35 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260] successful.
Oct 26 03:28:35 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d67c5c-9012-4e88-84ce-fd6db2a5f06d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5aa0b6-6ece-4559-9172-59ac88cb9f0a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:28:35 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:28:35 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] HCTL ('39', '-', '-', 0) found on session 19 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4455fc-594d-4681-881f-faca3e317385]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:35 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching for a device in session 19 and hctl ['39', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching for a device in session 19 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZLrARmS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] <== connect_volume: return (1962ms) {'type': 'block', 'scsi_wwn': '26465626636623237', 'path': '/dev/sdh'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465626636623237', 'path': '/dev/sdh'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.315s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:28:36 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:28:36 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec76b4f-f97c-4eb6-a17a-1c0f555c0ac5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:28:36 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T03:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-408750285',display_name='tempest-ServerActionsTestOtherA-server-1153489039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-408750285',id=15,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRQj+j0h8s5l5/c9Kzf5LlZUmn49bhrlJ3uSCaWTItfHpDtTlIsJ4WHGZJvTY9PtPQoKpGGVmQzLPcnzgoq3B+7cpI6c0xMS0qeeWXVorHztRqAqFqwFVzyTc7R0LLXqA==',key_name='tempest-keypair-1000691134',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51542ffdf7a84ac5a61f14e124eb2087',ramdisk_id='',reservation_id='r-6oe0n30b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-41539930',owner_user_name='tempest-ServerActionsTestOtherA-41539930-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a419737713f4797ab27db62d5aa746c',uuid=f5441872-864e-44d9-8632-e05c5d71bd90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converting VIF {"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:9b:96,bridge_name='br-int',has_traffic_filtering=True,id=add088cb-2d9c-4ad2-a72b-64f1138ddfa2,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd088cb-2d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:28:36 user nova-compute[74630]:   <uuid>f5441872-864e-44d9-8632-e05c5d71bd90</uuid>
Oct 26 03:28:36 user nova-compute[74630]:   <name>instance-0000000f</name>
Oct 26 03:28:36 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:28:36 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:28:36 user nova-compute[74630]:   <metadata>
Oct 26 03:28:36 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:28:36 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:28:36 user nova-compute[74630]:       <nova:name>tempest-ServerActionsTestOtherA-server-1153489039</nova:name>
Oct 26 03:28:36 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:28:34</nova:creationTime>
Oct 26 03:28:36 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:28:36 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:28:36 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:28:36 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:28:36 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:28:36 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:28:36 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:28:36 user nova-compute[74630]:       <nova:owner>
Oct 26 03:28:36 user nova-compute[74630]:         <nova:user uuid="7a419737713f4797ab27db62d5aa746c">tempest-ServerActionsTestOtherA-41539930-project-member</nova:user>
Oct 26 03:28:36 user nova-compute[74630]:         <nova:project uuid="51542ffdf7a84ac5a61f14e124eb2087">tempest-ServerActionsTestOtherA-41539930</nova:project>
Oct 26 03:28:36 user nova-compute[74630]:       </nova:owner>
Oct 26 03:28:36 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:28:36 user nova-compute[74630]:       <nova:ports>
Oct 26 03:28:36 user nova-compute[74630]:         <nova:port uuid="add088cb-2d9c-4ad2-a72b-64f1138ddfa2">
Oct 26 03:28:36 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 03:28:36 user nova-compute[74630]:         </nova:port>
Oct 26 03:28:36 user nova-compute[74630]:       </nova:ports>
Oct 26 03:28:36 user nova-compute[74630]:     </nova:instance>
Oct 26 03:28:36 user nova-compute[74630]:   </metadata>
Oct 26 03:28:36 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:28:36 user nova-compute[74630]:     <system>
Oct 26 03:28:36 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:28:36 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:28:36 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:28:36 user nova-compute[74630]:       <entry name="serial">f5441872-864e-44d9-8632-e05c5d71bd90</entry>
Oct 26 03:28:36 user nova-compute[74630]:       <entry name="uuid">f5441872-864e-44d9-8632-e05c5d71bd90</entry>
Oct 26 03:28:36 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:28:36 user nova-compute[74630]:     </system>
Oct 26 03:28:36 user nova-compute[74630]:   </sysinfo>
Oct 26 03:28:36 user nova-compute[74630]:   <os>
Oct 26 03:28:36 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:28:36 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:28:36 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:28:36 user nova-compute[74630]:   </os>
Oct 26 03:28:36 user nova-compute[74630]:   <features>
Oct 26 03:28:36 user nova-compute[74630]:     <acpi/>
Oct 26 03:28:36 user nova-compute[74630]:     <apic/>
Oct 26 03:28:36 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:28:36 user nova-compute[74630]:   </features>
Oct 26 03:28:36 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:28:36 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:28:36 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:28:36 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:28:36 user nova-compute[74630]:   </clock>
Oct 26 03:28:36 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:28:36 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:28:36 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:28:36 user nova-compute[74630]:   </cpu>
Oct 26 03:28:36 user nova-compute[74630]:   <devices>
Oct 26 03:28:36 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:28:36 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:28:36 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk"/>
Oct 26 03:28:36 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:28:36 user nova-compute[74630]:     </disk>
Oct 26 03:28:36 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:28:36 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:28:36 user nova-compute[74630]:       <source dev="/dev/sdh"/>
Oct 26 03:28:36 user nova-compute[74630]:       <target dev="vdb" bus="virtio"/>
Oct 26 03:28:36 user nova-compute[74630]:       <serial>9de496c0-3619-4b18-b4a4-4e490cbfe516</serial>
Oct 26 03:28:36 user nova-compute[74630]:     </disk>
Oct 26 03:28:36 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:28:36 user nova-compute[74630]:       <mac address="fa:16:3e:3d:9b:96"/>
Oct 26 03:28:36 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:28:36 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:28:36 user nova-compute[74630]:       <target dev="tapadd088cb-2d"/>
Oct 26 03:28:36 user nova-compute[74630]:     </interface>
Oct 26 03:28:36 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:28:36 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/console.log" append="off"/>
Oct 26 03:28:36 user nova-compute[74630]:     </serial>
Oct 26 03:28:36 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:28:36 user nova-compute[74630]:     <video>
Oct 26 03:28:36 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:28:36 user nova-compute[74630]:     </video>
Oct 26 03:28:36 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:28:36 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:28:36 user nova-compute[74630]:     </rng>
Oct 26 03:28:36 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:28:36 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:28:36 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:28:36 user nova-compute[74630]:     </memballoon>
Oct 26 03:28:36 user nova-compute[74630]:   </devices>
Oct 26 03:28:36 user nova-compute[74630]: </domain>
Oct 26 03:28:36 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T03:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-408750285',display_name='tempest-ServerActionsTestOtherA-server-1153489039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-408750285',id=15,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRQj+j0h8s5l5/c9Kzf5LlZUmn49bhrlJ3uSCaWTItfHpDtTlIsJ4WHGZJvTY9PtPQoKpGGVmQzLPcnzgoq3B+7cpI6c0xMS0qeeWXVorHztRqAqFqwFVzyTc7R0LLXqA==',key_name='tempest-keypair-1000691134',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51542ffdf7a84ac5a61f14e124eb2087',ramdisk_id='',reservation_id='r-6oe0n30b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-41539930',owner_user_name='tempest-ServerActionsTestOtherA-41539930-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a419737713f4797ab27db62d5aa746c',uuid=f5441872-864e-44d9-8632-e05c5d71bd90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converting VIF {"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:9b:96,bridge_name='br-int',has_traffic_filtering=True,id=add088cb-2d9c-4ad2-a72b-64f1138ddfa2,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd088cb-2d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_vif [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:9b:96,bridge_name='br-int',has_traffic_filtering=True,id=add088cb-2d9c-4ad2-a72b-64f1138ddfa2,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd088cb-2d') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '140f4d8b-2c9b-596d-9e48-bf23751049ae', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c33cdc-f50b-44b0-b580-a99bef06c70d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6] added
Oct 26 03:28:36 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadd088cb-2d, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapadd088cb-2d, col_values=(('qos', UUID('8597558d-31dc-42e3-b955-c19d112e649b')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapadd088cb-2d, col_values=(('external_ids', {'iface-id': 'add088cb-2d9c-4ad2-a72b-64f1138ddfa2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:9b:96', 'vm-uuid': 'f5441872-864e-44d9-8632-e05c5d71bd90'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:36 user nova-compute[74630]: INFO os_vif [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:9b:96,bridge_name='br-int',has_traffic_filtering=True,id=add088cb-2d9c-4ad2-a72b-64f1138ddfa2,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd088cb-2d')
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7ceb04-45d3-41ea-80d0-bf10ad035a43]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52a9d88-a116-40c4-881e-2514056d67d1]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLpbacSX {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jLpbacSX" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[719c2df3-b7cf-4775-a486-33c2f5ea1bbc]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jLpbacSX'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] No VIF found with MAC fa:16:3e:3d:9b:96, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee5bb7a-3f9a-4afd-837b-ba856641eb99]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[183f02c2-cf49-420d-8daa-4c3d2ba9b0c8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[880b273c-fb83-41e3-a76e-08fb203d25cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6, portal: 172.16.0.220,3260]
Oct 26 03:28:36 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6, portal: 172.16.0.220,3260] successful.
Oct 26 03:28:36 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cf3574-178c-4fbe-896a-2f59fbc28ede]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed82f4d5-38e8-4da7-8516-48fe9139e2b2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:28:36 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] HCTL ('40', '-', '-', 0) found on session 20 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[be06858d-2c98-4dfe-8f10-b8746b7d1735]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Searching for a device in session 20 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:28:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLpbacSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] <== connect_volume: return (2736ms) {'type': 'block', 'scsi_wwn': '26438666130623963', 'path': '/dev/sdi'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438666130623963', 'path': '/dev/sdi'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozixcMYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:28:37 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:28:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:28:37 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:28:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:28:37 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:28:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92249f7-1908-49aa-9f2c-2db01198fd11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:28:37 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d75df3-06c0-4689-b625-b453906c4a56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665] added
Oct 26 03:28:37 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe40e8f-24e6-41d8-82fc-976b8e688df8]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[82288216-1e2b-4045-a98a-404b93a9c6b6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozixcMYJ {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozixcMYJ" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bf1651-599f-46b4-9d61-720e168239f1]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ozixcMYJ'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7b7dc2-202f-4d8c-8093-96c12a012f34]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-f1487f94-f468-4f8a-b1b4-883a0dc05fb6 req-1eed4cf0-dd07-432a-88fc-089873ed3f88 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received event network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f1487f94-f468-4f8a-b1b4-883a0dc05fb6 req-1eed4cf0-dd07-432a-88fc-089873ed3f88 service nova] Acquiring lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f1487f94-f468-4f8a-b1b4-883a0dc05fb6 req-1eed4cf0-dd07-432a-88fc-089873ed3f88 service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f1487f94-f468-4f8a-b1b4-883a0dc05fb6 req-1eed4cf0-dd07-432a-88fc-089873ed3f88 service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-f1487f94-f468-4f8a-b1b4-883a0dc05fb6 req-1eed4cf0-dd07-432a-88fc-089873ed3f88 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] No waiting events found dispatching network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:37 user nova-compute[74630]: WARNING nova.compute.manager [req-f1487f94-f468-4f8a-b1b4-883a0dc05fb6 req-1eed4cf0-dd07-432a-88fc-089873ed3f88 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received unexpected event network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 for instance with vm_state active and task_state rebuild_spawning.
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c033458b-9a75-4121-9ce2-ef92549e05d7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:37 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:37 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:37 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:37 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:37 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:28:37 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:28:37 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:28:37 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:37 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:37 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:37 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:37 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:37 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:28:37 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:28:37 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:28:37 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c779b77b-5234-441b-86bb-887a5181751d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665, portal: 172.16.0.220,3260]
Oct 26 03:28:38 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665, portal: 172.16.0.220,3260] successful.
Oct 26 03:28:38 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee9da2b-ccd4-4142-a3ea-cd9a2b28cac9]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedc366e-ed1b-4db7-a041-ee833bb39eba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:28:38 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:28:38 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:28:38 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] HCTL ('41', '-', '-', 0) found on session 21 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdc6754-8b79-451f-aa68-a3ff22e22bab]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Searching for a device in session 21 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozixcMYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:28:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23165353962623032', 'path': '/dev/sdj'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165353962623032', 'path': '/dev/sdj'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47b60220-f566-48bd-8309-1f01ac44210f", "address": "fa:16:3e:5c:90:01", "network": {"id": "60b1d36a-bbd2-490b-aee0-e81b6501a8e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-631511684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b60220-f5", "ovs_interfaceid": "47b60220-f566-48bd-8309-1f01ac44210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "47b60220-f566-48bd-8309-1f01ac44210f", "address": "fa:16:3e:5c:90:01", "network": {"id": "60b1d36a-bbd2-490b-aee0-e81b6501a8e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-631511684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b60220-f5", "ovs_interfaceid": "47b60220-f566-48bd-8309-1f01ac44210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:90:01,bridge_name='br-int',has_traffic_filtering=True,id=47b60220-f566-48bd-8309-1f01ac44210f,network=Network(60b1d36a-bbd2-490b-aee0-e81b6501a8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47b60220-f5') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "address": "fa:16:3e:d4:5b:5e", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bdc530-6e", "ovs_interfaceid": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "address": "fa:16:3e:d4:5b:5e", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bdc530-6e", "ovs_interfaceid": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:5b:5e,bridge_name='br-int',has_traffic_filtering=True,id=44bdc530-6e50-4fff-b4fc-4fac53dff73a,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44bdc530-6e') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35ac986d-579c-4dcb-bee5-536a729a415c", "address": "fa:16:3e:4f:75:e2", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac986d-57", "ovs_interfaceid": "35ac986d-579c-4dcb-bee5-536a729a415c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "35ac986d-579c-4dcb-bee5-536a729a415c", "address": "fa:16:3e:4f:75:e2", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac986d-57", "ovs_interfaceid": "35ac986d-579c-4dcb-bee5-536a729a415c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:75:e2,bridge_name='br-int',has_traffic_filtering=True,id=35ac986d-579c-4dcb-bee5-536a729a415c,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap35ac986d-57') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "address": "fa:16:3e:db:93:52", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c706397-f0", "ovs_interfaceid": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "address": "fa:16:3e:db:93:52", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c706397-f0", "ovs_interfaceid": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:93:52,bridge_name='br-int',has_traffic_filtering=True,id=3c706397-f0b9-4d1c-9f03-d7808255fc57,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c706397-f0') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3acfbe-01", "ovs_interfaceid": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3acfbe-01", "ovs_interfaceid": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7c:ae,bridge_name='br-int',has_traffic_filtering=True,id=2c3acfbe-013e-4bf0-bb79-c84f9898353c,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c3acfbe-01') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2fd53b1-5769-4dea-960f-1797d60e8099", "address": "fa:16:3e:81:96:39", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fd53b1-57", "ovs_interfaceid": "a2fd53b1-5769-4dea-960f-1797d60e8099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "a2fd53b1-5769-4dea-960f-1797d60e8099", "address": "fa:16:3e:81:96:39", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fd53b1-57", "ovs_interfaceid": "a2fd53b1-5769-4dea-960f-1797d60e8099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:96:39,bridge_name='br-int',has_traffic_filtering=True,id=a2fd53b1-5769-4dea-960f-1797d60e8099,network=Network(0ab14735-0308-4373-be67-7d6add5de46c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fd53b1-57') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b956c51e-f736-461f-956a-29b585d0e31f", "address": "fa:16:3e:a3:a3:f3", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb956c51e-f7", "ovs_interfaceid": "b956c51e-f736-461f-956a-29b585d0e31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "b956c51e-f736-461f-956a-29b585d0e31f", "address": "fa:16:3e:a3:a3:f3", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb956c51e-f7", "ovs_interfaceid": "b956c51e-f736-461f-956a-29b585d0e31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:a3:f3,bridge_name='br-int',has_traffic_filtering=True,id=b956c51e-f736-461f-956a-29b585d0e31f,network=Network(0ab14735-0308-4373-be67-7d6add5de46c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb956c51e-f7') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.objects.instance [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lazy-loading 'pci_devices' on Instance uuid ab04a3a9-4a73-49d1-898a-547cb961e43f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:28:39 user nova-compute[74630]:   <uuid>ab04a3a9-4a73-49d1-898a-547cb961e43f</uuid>
Oct 26 03:28:39 user nova-compute[74630]:   <name>instance-00000013</name>
Oct 26 03:28:39 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:28:39 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:28:39 user nova-compute[74630]:   <metadata>
Oct 26 03:28:39 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:28:39 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:28:39 user nova-compute[74630]:       <nova:name>tempest-device-tagging-server-405950710</nova:name>
Oct 26 03:28:39 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:28:33</nova:creationTime>
Oct 26 03:28:39 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:28:39 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:28:39 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:28:39 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:28:39 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:28:39 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:28:39 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:28:39 user nova-compute[74630]:       <nova:owner>
Oct 26 03:28:39 user nova-compute[74630]:         <nova:user uuid="5a7d636306a941bbbedf02c4ea8edd30">tempest-TaggedBootDevicesTest-1281532896-project-member</nova:user>
Oct 26 03:28:39 user nova-compute[74630]:         <nova:project uuid="9a9993c7e16f451abd29d628bbc78ff2">tempest-TaggedBootDevicesTest-1281532896</nova:project>
Oct 26 03:28:39 user nova-compute[74630]:       </nova:owner>
Oct 26 03:28:39 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:28:39 user nova-compute[74630]:       <nova:ports>
Oct 26 03:28:39 user nova-compute[74630]:         <nova:port uuid="47b60220-f566-48bd-8309-1f01ac44210f">
Oct 26 03:28:39 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 03:28:39 user nova-compute[74630]:         </nova:port>
Oct 26 03:28:39 user nova-compute[74630]:         <nova:port uuid="44bdc530-6e50-4fff-b4fc-4fac53dff73a">
Oct 26 03:28:39 user nova-compute[74630]:           <nova:ip type="fixed" address="10.1.1.135" ipVersion="4"/>
Oct 26 03:28:39 user nova-compute[74630]:         </nova:port>
Oct 26 03:28:39 user nova-compute[74630]:         <nova:port uuid="35ac986d-579c-4dcb-bee5-536a729a415c">
Oct 26 03:28:39 user nova-compute[74630]:           <nova:ip type="fixed" address="10.1.1.65" ipVersion="4"/>
Oct 26 03:28:39 user nova-compute[74630]:         </nova:port>
Oct 26 03:28:39 user nova-compute[74630]:         <nova:port uuid="3c706397-f0b9-4d1c-9f03-d7808255fc57">
Oct 26 03:28:39 user nova-compute[74630]:           <nova:ip type="fixed" address="10.1.1.105" ipVersion="4"/>
Oct 26 03:28:39 user nova-compute[74630]:         </nova:port>
Oct 26 03:28:39 user nova-compute[74630]:         <nova:port uuid="2c3acfbe-013e-4bf0-bb79-c84f9898353c">
Oct 26 03:28:39 user nova-compute[74630]:           <nova:ip type="fixed" address="10.1.1.90" ipVersion="4"/>
Oct 26 03:28:39 user nova-compute[74630]:         </nova:port>
Oct 26 03:28:39 user nova-compute[74630]:         <nova:port uuid="a2fd53b1-5769-4dea-960f-1797d60e8099">
Oct 26 03:28:39 user nova-compute[74630]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 26 03:28:39 user nova-compute[74630]:         </nova:port>
Oct 26 03:28:39 user nova-compute[74630]:         <nova:port uuid="b956c51e-f736-461f-956a-29b585d0e31f">
Oct 26 03:28:39 user nova-compute[74630]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 26 03:28:39 user nova-compute[74630]:         </nova:port>
Oct 26 03:28:39 user nova-compute[74630]:       </nova:ports>
Oct 26 03:28:39 user nova-compute[74630]:     </nova:instance>
Oct 26 03:28:39 user nova-compute[74630]:   </metadata>
Oct 26 03:28:39 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:28:39 user nova-compute[74630]:     <system>
Oct 26 03:28:39 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:28:39 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:28:39 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:28:39 user nova-compute[74630]:       <entry name="serial">ab04a3a9-4a73-49d1-898a-547cb961e43f</entry>
Oct 26 03:28:39 user nova-compute[74630]:       <entry name="uuid">ab04a3a9-4a73-49d1-898a-547cb961e43f</entry>
Oct 26 03:28:39 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:28:39 user nova-compute[74630]:     </system>
Oct 26 03:28:39 user nova-compute[74630]:   </sysinfo>
Oct 26 03:28:39 user nova-compute[74630]:   <os>
Oct 26 03:28:39 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:28:39 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:28:39 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:28:39 user nova-compute[74630]:   </os>
Oct 26 03:28:39 user nova-compute[74630]:   <features>
Oct 26 03:28:39 user nova-compute[74630]:     <acpi/>
Oct 26 03:28:39 user nova-compute[74630]:     <apic/>
Oct 26 03:28:39 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:28:39 user nova-compute[74630]:   </features>
Oct 26 03:28:39 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:28:39 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:28:39 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:28:39 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:28:39 user nova-compute[74630]:   </clock>
Oct 26 03:28:39 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:28:39 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:28:39 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:28:39 user nova-compute[74630]:   </cpu>
Oct 26 03:28:39 user nova-compute[74630]:   <devices>
Oct 26 03:28:39 user nova-compute[74630]:     <disk type="file" device="cdrom">
Oct 26 03:28:39 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 03:28:39 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/ab04a3a9-4a73-49d1-898a-547cb961e43f/disk.config"/>
Oct 26 03:28:39 user nova-compute[74630]:       <target dev="hda" bus="ide"/>
Oct 26 03:28:39 user nova-compute[74630]:     </disk>
Oct 26 03:28:39 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:28:39 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:28:39 user nova-compute[74630]:       <source dev="/dev/sdg"/>
Oct 26 03:28:39 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:28:39 user nova-compute[74630]:       <serial>512737dd-f70d-4cc3-8a77-936583fa73ed</serial>
Oct 26 03:28:39 user nova-compute[74630]:     </disk>
Oct 26 03:28:39 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:28:39 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:28:39 user nova-compute[74630]:       <source dev="/dev/sdi"/>
Oct 26 03:28:39 user nova-compute[74630]:       <target dev="vdb" bus="virtio"/>
Oct 26 03:28:39 user nova-compute[74630]:       <serial>371afae4-ff7a-483d-aeea-94b83bcb16d6</serial>
Oct 26 03:28:39 user nova-compute[74630]:     </disk>
Oct 26 03:28:39 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:28:39 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:28:39 user nova-compute[74630]:       <source dev="/dev/sdj"/>
Oct 26 03:28:39 user nova-compute[74630]:       <target dev="vdc" bus="virtio"/>
Oct 26 03:28:39 user nova-compute[74630]:       <serial>6ac062cb-4adf-4b35-8b4c-dc4fb71e6665</serial>
Oct 26 03:28:39 user nova-compute[74630]:     </disk>
Oct 26 03:28:39 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:28:39 user nova-compute[74630]:       <mac address="fa:16:3e:5c:90:01"/>
Oct 26 03:28:39 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:28:39 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:28:39 user nova-compute[74630]:       <target dev="tap47b60220-f5"/>
Oct 26 03:28:39 user nova-compute[74630]:     </interface>
Oct 26 03:28:39 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:28:39 user nova-compute[74630]:       <mac address="fa:16:3e:d4:5b:5e"/>
Oct 26 03:28:39 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:28:39 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:28:39 user nova-compute[74630]:       <target dev="tap44bdc530-6e"/>
Oct 26 03:28:39 user nova-compute[74630]:     </interface>
Oct 26 03:28:39 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:28:39 user nova-compute[74630]:       <mac address="fa:16:3e:4f:75:e2"/>
Oct 26 03:28:39 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:28:39 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:28:39 user nova-compute[74630]:       <target dev="tap35ac986d-57"/>
Oct 26 03:28:39 user nova-compute[74630]:     </interface>
Oct 26 03:28:39 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:28:39 user nova-compute[74630]:       <mac address="fa:16:3e:db:93:52"/>
Oct 26 03:28:39 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:28:39 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:28:39 user nova-compute[74630]:       <target dev="tap3c706397-f0"/>
Oct 26 03:28:39 user nova-compute[74630]:     </interface>
Oct 26 03:28:39 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:28:39 user nova-compute[74630]:       <mac address="fa:16:3e:b4:7c:ae"/>
Oct 26 03:28:39 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:28:39 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:28:39 user nova-compute[74630]:       <target dev="tap2c3acfbe-01"/>
Oct 26 03:28:39 user nova-compute[74630]:     </interface>
Oct 26 03:28:39 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:28:39 user nova-compute[74630]:       <mac address="fa:16:3e:81:96:39"/>
Oct 26 03:28:39 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:28:39 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:28:39 user nova-compute[74630]:       <target dev="tapa2fd53b1-57"/>
Oct 26 03:28:39 user nova-compute[74630]:     </interface>
Oct 26 03:28:39 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:28:39 user nova-compute[74630]:       <mac address="fa:16:3e:a3:a3:f3"/>
Oct 26 03:28:39 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:28:39 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:28:39 user nova-compute[74630]:       <target dev="tapb956c51e-f7"/>
Oct 26 03:28:39 user nova-compute[74630]:     </interface>
Oct 26 03:28:39 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:28:39 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/ab04a3a9-4a73-49d1-898a-547cb961e43f/console.log" append="off"/>
Oct 26 03:28:39 user nova-compute[74630]:     </serial>
Oct 26 03:28:39 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:28:39 user nova-compute[74630]:     <video>
Oct 26 03:28:39 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:28:39 user nova-compute[74630]:     </video>
Oct 26 03:28:39 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:28:39 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:28:39 user nova-compute[74630]:     </rng>
Oct 26 03:28:39 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:28:39 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:28:39 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:28:39 user nova-compute[74630]:     </memballoon>
Oct 26 03:28:39 user nova-compute[74630]:   </devices>
Oct 26 03:28:39 user nova-compute[74630]: </domain>
Oct 26 03:28:39 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47b60220-f566-48bd-8309-1f01ac44210f", "address": "fa:16:3e:5c:90:01", "network": {"id": "60b1d36a-bbd2-490b-aee0-e81b6501a8e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-631511684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b60220-f5", "ovs_interfaceid": "47b60220-f566-48bd-8309-1f01ac44210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "47b60220-f566-48bd-8309-1f01ac44210f", "address": "fa:16:3e:5c:90:01", "network": {"id": "60b1d36a-bbd2-490b-aee0-e81b6501a8e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-631511684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b60220-f5", "ovs_interfaceid": "47b60220-f566-48bd-8309-1f01ac44210f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:90:01,bridge_name='br-int',has_traffic_filtering=True,id=47b60220-f566-48bd-8309-1f01ac44210f,network=Network(60b1d36a-bbd2-490b-aee0-e81b6501a8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47b60220-f5') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG os_vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:90:01,bridge_name='br-int',has_traffic_filtering=True,id=47b60220-f566-48bd-8309-1f01ac44210f,network=Network(60b1d36a-bbd2-490b-aee0-e81b6501a8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47b60220-f5') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '874d9b03-b5dc-58b2-abfd-0964ef85216f', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47b60220-f5, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47b60220-f5, col_values=(('qos', UUID('d22908ca-f05c-46df-a903-5b7941823bd7')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47b60220-f5, col_values=(('external_ids', {'iface-id': '47b60220-f566-48bd-8309-1f01ac44210f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:90:01', 'vm-uuid': 'ab04a3a9-4a73-49d1-898a-547cb961e43f'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: INFO os_vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:90:01,bridge_name='br-int',has_traffic_filtering=True,id=47b60220-f566-48bd-8309-1f01ac44210f,network=Network(60b1d36a-bbd2-490b-aee0-e81b6501a8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47b60220-f5')
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "address": "fa:16:3e:d4:5b:5e", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bdc530-6e", "ovs_interfaceid": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "address": "fa:16:3e:d4:5b:5e", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bdc530-6e", "ovs_interfaceid": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:5b:5e,bridge_name='br-int',has_traffic_filtering=True,id=44bdc530-6e50-4fff-b4fc-4fac53dff73a,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44bdc530-6e') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG os_vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:5b:5e,bridge_name='br-int',has_traffic_filtering=True,id=44bdc530-6e50-4fff-b4fc-4fac53dff73a,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44bdc530-6e') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6092481-1631-590f-829a-f1b4d1835785', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44bdc530-6e, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44bdc530-6e, col_values=(('qos', UUID('163118fa-c4dd-4c3c-bcd9-2bb26cb5856c')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44bdc530-6e, col_values=(('external_ids', {'iface-id': '44bdc530-6e50-4fff-b4fc-4fac53dff73a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:5b:5e', 'vm-uuid': 'ab04a3a9-4a73-49d1-898a-547cb961e43f'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: INFO os_vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:5b:5e,bridge_name='br-int',has_traffic_filtering=True,id=44bdc530-6e50-4fff-b4fc-4fac53dff73a,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44bdc530-6e')
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35ac986d-579c-4dcb-bee5-536a729a415c", "address": "fa:16:3e:4f:75:e2", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac986d-57", "ovs_interfaceid": "35ac986d-579c-4dcb-bee5-536a729a415c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "35ac986d-579c-4dcb-bee5-536a729a415c", "address": "fa:16:3e:4f:75:e2", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac986d-57", "ovs_interfaceid": "35ac986d-579c-4dcb-bee5-536a729a415c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:75:e2,bridge_name='br-int',has_traffic_filtering=True,id=35ac986d-579c-4dcb-bee5-536a729a415c,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap35ac986d-57') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG os_vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:75:e2,bridge_name='br-int',has_traffic_filtering=True,id=35ac986d-579c-4dcb-bee5-536a729a415c,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap35ac986d-57') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61286c0d-2592-579f-85ab-0a3fd4f1a40e', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35ac986d-57, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35ac986d-57, col_values=(('qos', UUID('8f12fa2c-dd20-4f6d-8c9e-01ecae4a9250')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35ac986d-57, col_values=(('external_ids', {'iface-id': '35ac986d-579c-4dcb-bee5-536a729a415c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:75:e2', 'vm-uuid': 'ab04a3a9-4a73-49d1-898a-547cb961e43f'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: INFO os_vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:75:e2,bridge_name='br-int',has_traffic_filtering=True,id=35ac986d-579c-4dcb-bee5-536a729a415c,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap35ac986d-57')
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "address": "fa:16:3e:db:93:52", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c706397-f0", "ovs_interfaceid": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "address": "fa:16:3e:db:93:52", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c706397-f0", "ovs_interfaceid": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:93:52,bridge_name='br-int',has_traffic_filtering=True,id=3c706397-f0b9-4d1c-9f03-d7808255fc57,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c706397-f0') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG os_vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:93:52,bridge_name='br-int',has_traffic_filtering=True,id=3c706397-f0b9-4d1c-9f03-d7808255fc57,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c706397-f0') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c81ab26-ce58-5f10-9de6-65694246c174', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c706397-f0, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c706397-f0, col_values=(('qos', UUID('f1d538d0-6763-4cfa-9eed-2d45b5b17f2b')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c706397-f0, col_values=(('external_ids', {'iface-id': '3c706397-f0b9-4d1c-9f03-d7808255fc57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:93:52', 'vm-uuid': 'ab04a3a9-4a73-49d1-898a-547cb961e43f'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: INFO os_vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:93:52,bridge_name='br-int',has_traffic_filtering=True,id=3c706397-f0b9-4d1c-9f03-d7808255fc57,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c706397-f0')
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3acfbe-01", "ovs_interfaceid": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3acfbe-01", "ovs_interfaceid": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7c:ae,bridge_name='br-int',has_traffic_filtering=True,id=2c3acfbe-013e-4bf0-bb79-c84f9898353c,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c3acfbe-01') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG os_vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7c:ae,bridge_name='br-int',has_traffic_filtering=True,id=2c3acfbe-013e-4bf0-bb79-c84f9898353c,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c3acfbe-01') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e106ffcb-7dd0-52e6-bca7-e9c15e21a546', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c3acfbe-01, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c3acfbe-01, col_values=(('qos', UUID('73dbb6f4-5e2f-44c0-a1a8-9b9ee53fc238')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c3acfbe-01, col_values=(('external_ids', {'iface-id': '2c3acfbe-013e-4bf0-bb79-c84f9898353c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:7c:ae', 'vm-uuid': 'ab04a3a9-4a73-49d1-898a-547cb961e43f'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:39 user nova-compute[74630]: INFO os_vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7c:ae,bridge_name='br-int',has_traffic_filtering=True,id=2c3acfbe-013e-4bf0-bb79-c84f9898353c,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c3acfbe-01')
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2fd53b1-5769-4dea-960f-1797d60e8099", "address": "fa:16:3e:81:96:39", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fd53b1-57", "ovs_interfaceid": "a2fd53b1-5769-4dea-960f-1797d60e8099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "a2fd53b1-5769-4dea-960f-1797d60e8099", "address": "fa:16:3e:81:96:39", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fd53b1-57", "ovs_interfaceid": "a2fd53b1-5769-4dea-960f-1797d60e8099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:96:39,bridge_name='br-int',has_traffic_filtering=True,id=a2fd53b1-5769-4dea-960f-1797d60e8099,network=Network(0ab14735-0308-4373-be67-7d6add5de46c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fd53b1-57') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG os_vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:96:39,bridge_name='br-int',has_traffic_filtering=True,id=a2fd53b1-5769-4dea-960f-1797d60e8099,network=Network(0ab14735-0308-4373-be67-7d6add5de46c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fd53b1-57') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4b072c3-b110-5fb3-8390-baa8ca663d91', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2fd53b1-57, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2fd53b1-57, col_values=(('qos', UUID('bdfbf1fc-ccc0-4df2-8898-a84e39a8cdd4')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2fd53b1-57, col_values=(('external_ids', {'iface-id': 'a2fd53b1-5769-4dea-960f-1797d60e8099', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:96:39', 'vm-uuid': 'ab04a3a9-4a73-49d1-898a-547cb961e43f'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:40 user nova-compute[74630]: INFO os_vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:96:39,bridge_name='br-int',has_traffic_filtering=True,id=a2fd53b1-5769-4dea-960f-1797d60e8099,network=Network(0ab14735-0308-4373-be67-7d6add5de46c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fd53b1-57')
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:26:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b956c51e-f736-461f-956a-29b585d0e31f", "address": "fa:16:3e:a3:a3:f3", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb956c51e-f7", "ovs_interfaceid": "b956c51e-f736-461f-956a-29b585d0e31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "b956c51e-f736-461f-956a-29b585d0e31f", "address": "fa:16:3e:a3:a3:f3", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb956c51e-f7", "ovs_interfaceid": "b956c51e-f736-461f-956a-29b585d0e31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:a3:f3,bridge_name='br-int',has_traffic_filtering=True,id=b956c51e-f736-461f-956a-29b585d0e31f,network=Network(0ab14735-0308-4373-be67-7d6add5de46c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb956c51e-f7') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG os_vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:a3:f3,bridge_name='br-int',has_traffic_filtering=True,id=b956c51e-f736-461f-956a-29b585d0e31f,network=Network(0ab14735-0308-4373-be67-7d6add5de46c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb956c51e-f7') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '194e9328-6931-57d6-8579-43f78d247986', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb956c51e-f7, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb956c51e-f7, col_values=(('qos', UUID('a1d73ced-a32b-44d5-adc7-9e45e79ef390')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb956c51e-f7, col_values=(('external_ids', {'iface-id': 'b956c51e-f736-461f-956a-29b585d0e31f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:a3:f3', 'vm-uuid': 'ab04a3a9-4a73-49d1-898a-547cb961e43f'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-887bad7b-0b66-492e-add1-1b6c04382431 req-61ebe9a9-7186-46c0-aafa-a4c96b8ca0c4 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received event network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-887bad7b-0b66-492e-add1-1b6c04382431 req-61ebe9a9-7186-46c0-aafa-a4c96b8ca0c4 service nova] Acquiring lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-887bad7b-0b66-492e-add1-1b6c04382431 req-61ebe9a9-7186-46c0-aafa-a4c96b8ca0c4 service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-887bad7b-0b66-492e-add1-1b6c04382431 req-61ebe9a9-7186-46c0-aafa-a4c96b8ca0c4 service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-887bad7b-0b66-492e-add1-1b6c04382431 req-61ebe9a9-7186-46c0-aafa-a4c96b8ca0c4 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] No waiting events found dispatching network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:40 user nova-compute[74630]: WARNING nova.compute.manager [req-887bad7b-0b66-492e-add1-1b6c04382431 req-61ebe9a9-7186-46c0-aafa-a4c96b8ca0c4 service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received unexpected event network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 for instance with vm_state active and task_state rebuild_spawning.
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:40 user nova-compute[74630]: INFO os_vif [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:a3:f3,bridge_name='br-int',has_traffic_filtering=True,id=b956c51e-f736-461f-956a-29b585d0e31f,network=Network(0ab14735-0308-4373-be67-7d6add5de46c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb956c51e-f7')
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.compute.manager [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:28:40 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Instance spawned successfully.
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] No BDM found with device name hda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] No VIF found with MAC fa:16:3e:5c:90:01, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] No VIF found with MAC fa:16:3e:b4:7c:ae, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:28:40 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Using config drive
Oct 26 03:28:40 user nova-compute[74630]: DEBUG nova.compute.manager [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:28:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:41 user nova-compute[74630]: DEBUG nova.objects.instance [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74630) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 26 03:28:41 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Creating config drive at /opt/stack/data/nova/instances/ab04a3a9-4a73-49d1-898a-547cb961e43f/disk.config
Oct 26 03:28:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ab04a3a9-4a73-49d1-898a-547cb961e43f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl5nwi2jv {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ab04a3a9-4a73-49d1-898a-547cb961e43f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl5nwi2jv" returned: 0 in 0.057s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-91377df0-b9ae-4cda-97ed-e4f4a872641b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.125s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b17fe076-8739-405f-b559-f830af4b5e63 req-84ab1497-b9f0-42c1-8fc3-b131299d176d service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-47b60220-f566-48bd-8309-1f01ac44210f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b17fe076-8739-405f-b559-f830af4b5e63 req-84ab1497-b9f0-42c1-8fc3-b131299d176d service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b17fe076-8739-405f-b559-f830af4b5e63 req-84ab1497-b9f0-42c1-8fc3-b131299d176d service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b17fe076-8739-405f-b559-f830af4b5e63 req-84ab1497-b9f0-42c1-8fc3-b131299d176d service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-b17fe076-8739-405f-b559-f830af4b5e63 req-84ab1497-b9f0-42c1-8fc3-b131299d176d service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-47b60220-f566-48bd-8309-1f01ac44210f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:43 user nova-compute[74630]: WARNING nova.compute.manager [req-b17fe076-8739-405f-b559-f830af4b5e63 req-84ab1497-b9f0-42c1-8fc3-b131299d176d service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-47b60220-f566-48bd-8309-1f01ac44210f for instance with vm_state building and task_state spawning.
Oct 26 03:28:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-ae06574b-2781-431a-9131-01246a85c506 req-4e3e2538-fa68-4ae3-b1b7-e4228222cb04 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-2c3acfbe-013e-4bf0-bb79-c84f9898353c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ae06574b-2781-431a-9131-01246a85c506 req-4e3e2538-fa68-4ae3-b1b7-e4228222cb04 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ae06574b-2781-431a-9131-01246a85c506 req-4e3e2538-fa68-4ae3-b1b7-e4228222cb04 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ae06574b-2781-431a-9131-01246a85c506 req-4e3e2538-fa68-4ae3-b1b7-e4228222cb04 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-ae06574b-2781-431a-9131-01246a85c506 req-4e3e2538-fa68-4ae3-b1b7-e4228222cb04 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-2c3acfbe-013e-4bf0-bb79-c84f9898353c {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:44 user nova-compute[74630]: WARNING nova.compute.manager [req-ae06574b-2781-431a-9131-01246a85c506 req-4e3e2538-fa68-4ae3-b1b7-e4228222cb04 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-2c3acfbe-013e-4bf0-bb79-c84f9898353c for instance with vm_state building and task_state spawning.
Oct 26 03:28:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-f8c1428b-d330-41d8-9795-66884be1e334 req-96dcf5a2-4434-435f-a254-802b215ae3e0 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-a2fd53b1-5769-4dea-960f-1797d60e8099 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f8c1428b-d330-41d8-9795-66884be1e334 req-96dcf5a2-4434-435f-a254-802b215ae3e0 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f8c1428b-d330-41d8-9795-66884be1e334 req-96dcf5a2-4434-435f-a254-802b215ae3e0 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f8c1428b-d330-41d8-9795-66884be1e334 req-96dcf5a2-4434-435f-a254-802b215ae3e0 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-f8c1428b-d330-41d8-9795-66884be1e334 req-96dcf5a2-4434-435f-a254-802b215ae3e0 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-a2fd53b1-5769-4dea-960f-1797d60e8099 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:44 user nova-compute[74630]: WARNING nova.compute.manager [req-f8c1428b-d330-41d8-9795-66884be1e334 req-96dcf5a2-4434-435f-a254-802b215ae3e0 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-a2fd53b1-5769-4dea-960f-1797d60e8099 for instance with vm_state building and task_state spawning.
Oct 26 03:28:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-47b60220-f566-48bd-8309-1f01ac44210f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-47b60220-f566-48bd-8309-1f01ac44210f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:45 user nova-compute[74630]: WARNING nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-47b60220-f566-48bd-8309-1f01ac44210f for instance with vm_state building and task_state spawning.
Oct 26 03:28:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-44bdc530-6e50-4fff-b4fc-4fac53dff73a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-44bdc530-6e50-4fff-b4fc-4fac53dff73a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:45 user nova-compute[74630]: WARNING nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-44bdc530-6e50-4fff-b4fc-4fac53dff73a for instance with vm_state building and task_state spawning.
Oct 26 03:28:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-44bdc530-6e50-4fff-b4fc-4fac53dff73a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-44bdc530-6e50-4fff-b4fc-4fac53dff73a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:45 user nova-compute[74630]: WARNING nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-44bdc530-6e50-4fff-b4fc-4fac53dff73a for instance with vm_state building and task_state spawning.
Oct 26 03:28:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-35ac986d-579c-4dcb-bee5-536a729a415c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-35ac986d-579c-4dcb-bee5-536a729a415c {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:45 user nova-compute[74630]: WARNING nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-35ac986d-579c-4dcb-bee5-536a729a415c for instance with vm_state building and task_state spawning.
Oct 26 03:28:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-35ac986d-579c-4dcb-bee5-536a729a415c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-35ac986d-579c-4dcb-bee5-536a729a415c {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:45 user nova-compute[74630]: WARNING nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-35ac986d-579c-4dcb-bee5-536a729a415c for instance with vm_state building and task_state spawning.
Oct 26 03:28:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-3c706397-f0b9-4d1c-9f03-d7808255fc57 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-3c706397-f0b9-4d1c-9f03-d7808255fc57 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:45 user nova-compute[74630]: WARNING nova.compute.manager [req-e24e285e-1a3c-4de4-9bdc-2b5a41035705 req-65a87243-31cc-4dac-9a3b-157e872adc33 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-3c706397-f0b9-4d1c-9f03-d7808255fc57 for instance with vm_state building and task_state spawning.
Oct 26 03:28:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-69077601-97cd-451f-8416-bea2244804c1 req-697f13e8-1cb4-4028-a2c6-13a30eec8fab service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-2c3acfbe-013e-4bf0-bb79-c84f9898353c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-69077601-97cd-451f-8416-bea2244804c1 req-697f13e8-1cb4-4028-a2c6-13a30eec8fab service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-69077601-97cd-451f-8416-bea2244804c1 req-697f13e8-1cb4-4028-a2c6-13a30eec8fab service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-69077601-97cd-451f-8416-bea2244804c1 req-697f13e8-1cb4-4028-a2c6-13a30eec8fab service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-69077601-97cd-451f-8416-bea2244804c1 req-697f13e8-1cb4-4028-a2c6-13a30eec8fab service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-2c3acfbe-013e-4bf0-bb79-c84f9898353c {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:46 user nova-compute[74630]: WARNING nova.compute.manager [req-69077601-97cd-451f-8416-bea2244804c1 req-697f13e8-1cb4-4028-a2c6-13a30eec8fab service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-2c3acfbe-013e-4bf0-bb79-c84f9898353c for instance with vm_state building and task_state spawning.
Oct 26 03:28:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-5cd40918-483a-4ef4-9b55-593298ec792d req-8104bd38-00f7-4cc9-a645-7a3c78271e62 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-a2fd53b1-5769-4dea-960f-1797d60e8099 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5cd40918-483a-4ef4-9b55-593298ec792d req-8104bd38-00f7-4cc9-a645-7a3c78271e62 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5cd40918-483a-4ef4-9b55-593298ec792d req-8104bd38-00f7-4cc9-a645-7a3c78271e62 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5cd40918-483a-4ef4-9b55-593298ec792d req-8104bd38-00f7-4cc9-a645-7a3c78271e62 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-5cd40918-483a-4ef4-9b55-593298ec792d req-8104bd38-00f7-4cc9-a645-7a3c78271e62 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-a2fd53b1-5769-4dea-960f-1797d60e8099 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:47 user nova-compute[74630]: WARNING nova.compute.manager [req-5cd40918-483a-4ef4-9b55-593298ec792d req-8104bd38-00f7-4cc9-a645-7a3c78271e62 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-a2fd53b1-5769-4dea-960f-1797d60e8099 for instance with vm_state building and task_state spawning.
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-3c706397-f0b9-4d1c-9f03-d7808255fc57 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-3c706397-f0b9-4d1c-9f03-d7808255fc57 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:47 user nova-compute[74630]: WARNING nova.compute.manager [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-3c706397-f0b9-4d1c-9f03-d7808255fc57 for instance with vm_state building and task_state spawning.
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-b956c51e-f736-461f-956a-29b585d0e31f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-b956c51e-f736-461f-956a-29b585d0e31f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:47 user nova-compute[74630]: WARNING nova.compute.manager [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-b956c51e-f736-461f-956a-29b585d0e31f for instance with vm_state building and task_state spawning.
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-b956c51e-f736-461f-956a-29b585d0e31f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-b956c51e-f736-461f-956a-29b585d0e31f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:47 user nova-compute[74630]: WARNING nova.compute.manager [req-6cd70bb1-67a2-4d04-bbd4-5f5cfba1ed5a req-23fa72d9-a058-4a66-b078-de9c93a1cd35 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-b956c51e-f736-461f-956a-29b585d0e31f for instance with vm_state building and task_state spawning.
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.compute.manager [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:28:47 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Instance spawned successfully.
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:28:47 user nova-compute[74630]: INFO nova.compute.manager [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Took 14.06 seconds to spawn the instance on the hypervisor.
Oct 26 03:28:47 user nova-compute[74630]: DEBUG nova.compute.manager [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:28:47 user nova-compute[74630]: INFO nova.compute.manager [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Took 142.38 seconds to build instance.
Oct 26 03:28:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a5ff1569-cb18-4721-abe4-92d2238a352e tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 142.588s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 138.310s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:47 user nova-compute[74630]: INFO nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 26 03:28:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:52 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:28:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:52 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:28:52 user nova-compute[74630]: INFO nova.compute.claims [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Claim successful on node user
Oct 26 03:28:53 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.689s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:28:53 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:28:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG nova.policy [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8694c5db6e34f1e88595b55f8e5fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e396316ddc243c594c29f5c434501cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:28:53 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Creating image(s)
Oct 26 03:28:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "/opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "/opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "/opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.237s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.222s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk 1073741824" returned: 0 in 0.154s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.384s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:54 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Successfully created port: a56ab20c-9890-481a-b7b0-e5a4ace45c39 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:28:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.206s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:54 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:28:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:28:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:28:54 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Cannot resize image /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:28:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:28:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Ensure instance console log exists: /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:28:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Successfully updated port: a56ab20c-9890-481a-b7b0-e5a4ace45c39 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "refresh_cache-73ac3b23-4f52-4107-989a-bcb38b9e0a00" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquired lock "refresh_cache-73ac3b23-4f52-4107-989a-bcb38b9e0a00" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-6e53c77b-dc80-46bd-a39e-777cc63c7532 req-7c21d9d3-25ac-4284-8ec0-f6a27e53d911 service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Received event network-changed-a56ab20c-9890-481a-b7b0-e5a4ace45c39 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-6e53c77b-dc80-46bd-a39e-777cc63c7532 req-7c21d9d3-25ac-4284-8ec0-f6a27e53d911 service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Refreshing instance network info cache due to event network-changed-a56ab20c-9890-481a-b7b0-e5a4ace45c39. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6e53c77b-dc80-46bd-a39e-777cc63c7532 req-7c21d9d3-25ac-4284-8ec0-f6a27e53d911 service nova] Acquiring lock "refresh_cache-73ac3b23-4f52-4107-989a-bcb38b9e0a00" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Updating instance_info_cache with network_info: [{"id": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "address": "fa:16:3e:e6:d9:ea", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ab20c-98", "ovs_interfaceid": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Releasing lock "refresh_cache-73ac3b23-4f52-4107-989a-bcb38b9e0a00" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Instance network_info: |[{"id": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "address": "fa:16:3e:e6:d9:ea", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ab20c-98", "ovs_interfaceid": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6e53c77b-dc80-46bd-a39e-777cc63c7532 req-7c21d9d3-25ac-4284-8ec0-f6a27e53d911 service nova] Acquired lock "refresh_cache-73ac3b23-4f52-4107-989a-bcb38b9e0a00" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.network.neutron [req-6e53c77b-dc80-46bd-a39e-777cc63c7532 req-7c21d9d3-25ac-4284-8ec0-f6a27e53d911 service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Refreshing network info cache for port a56ab20c-9890-481a-b7b0-e5a4ace45c39 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Start _get_guest_xml network_info=[{"id": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "address": "fa:16:3e:e6:d9:ea", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ab20c-98", "ovs_interfaceid": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:28:55 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:28:55 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1991759247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1991759247',id=22,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e396316ddc243c594c29f5c434501cb',ramdisk_id='',reservation_id='r-5uc73x9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:28:53Z,user_data=None,user_id='f8694c5db6e34f1e88595b55f8e5fe70',uuid=73ac3b23-4f52-4107-989a-bcb38b9e0a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "address": "fa:16:3e:e6:d9:ea", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ab20c-98", "ovs_interfaceid": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converting VIF {"id": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "address": "fa:16:3e:e6:d9:ea", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ab20c-98", "ovs_interfaceid": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:d9:ea,bridge_name='br-int',has_traffic_filtering=True,id=a56ab20c-9890-481a-b7b0-e5a4ace45c39,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56ab20c-98') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.objects.instance [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'pci_devices' on Instance uuid 73ac3b23-4f52-4107-989a-bcb38b9e0a00 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:28:55 user nova-compute[74630]:   <uuid>73ac3b23-4f52-4107-989a-bcb38b9e0a00</uuid>
Oct 26 03:28:55 user nova-compute[74630]:   <name>instance-00000016</name>
Oct 26 03:28:55 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:28:55 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:28:55 user nova-compute[74630]:   <metadata>
Oct 26 03:28:55 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:28:55 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:28:55 user nova-compute[74630]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1991759247</nova:name>
Oct 26 03:28:55 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:28:55</nova:creationTime>
Oct 26 03:28:55 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:28:55 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:28:55 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:28:55 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:28:55 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:28:55 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:28:55 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:28:55 user nova-compute[74630]:       <nova:owner>
Oct 26 03:28:55 user nova-compute[74630]:         <nova:user uuid="f8694c5db6e34f1e88595b55f8e5fe70">tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member</nova:user>
Oct 26 03:28:55 user nova-compute[74630]:         <nova:project uuid="1e396316ddc243c594c29f5c434501cb">tempest-ServerBootFromVolumeStableRescueTest-1296515996</nova:project>
Oct 26 03:28:55 user nova-compute[74630]:       </nova:owner>
Oct 26 03:28:55 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:28:55 user nova-compute[74630]:       <nova:ports>
Oct 26 03:28:55 user nova-compute[74630]:         <nova:port uuid="a56ab20c-9890-481a-b7b0-e5a4ace45c39">
Oct 26 03:28:55 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 03:28:55 user nova-compute[74630]:         </nova:port>
Oct 26 03:28:55 user nova-compute[74630]:       </nova:ports>
Oct 26 03:28:55 user nova-compute[74630]:     </nova:instance>
Oct 26 03:28:55 user nova-compute[74630]:   </metadata>
Oct 26 03:28:55 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:28:55 user nova-compute[74630]:     <system>
Oct 26 03:28:55 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:28:55 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:28:55 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:28:55 user nova-compute[74630]:       <entry name="serial">73ac3b23-4f52-4107-989a-bcb38b9e0a00</entry>
Oct 26 03:28:55 user nova-compute[74630]:       <entry name="uuid">73ac3b23-4f52-4107-989a-bcb38b9e0a00</entry>
Oct 26 03:28:55 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:28:55 user nova-compute[74630]:     </system>
Oct 26 03:28:55 user nova-compute[74630]:   </sysinfo>
Oct 26 03:28:55 user nova-compute[74630]:   <os>
Oct 26 03:28:55 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:28:55 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:28:55 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:28:55 user nova-compute[74630]:   </os>
Oct 26 03:28:55 user nova-compute[74630]:   <features>
Oct 26 03:28:55 user nova-compute[74630]:     <acpi/>
Oct 26 03:28:55 user nova-compute[74630]:     <apic/>
Oct 26 03:28:55 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:28:55 user nova-compute[74630]:   </features>
Oct 26 03:28:55 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:28:55 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:28:55 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:28:55 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:28:55 user nova-compute[74630]:   </clock>
Oct 26 03:28:55 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:28:55 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:28:55 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:28:55 user nova-compute[74630]:   </cpu>
Oct 26 03:28:55 user nova-compute[74630]:   <devices>
Oct 26 03:28:55 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:28:55 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:28:55 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk"/>
Oct 26 03:28:55 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:28:55 user nova-compute[74630]:     </disk>
Oct 26 03:28:55 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:28:55 user nova-compute[74630]:       <mac address="fa:16:3e:e6:d9:ea"/>
Oct 26 03:28:55 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:28:55 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:28:55 user nova-compute[74630]:       <target dev="tapa56ab20c-98"/>
Oct 26 03:28:55 user nova-compute[74630]:     </interface>
Oct 26 03:28:55 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:28:55 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/console.log" append="off"/>
Oct 26 03:28:55 user nova-compute[74630]:     </serial>
Oct 26 03:28:55 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:28:55 user nova-compute[74630]:     <video>
Oct 26 03:28:55 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:28:55 user nova-compute[74630]:     </video>
Oct 26 03:28:55 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:28:55 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:28:55 user nova-compute[74630]:     </rng>
Oct 26 03:28:55 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:28:55 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:28:55 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:28:55 user nova-compute[74630]:     </memballoon>
Oct 26 03:28:55 user nova-compute[74630]:   </devices>
Oct 26 03:28:55 user nova-compute[74630]: </domain>
Oct 26 03:28:55 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1991759247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1991759247',id=22,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e396316ddc243c594c29f5c434501cb',ramdisk_id='',reservation_id='r-5uc73x9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:28:53Z,user_data=None,user_id='f8694c5db6e34f1e88595b55f8e5fe70',uuid=73ac3b23-4f52-4107-989a-bcb38b9e0a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "address": "fa:16:3e:e6:d9:ea", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ab20c-98", "ovs_interfaceid": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converting VIF {"id": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "address": "fa:16:3e:e6:d9:ea", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ab20c-98", "ovs_interfaceid": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:d9:ea,bridge_name='br-int',has_traffic_filtering=True,id=a56ab20c-9890-481a-b7b0-e5a4ace45c39,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56ab20c-98') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG os_vif [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:d9:ea,bridge_name='br-int',has_traffic_filtering=True,id=a56ab20c-9890-481a-b7b0-e5a4ace45c39,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56ab20c-98') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6edfb52-40b1-5c97-863c-0a4c88b878be', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa56ab20c-98, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa56ab20c-98, col_values=(('qos', UUID('135a4907-f819-4c0e-ad14-462c0fdd3808')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa56ab20c-98, col_values=(('external_ids', {'iface-id': 'a56ab20c-9890-481a-b7b0-e5a4ace45c39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:d9:ea', 'vm-uuid': '73ac3b23-4f52-4107-989a-bcb38b9e0a00'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:55 user nova-compute[74630]: INFO os_vif [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:d9:ea,bridge_name='br-int',has_traffic_filtering=True,id=a56ab20c-9890-481a-b7b0-e5a4ace45c39,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56ab20c-98')
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:28:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] No VIF found with MAC fa:16:3e:e6:d9:ea, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:28:56 user nova-compute[74630]: DEBUG nova.network.neutron [req-6e53c77b-dc80-46bd-a39e-777cc63c7532 req-7c21d9d3-25ac-4284-8ec0-f6a27e53d911 service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Updated VIF entry in instance network info cache for port a56ab20c-9890-481a-b7b0-e5a4ace45c39. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:28:56 user nova-compute[74630]: DEBUG nova.network.neutron [req-6e53c77b-dc80-46bd-a39e-777cc63c7532 req-7c21d9d3-25ac-4284-8ec0-f6a27e53d911 service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Updating instance_info_cache with network_info: [{"id": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "address": "fa:16:3e:e6:d9:ea", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ab20c-98", "ovs_interfaceid": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:28:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6e53c77b-dc80-46bd-a39e-777cc63c7532 req-7c21d9d3-25ac-4284-8ec0-f6a27e53d911 service nova] Releasing lock "refresh_cache-73ac3b23-4f52-4107-989a-bcb38b9e0a00" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:28:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-49591445-d714-4ac1-a15c-8270826736fd req-b66b774d-b17b-4ade-b50b-4b48a65064c9 service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Received event network-vif-plugged-a56ab20c-9890-481a-b7b0-e5a4ace45c39 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:28:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-49591445-d714-4ac1-a15c-8270826736fd req-b66b774d-b17b-4ade-b50b-4b48a65064c9 service nova] Acquiring lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-49591445-d714-4ac1-a15c-8270826736fd req-b66b774d-b17b-4ade-b50b-4b48a65064c9 service nova] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-49591445-d714-4ac1-a15c-8270826736fd req-b66b774d-b17b-4ade-b50b-4b48a65064c9 service nova] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:28:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-49591445-d714-4ac1-a15c-8270826736fd req-b66b774d-b17b-4ade-b50b-4b48a65064c9 service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] No waiting events found dispatching network-vif-plugged-a56ab20c-9890-481a-b7b0-e5a4ace45c39 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:28:58 user nova-compute[74630]: WARNING nova.compute.manager [req-49591445-d714-4ac1-a15c-8270826736fd req-b66b774d-b17b-4ade-b50b-4b48a65064c9 service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Received unexpected event network-vif-plugged-a56ab20c-9890-481a-b7b0-e5a4ace45c39 for instance with vm_state building and task_state spawning.
Oct 26 03:28:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:28:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e748e6b1-72d5-4832-a992-32070d237064" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:28:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:28:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:28:59 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:28:59 user nova-compute[74630]: INFO nova.compute.claims [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Claim successful on node user
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-5f3f1aab-89a2-4291-9ad1-56f2dd1ccfe8 req-f8ac81dc-9849-40d0-b169-8a491b9e5709 service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Received event network-vif-plugged-a56ab20c-9890-481a-b7b0-e5a4ace45c39 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5f3f1aab-89a2-4291-9ad1-56f2dd1ccfe8 req-f8ac81dc-9849-40d0-b169-8a491b9e5709 service nova] Acquiring lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5f3f1aab-89a2-4291-9ad1-56f2dd1ccfe8 req-f8ac81dc-9849-40d0-b169-8a491b9e5709 service nova] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5f3f1aab-89a2-4291-9ad1-56f2dd1ccfe8 req-f8ac81dc-9849-40d0-b169-8a491b9e5709 service nova] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-5f3f1aab-89a2-4291-9ad1-56f2dd1ccfe8 req-f8ac81dc-9849-40d0-b169-8a491b9e5709 service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] No waiting events found dispatching network-vif-plugged-a56ab20c-9890-481a-b7b0-e5a4ace45c39 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:29:00 user nova-compute[74630]: WARNING nova.compute.manager [req-5f3f1aab-89a2-4291-9ad1-56f2dd1ccfe8 req-f8ac81dc-9849-40d0-b169-8a491b9e5709 service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Received unexpected event network-vif-plugged-a56ab20c-9890-481a-b7b0-e5a4ace45c39 for instance with vm_state building and task_state spawning.
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:29:00 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Instance spawned successfully.
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:29:00 user nova-compute[74630]: INFO nova.compute.manager [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Took 6.85 seconds to spawn the instance on the hypervisor.
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:29:00 user nova-compute[74630]: INFO nova.compute.manager [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Took 7.97 seconds to build instance.
Oct 26 03:29:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c912513-60a8-4aea-bec8-06be2b68a25c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.072s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:29:00 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.policy [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62370747d10a420b81009d23e3ba324b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b652c6f02780451b89d51d74178bf6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:29:00 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Creating image(s)
Oct 26 03:29:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "/opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "/opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "/opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.197s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.289s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk 1073741824" returned: 0 in 0.074s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.376s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Successfully created port: b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.233s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Cannot resize image /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Ensure instance console log exists: /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Successfully updated port: b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquired lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-52760ab0-e0a5-46f3-b806-9d9f4f896a7e req-823b7d52-df42-4f2e-914b-162530a1a004 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-changed-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-52760ab0-e0a5-46f3-b806-9d9f4f896a7e req-823b7d52-df42-4f2e-914b-162530a1a004 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Refreshing instance network info cache due to event network-changed-b75891ea-8201-4c0f-a203-ef383b64938b. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-52760ab0-e0a5-46f3-b806-9d9f4f896a7e req-823b7d52-df42-4f2e-914b-162530a1a004 service nova] Acquiring lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Updating instance_info_cache with network_info: [{"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Releasing lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Instance network_info: |[{"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-52760ab0-e0a5-46f3-b806-9d9f4f896a7e req-823b7d52-df42-4f2e-914b-162530a1a004 service nova] Acquired lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.network.neutron [req-52760ab0-e0a5-46f3-b806-9d9f4f896a7e req-823b7d52-df42-4f2e-914b-162530a1a004 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Refreshing network info cache for port b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Start _get_guest_xml network_info=[{"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:29:02 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:29:02 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:28:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-669113886',display_name='tempest-ServerRescueNegativeTestJSON-server-669113886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-669113886',id=23,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ7A+Oi05puuZCxjb1Gla62sCt0xlDzLUfOfZl8W878tAr590CUZ83zWNmE3vYrqMx0mj979VdjN3SFmuveJm926K5vLb2t3sO8Srwh2TvxN2SxREaL3Mizqc4rUoferw==',key_name='tempest-keypair-894050888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b652c6f02780451b89d51d74178bf6c7',ramdisk_id='',reservation_id='r-dp6pivuc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2117587238',owner_user_name='tempest-ServerRescueNegativeTestJSON-2117587238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:29:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62370747d10a420b81009d23e3ba324b',uuid=e748e6b1-72d5-4832-a992-32070d237064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converting VIF {"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:af:55,bridge_name='br-int',has_traffic_filtering=True,id=b75891ea-8201-4c0f-a203-ef383b64938b,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb75891ea-82') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.objects.instance [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'pci_devices' on Instance uuid e748e6b1-72d5-4832-a992-32070d237064 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:29:02 user nova-compute[74630]:   <uuid>e748e6b1-72d5-4832-a992-32070d237064</uuid>
Oct 26 03:29:02 user nova-compute[74630]:   <name>instance-00000017</name>
Oct 26 03:29:02 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:29:02 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:29:02 user nova-compute[74630]:   <metadata>
Oct 26 03:29:02 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:29:02 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:29:02 user nova-compute[74630]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-669113886</nova:name>
Oct 26 03:29:02 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:29:02</nova:creationTime>
Oct 26 03:29:02 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:29:02 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:29:02 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:29:02 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:29:02 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:29:02 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:29:02 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:29:02 user nova-compute[74630]:       <nova:owner>
Oct 26 03:29:02 user nova-compute[74630]:         <nova:user uuid="62370747d10a420b81009d23e3ba324b">tempest-ServerRescueNegativeTestJSON-2117587238-project-member</nova:user>
Oct 26 03:29:02 user nova-compute[74630]:         <nova:project uuid="b652c6f02780451b89d51d74178bf6c7">tempest-ServerRescueNegativeTestJSON-2117587238</nova:project>
Oct 26 03:29:02 user nova-compute[74630]:       </nova:owner>
Oct 26 03:29:02 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:29:02 user nova-compute[74630]:       <nova:ports>
Oct 26 03:29:02 user nova-compute[74630]:         <nova:port uuid="b75891ea-8201-4c0f-a203-ef383b64938b">
Oct 26 03:29:02 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 03:29:02 user nova-compute[74630]:         </nova:port>
Oct 26 03:29:02 user nova-compute[74630]:       </nova:ports>
Oct 26 03:29:02 user nova-compute[74630]:     </nova:instance>
Oct 26 03:29:02 user nova-compute[74630]:   </metadata>
Oct 26 03:29:02 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:29:02 user nova-compute[74630]:     <system>
Oct 26 03:29:02 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:29:02 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:29:02 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:29:02 user nova-compute[74630]:       <entry name="serial">e748e6b1-72d5-4832-a992-32070d237064</entry>
Oct 26 03:29:02 user nova-compute[74630]:       <entry name="uuid">e748e6b1-72d5-4832-a992-32070d237064</entry>
Oct 26 03:29:02 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:29:02 user nova-compute[74630]:     </system>
Oct 26 03:29:02 user nova-compute[74630]:   </sysinfo>
Oct 26 03:29:02 user nova-compute[74630]:   <os>
Oct 26 03:29:02 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:29:02 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:29:02 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:29:02 user nova-compute[74630]:   </os>
Oct 26 03:29:02 user nova-compute[74630]:   <features>
Oct 26 03:29:02 user nova-compute[74630]:     <acpi/>
Oct 26 03:29:02 user nova-compute[74630]:     <apic/>
Oct 26 03:29:02 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:29:02 user nova-compute[74630]:   </features>
Oct 26 03:29:02 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:29:02 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:29:02 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:29:02 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:29:02 user nova-compute[74630]:   </clock>
Oct 26 03:29:02 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:29:02 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:29:02 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:29:02 user nova-compute[74630]:   </cpu>
Oct 26 03:29:02 user nova-compute[74630]:   <devices>
Oct 26 03:29:02 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:29:02 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:29:02 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk"/>
Oct 26 03:29:02 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:29:02 user nova-compute[74630]:     </disk>
Oct 26 03:29:02 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:29:02 user nova-compute[74630]:       <mac address="fa:16:3e:80:af:55"/>
Oct 26 03:29:02 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:29:02 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:29:02 user nova-compute[74630]:       <target dev="tapb75891ea-82"/>
Oct 26 03:29:02 user nova-compute[74630]:     </interface>
Oct 26 03:29:02 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:29:02 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/console.log" append="off"/>
Oct 26 03:29:02 user nova-compute[74630]:     </serial>
Oct 26 03:29:02 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:29:02 user nova-compute[74630]:     <video>
Oct 26 03:29:02 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:29:02 user nova-compute[74630]:     </video>
Oct 26 03:29:02 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:29:02 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:29:02 user nova-compute[74630]:     </rng>
Oct 26 03:29:02 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:29:02 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:29:02 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:29:02 user nova-compute[74630]:     </memballoon>
Oct 26 03:29:02 user nova-compute[74630]:   </devices>
Oct 26 03:29:02 user nova-compute[74630]: </domain>
Oct 26 03:29:02 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:28:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-669113886',display_name='tempest-ServerRescueNegativeTestJSON-server-669113886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-669113886',id=23,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ7A+Oi05puuZCxjb1Gla62sCt0xlDzLUfOfZl8W878tAr590CUZ83zWNmE3vYrqMx0mj979VdjN3SFmuveJm926K5vLb2t3sO8Srwh2TvxN2SxREaL3Mizqc4rUoferw==',key_name='tempest-keypair-894050888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b652c6f02780451b89d51d74178bf6c7',ramdisk_id='',reservation_id='r-dp6pivuc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2117587238',owner_user_name='tempest-ServerRescueNegativeTestJSON-2117587238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:29:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62370747d10a420b81009d23e3ba324b',uuid=e748e6b1-72d5-4832-a992-32070d237064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converting VIF {"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:af:55,bridge_name='br-int',has_traffic_filtering=True,id=b75891ea-8201-4c0f-a203-ef383b64938b,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb75891ea-82') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG os_vif [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:af:55,bridge_name='br-int',has_traffic_filtering=True,id=b75891ea-8201-4c0f-a203-ef383b64938b,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb75891ea-82') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcce512b-5823-5f83-8726-706b9eaa8b8d', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb75891ea-82, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb75891ea-82, col_values=(('qos', UUID('a5b7013c-b6ba-4cb0-8f13-b733189ef2f3')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb75891ea-82, col_values=(('external_ids', {'iface-id': 'b75891ea-8201-4c0f-a203-ef383b64938b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:af:55', 'vm-uuid': 'e748e6b1-72d5-4832-a992-32070d237064'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:02 user nova-compute[74630]: INFO os_vif [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:af:55,bridge_name='br-int',has_traffic_filtering=True,id=b75891ea-8201-4c0f-a203-ef383b64938b,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb75891ea-82')
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:29:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No VIF found with MAC fa:16:3e:80:af:55, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:29:03 user nova-compute[74630]: DEBUG nova.network.neutron [req-52760ab0-e0a5-46f3-b806-9d9f4f896a7e req-823b7d52-df42-4f2e-914b-162530a1a004 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Updated VIF entry in instance network info cache for port b75891ea-8201-4c0f-a203-ef383b64938b. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:29:03 user nova-compute[74630]: DEBUG nova.network.neutron [req-52760ab0-e0a5-46f3-b806-9d9f4f896a7e req-823b7d52-df42-4f2e-914b-162530a1a004 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Updating instance_info_cache with network_info: [{"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:29:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-52760ab0-e0a5-46f3-b806-9d9f4f896a7e req-823b7d52-df42-4f2e-914b-162530a1a004 service nova] Releasing lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:29:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-b3d0d91b-43d6-4d57-8bd1-5dbaca3ba1af req-fb25769b-4dd8-463d-8272-a14b3a6db2e2 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b3d0d91b-43d6-4d57-8bd1-5dbaca3ba1af req-fb25769b-4dd8-463d-8272-a14b3a6db2e2 service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b3d0d91b-43d6-4d57-8bd1-5dbaca3ba1af req-fb25769b-4dd8-463d-8272-a14b3a6db2e2 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b3d0d91b-43d6-4d57-8bd1-5dbaca3ba1af req-fb25769b-4dd8-463d-8272-a14b3a6db2e2 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-b3d0d91b-43d6-4d57-8bd1-5dbaca3ba1af req-fb25769b-4dd8-463d-8272-a14b3a6db2e2 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:29:05 user nova-compute[74630]: WARNING nova.compute.manager [req-b3d0d91b-43d6-4d57-8bd1-5dbaca3ba1af req-fb25769b-4dd8-463d-8272-a14b3a6db2e2 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state building and task_state spawning.
Oct 26 03:29:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:29:07 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: e748e6b1-72d5-4832-a992-32070d237064] Instance spawned successfully.
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-227b9719-c6ae-424a-836c-c120ef7277fc req-444d071d-2f85-4286-a817-74932c277808 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received event network-changed-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-227b9719-c6ae-424a-836c-c120ef7277fc req-444d071d-2f85-4286-a817-74932c277808 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Refreshing instance network info cache due to event network-changed-3918526e-3b7f-40b0-a4fa-e3960470392b. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-227b9719-c6ae-424a-836c-c120ef7277fc req-444d071d-2f85-4286-a817-74932c277808 service nova] Acquiring lock "refresh_cache-90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-227b9719-c6ae-424a-836c-c120ef7277fc req-444d071d-2f85-4286-a817-74932c277808 service nova] Acquired lock "refresh_cache-90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.network.neutron [req-227b9719-c6ae-424a-836c-c120ef7277fc req-444d071d-2f85-4286-a817-74932c277808 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Refreshing network info cache for port 3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:29:07 user nova-compute[74630]: INFO nova.compute.manager [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Took 6.36 seconds to spawn the instance on the hypervisor.
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-c6f5c482-1891-4228-93c5-5307fcc67882 req-f6af7839-4bd2-4049-94ec-019a2413d0cd service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c6f5c482-1891-4228-93c5-5307fcc67882 req-f6af7839-4bd2-4049-94ec-019a2413d0cd service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c6f5c482-1891-4228-93c5-5307fcc67882 req-f6af7839-4bd2-4049-94ec-019a2413d0cd service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c6f5c482-1891-4228-93c5-5307fcc67882 req-f6af7839-4bd2-4049-94ec-019a2413d0cd service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-c6f5c482-1891-4228-93c5-5307fcc67882 req-f6af7839-4bd2-4049-94ec-019a2413d0cd service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:29:07 user nova-compute[74630]: WARNING nova.compute.manager [req-c6f5c482-1891-4228-93c5-5307fcc67882 req-f6af7839-4bd2-4049-94ec-019a2413d0cd service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state building and task_state spawning.
Oct 26 03:29:07 user nova-compute[74630]: INFO nova.compute.manager [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Took 7.40 seconds to build instance.
Oct 26 03:29:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4475dd4d-1783-418f-ae1b-3b5fb2d951eb tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e748e6b1-72d5-4832-a992-32070d237064" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.535s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.network.neutron [req-227b9719-c6ae-424a-836c-c120ef7277fc req-444d071d-2f85-4286-a817-74932c277808 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Updated VIF entry in instance network info cache for port 3918526e-3b7f-40b0-a4fa-e3960470392b. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG nova.network.neutron [req-227b9719-c6ae-424a-836c-c120ef7277fc req-444d071d-2f85-4286-a817-74932c277808 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Updating instance_info_cache with network_info: [{"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:29:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-227b9719-c6ae-424a-836c-c120ef7277fc req-444d071d-2f85-4286-a817-74932c277808 service nova] Releasing lock "refresh_cache-90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAgpUSMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7576bf64-216a-4d1a-88a2-b90468e61515', 'attached_at': '', 'detached_at': '', 'volume_id': '1dc98834-709f-46e3-8e76-06da464f1086', 'serial': '1dc98834-709f-46e3-8e76-06da464f1086'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HokzwZVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '7576bf64-216a-4d1a-88a2-b90468e61515', 'attached_at': '', 'detached_at': '', 'volume_id': '70059a1a-e77c-467d-885b-6a7378b50c25', 'serial'} {{(pid=74630) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAgpUSMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:29:08 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:29:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:29:08 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:29:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:29:08 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d96bd5-1af2-42a5-b0e6-0677c0f9dbd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:29:08 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.043s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[62732a3e-10af-4864-b02c-c28d20b61789]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086] added
Oct 26 03:29:08 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:08 user nova-compute[74630]: INFO nova.compute.manager [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Rebuilding instance
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.081s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3151a6-6245-49c1-a5a5-f785d7ae685e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb40148-6913-497f-9408-9f5ff4f1c40b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PAgpUSMn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PAgpUSMn" returned: 0 in 0.042s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed7f801-20d6-441e-843c-50a9f60f792b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PAgpUSMn'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.050s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a704799-3ea8-47bb-ab13-f37199ef1c17]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6b020a-3c92-4bd7-bda7-6467afcaafbb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:08 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:08 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:08 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --login" returned: 0 in 0.139s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[613f18d7-6ff4-4425-a9f4-77e6f6a26c23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086, portal: 172.16.0.220,3260]
Oct 26 03:29:08 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086, portal: 172.16.0.220,3260] successful.
Oct 26 03:29:08 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.055s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[28845bf2-4dfe-49fc-ae46-8c712fba8c8c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[988bef26-5b11-45f3-ba21-0cef1f1fdde6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)
Oct 26 03:29:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.646s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] HCTL ('42', '-', '-', 0) found on session 22 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e76ab43-9996-4617-aa74-ea20e8bf49e8]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Searching for a device in session 22 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAgpUSMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-578b7d35-9a56-4528-94f9-1ed1c3c84eeb req-eb6eca04-7b32-42ce-af4a-1ca5ad02301b service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received event network-vif-unplugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-578b7d35-9a56-4528-94f9-1ed1c3c84eeb req-eb6eca04-7b32-42ce-af4a-1ca5ad02301b service nova] Acquiring lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-578b7d35-9a56-4528-94f9-1ed1c3c84eeb req-eb6eca04-7b32-42ce-af4a-1ca5ad02301b service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-578b7d35-9a56-4528-94f9-1ed1c3c84eeb req-eb6eca04-7b32-42ce-af4a-1ca5ad02301b service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-578b7d35-9a56-4528-94f9-1ed1c3c84eeb req-eb6eca04-7b32-42ce-af4a-1ca5ad02301b service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] No waiting events found dispatching network-vif-unplugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:29:09 user nova-compute[74630]: WARNING nova.compute.manager [req-578b7d35-9a56-4528-94f9-1ed1c3c84eeb req-eb6eca04-7b32-42ce-af4a-1ca5ad02301b service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received unexpected event network-vif-unplugged-3918526e-3b7f-40b0-a4fa-e3960470392b for instance with vm_state active and task_state rebuilding.
Oct 26 03:29:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Instance destroyed successfully.
Oct 26 03:29:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Instance destroyed successfully.
Oct 26 03:29:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:26:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-593771189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-415578365',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJud6mpHVea5l3TmFMj7TUo36YSkBpoQyMbTjtpYD/dGU90azzgcRr8MHCroAaS2zs20gbK6yileVVDApGs2uHRxNL2W5M/4qgb3zIJ0sK0u5dluv9CMLCmmumrj5e/PUA==',key_name='tempest-keypair-1033500048',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9079bef72e74a65956113a03d158599',ramdisk_id='',reservation_id='r-ye3e7o2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-310127885',owner_user_name='tempest-ServerActionsV293TestJSON-310127885-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:29:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61f0a167683a42fcacac8fd8532812ba',uuid=90dc2dc2-0ea2-4a8c-b4c9-794523df32f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Converting VIF {"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:dc:ae,bridge_name='br-int',has_traffic_filtering=True,id=3918526e-3b7f-40b0-a4fa-e3960470392b,network=Network(9282a8c0-6bcd-433f-a357-1c399e425972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3918526e-3b') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG os_vif [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:dc:ae,bridge_name='br-int',has_traffic_filtering=True,id=3918526e-3b7f-40b0-a4fa-e3960470392b,network=Network(9282a8c0-6bcd-433f-a357-1c399e425972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3918526e-3b') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3918526e-3b, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8b9b205-bd90-42b7-b571-83e229df84c9) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:09 user nova-compute[74630]: INFO os_vif [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:dc:ae,bridge_name='br-int',has_traffic_filtering=True,id=3918526e-3b7f-40b0-a4fa-e3960470392b,network=Network(9282a8c0-6bcd-433f-a357-1c399e425972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3918526e-3b')
Oct 26 03:29:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:29:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxqRWiIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:29:09 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 03:29:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.701s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] <== connect_volume: return (1702ms) {'type': 'block', 'scsi_wwn': '23662613463353039', 'path': '/dev/sdk'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662613463353039', 'path': '/dev/sdk'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.406s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG nova.objects.instance [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lazy-loading 'flavor' on Instance uuid 7576bf64-216a-4d1a-88a2-b90468e61515 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ddce05-b092-416b-9dbc-92cf60a4cdeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:29:10 user nova-compute[74630]: No targets found.
Oct 26 03:29:10 user nova-compute[74630]: iSNS:
Oct 26 03:29:10 user nova-compute[74630]: No targets found.
Oct 26 03:29:10 user nova-compute[74630]: STATIC:
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: FIRMWARE:
Oct 26 03:29:10 user nova-compute[74630]: No targets found.
Oct 26 03:29:10 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:29:10 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:29:10 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f6ab8c-4d59-4a3e-b070-32b22e3a0afa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8dc933-c531-4feb-811b-0c3e8c01ecc2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c1cb760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550'): ({'sdc'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Removing single pathed devices sdc {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16a6b97-3ad2-4752-a6fe-e2b14c80bdb4]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87b3f6c-84f6-40bf-a0d9-c490ccbd7921]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Flushing IO for device /dev/sdc {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8e1b7d-5e3b-4479-9a49-e094fc9e23dd]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.065s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab2b636-af79-47ea-94b8-f515448b8f13]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25eb942-4b9b-451d-8a03-98c41f215bea]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ff1f60-f520-4f53-8017-a043e412aee2]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260]
Oct 26 03:29:10 user nova-compute[74630]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260] successful.
Oct 26 03:29:10 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a3c50c-b741-47ee-ad57-87bd4db2e1c9]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] <== disconnect_volume: return (841ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:29:10 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Deleting instance files /opt/stack/data/nova/instances/90dc2dc2-0ea2-4a8c-b4c9-794523df32f0_del
Oct 26 03:29:10 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Deletion of /opt/stack/data/nova/instances/90dc2dc2-0ea2-4a8c-b4c9-794523df32f0_del complete
Oct 26 03:29:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:10 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0 could not be found.
Oct 26 03:29:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxqRWiIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:29:10 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef13008-f9aa-4764-ab7d-473bcbc0e853]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:29:10 user nova-compute[74630]: No targets found.
Oct 26 03:29:10 user nova-compute[74630]: iSNS:
Oct 26 03:29:10 user nova-compute[74630]: No targets found.
Oct 26 03:29:10 user nova-compute[74630]: STATIC:
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086
Oct 26 03:29:10 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:10 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:10 user nova-compute[74630]: FIRMWARE:
Oct 26 03:29:10 user nova-compute[74630]: No targets found.
Oct 26 03:29:10 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:29:10 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:29:10 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a922adfc-38af-4b5f-9627-22e13b807ca5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[653b6aa5-d318-4aff-902f-48b909478986]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)
Oct 26 03:29:10 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c1c8550>, {}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Disconnecting from: [] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.140s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] <== disconnect_volume: return (141ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:29:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:29:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 99614720 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-5f7daafb-53da-493e-9ece-3f7e8db9299e req-d6d91827-2d00-4720-b9a5-4b18212d0825 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received event network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5f7daafb-53da-493e-9ece-3f7e8db9299e req-d6d91827-2d00-4720-b9a5-4b18212d0825 service nova] Acquiring lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5f7daafb-53da-493e-9ece-3f7e8db9299e req-d6d91827-2d00-4720-b9a5-4b18212d0825 service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5f7daafb-53da-493e-9ece-3f7e8db9299e req-d6d91827-2d00-4720-b9a5-4b18212d0825 service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-5f7daafb-53da-493e-9ece-3f7e8db9299e req-d6d91827-2d00-4720-b9a5-4b18212d0825 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] No waiting events found dispatching network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:29:11 user nova-compute[74630]: WARNING nova.compute.manager [req-5f7daafb-53da-493e-9ece-3f7e8db9299e req-d6d91827-2d00-4720-b9a5-4b18212d0825 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received unexpected event network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b for instance with vm_state active and task_state rebuilding.
Oct 26 03:29:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 247463936 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 412090368 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 501219328 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 640679936 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 763363328 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 924844032 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HokzwZVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:29:14 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:29:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[be07ef94-f6db-4c30-8cdb-c200db37fbf2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:29:14 user nova-compute[74630]: No targets found.
Oct 26 03:29:14 user nova-compute[74630]: iSNS:
Oct 26 03:29:14 user nova-compute[74630]: No targets found.
Oct 26 03:29:14 user nova-compute[74630]: STATIC:
Oct 26 03:29:14 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:29:14 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:14 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:14 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677
Oct 26 03:29:14 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:14 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:14 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665
Oct 26 03:29:14 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:14 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:14 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719
Oct 26 03:29:14 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:14 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:14 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:29:14 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:14 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:14 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25
Oct 26 03:29:14 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:14 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:14 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6
Oct 26 03:29:14 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:14 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:14 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed
Oct 26 03:29:14 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:14 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:14 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086
Oct 26 03:29:14 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:14 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:14 user nova-compute[74630]: FIRMWARE:
Oct 26 03:29:14 user nova-compute[74630]: No targets found.
Oct 26 03:29:14 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:29:14 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:29:14 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f26eae-e9ac-48ef-bee2-ba097763cc4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c60c738-5f62-480f-bcab-fbef706615da]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)
Oct 26 03:29:14 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:14 user nova-compute[74630]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)
Oct 26 03:29:14 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f318464c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25'): ({'sdf'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Removing single pathed devices sdf {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:29:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71a9397-7ffc-4c4a-b943-4a6084f5779a]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5661ff91-a6cf-47d5-9e8a-a777f0c0767e]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Flushing IO for device /dev/sdf {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e740e3-a182-4c20-9fef-17263d0f8f37]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7010e26-301a-4a79-87cf-737000de9b76]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] SCSI volumes sdf have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[da91d4f0-5c7e-4f6e-bc50-b2d65f30e29b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.133s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b311cf-8651-48e8-89c0-35a0b9373c52]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260]
Oct 26 03:29:15 user nova-compute[74630]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260] successful.
Oct 26 03:29:15 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afad506-67d6-4cf8-9bf5-de7d08b5b79d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] <== disconnect_volume: return (434ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAgpUSMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '7576bf64-216a-4d1a-88a2-b90468e61515', 'attached_at': '', 'detached_at': '', 'volume_id': '1dc98834-709f-46e3-8e76-06da464f1086', 'serial'} {{(pid=74630) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 26 03:29:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] swap_volume: removing Cinder connection for volume 70059a1a-e77c-467d-885b-6a7378b50c25 {{(pid=74630) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 26 03:29:16 user nova-compute[74630]: DEBUG nova.compute.manager [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] swap_volume: Updating volume 70059a1a-e77c-467d-885b-6a7378b50c25 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "PAgpUSMn", "auth_password": "2qySeU1VCROnhG", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "1dc98834-709f-46e3-8e76-06da464f1086"}, "status": "reserved", "instance": "7576bf64-216a-4d1a-88a2-b90468e61515", "attached_at": "", "detached_at": "", "volume_id": "1dc98834-709f-46e3-8e76-06da464f1086", "serial": "1dc98834-709f-46e3-8e76-06da464f1086"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '1dc98834-709f-46e3-8e76-06da464f1086', 'no_device': None, 'attachment_id': 'bb58f027-2e6e-4ed0-a989-e8b45c1c4e6e'} {{(pid=74630) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 26 03:29:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-33e4c620-6bf6-4ea7-929b-cd9dca7642e6 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 46.882s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Acquiring lock "7576bf64-216a-4d1a-88a2-b90468e61515" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG os_brick.utils [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ff097c-ea25-495c-b969-d8a5f6a9f87c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef4411e-8891-44bc-86f6-130f057c7635]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a54f4c4-689b-444a-882a-a3231dbae2a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f89abd7-fea1-4488-b5c9-255de9c4c4de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:29:17 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:29:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f828a2-62a9-4f2e-8a01-4483b4d8bdd4]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:29:17 user nova-compute[74630]: DEBUG os_brick.utils [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:29:18 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:29:18 user nova-compute[74630]: INFO nova.compute.manager [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Swapping volume 1dc98834-709f-46e3-8e76-06da464f1086 for 70059a1a-e77c-467d-885b-6a7378b50c25
Oct 26 03:29:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:29:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:29:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:29:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:29:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:29:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:29:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Preparing to wait for external event volume-reimaged-ba36f137-d667-483f-9b08-7b0193c3f550 {{(pid=74630) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 26 03:29:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:29:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:25 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:29:25 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=6847MB free_disk=25.168663024902344GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 747e596d-d9b3-4af2-be42-0fd494b6ef9a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f5441872-864e-44d9-8632-e05c5d71bd90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 65ff804f-8b98-406d-8c5c-3d73bb52ff18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 980e7a2f-b94d-4544-9e50-03f96fd376fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7576bf64-216a-4d1a-88a2-b90468e61515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance ab04a3a9-4a73-49d1-898a-547cb961e43f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance a7484e47-3d75-4913-970b-41f8ff66eb93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 73ac3b23-4f52-4107-989a-bcb38b9e0a00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e748e6b1-72d5-4832-a992-32070d237064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:29:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:29:26 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:29:26 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:29:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:29:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.872s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:29:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:29:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:29:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:29:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Acquiring lock "a7484e47-3d75-4913-970b-41f8ff66eb93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "a7484e47-3d75-4913-970b-41f8ff66eb93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Acquiring lock "a7484e47-3d75-4913-970b-41f8ff66eb93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "a7484e47-3d75-4913-970b-41f8ff66eb93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "a7484e47-3d75-4913-970b-41f8ff66eb93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:33 user nova-compute[74630]: INFO nova.compute.manager [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Terminating instance
Oct 26 03:29:33 user nova-compute[74630]: DEBUG nova.compute.manager [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:29:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-8720b3f8-24ea-4637-a819-57a01ca6441a req-7d425834-335e-4c66-9772-3148f29f4e50 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Received event network-vif-unplugged-d0ee15a8-0622-4c30-99fc-d18cc5d192cc {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8720b3f8-24ea-4637-a819-57a01ca6441a req-7d425834-335e-4c66-9772-3148f29f4e50 service nova] Acquiring lock "a7484e47-3d75-4913-970b-41f8ff66eb93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8720b3f8-24ea-4637-a819-57a01ca6441a req-7d425834-335e-4c66-9772-3148f29f4e50 service nova] Lock "a7484e47-3d75-4913-970b-41f8ff66eb93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8720b3f8-24ea-4637-a819-57a01ca6441a req-7d425834-335e-4c66-9772-3148f29f4e50 service nova] Lock "a7484e47-3d75-4913-970b-41f8ff66eb93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-8720b3f8-24ea-4637-a819-57a01ca6441a req-7d425834-335e-4c66-9772-3148f29f4e50 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] No waiting events found dispatching network-vif-unplugged-d0ee15a8-0622-4c30-99fc-d18cc5d192cc {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-8720b3f8-24ea-4637-a819-57a01ca6441a req-7d425834-335e-4c66-9772-3148f29f4e50 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Received event network-vif-unplugged-d0ee15a8-0622-4c30-99fc-d18cc5d192cc for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:29:34 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Instance destroyed successfully.
Oct 26 03:29:34 user nova-compute[74630]: DEBUG nova.objects.instance [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lazy-loading 'resources' on Instance uuid a7484e47-3d75-4913-970b-41f8ff66eb93 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:27:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2128438755',display_name='tempest-VolumesNegativeTest-instance-2128438755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2128438755',id=21,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:27:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6da1ec8d94f24b5a9e07f8836f228a83',ramdisk_id='',reservation_id='r-2kz96w6e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1151908457',owner_user_name='tempest-VolumesNegativeTest-1151908457-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:27:52Z,user_data=None,user_id='7616d76f2daa4aa8ab85e663b5a01e3c',uuid=a7484e47-3d75-4913-970b-41f8ff66eb93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "address": "fa:16:3e:96:ce:67", "network": {"id": "995297ce-f2c1-4f27-8a1a-1654ed656e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "353df6cf0134444f8bcf2604c1eceaa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ee15a8-06", "ovs_interfaceid": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Converting VIF {"id": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "address": "fa:16:3e:96:ce:67", "network": {"id": "995297ce-f2c1-4f27-8a1a-1654ed656e7b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "353df6cf0134444f8bcf2604c1eceaa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0ee15a8-06", "ovs_interfaceid": "d0ee15a8-0622-4c30-99fc-d18cc5d192cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:ce:67,bridge_name='br-int',has_traffic_filtering=True,id=d0ee15a8-0622-4c30-99fc-d18cc5d192cc,network=Network(995297ce-f2c1-4f27-8a1a-1654ed656e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ee15a8-06') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG os_vif [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ce:67,bridge_name='br-int',has_traffic_filtering=True,id=d0ee15a8-0622-4c30-99fc-d18cc5d192cc,network=Network(995297ce-f2c1-4f27-8a1a-1654ed656e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ee15a8-06') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0ee15a8-06, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ee72835-9f06-4d30-9179-c2012dd46bf3) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:34 user nova-compute[74630]: INFO os_vif [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:ce:67,bridge_name='br-int',has_traffic_filtering=True,id=d0ee15a8-0622-4c30-99fc-d18cc5d192cc,network=Network(995297ce-f2c1-4f27-8a1a-1654ed656e7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0ee15a8-06')
Oct 26 03:29:34 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Deleting instance files /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93_del
Oct 26 03:29:34 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Deletion of /opt/stack/data/nova/instances/a7484e47-3d75-4913-970b-41f8ff66eb93_del complete
Oct 26 03:29:34 user nova-compute[74630]: INFO nova.compute.manager [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 26 03:29:34 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:29:34 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:29:35 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:29:35 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Took 0.59 seconds to deallocate network for instance.
Oct 26 03:29:35 user nova-compute[74630]: DEBUG nova.compute.manager [req-4ee5898c-a773-4d69-a1f9-50ca261d3dfe req-465ef8a2-35f0-49d4-9dfd-6e691217d4b4 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Received event network-vif-deleted-d0ee15a8-0622-4c30-99fc-d18cc5d192cc {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:35 user nova-compute[74630]: INFO nova.compute.manager [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Detaching volume f24e78ee-fa99-4bfe-8a91-cbdf1f484719
Oct 26 03:29:35 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:29:35 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:29:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.590s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:35 user nova-compute[74630]: INFO nova.virt.block_device [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Attempting to driver detach volume f24e78ee-fa99-4bfe-8a91-cbdf1f484719 from mountpoint /dev/vdb
Oct 26 03:29:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:35 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Attempting to detach device vdb from instance 980e7a2f-b94d-4544-9e50-03f96fd376fe from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:29:35 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:29:35 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:29:35 user nova-compute[74630]:   <source dev="/dev/sde"/>
Oct 26 03:29:35 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:29:35 user nova-compute[74630]:   <serial>f24e78ee-fa99-4bfe-8a91-cbdf1f484719</serial>
Oct 26 03:29:35 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:29:35 user nova-compute[74630]: </disk>
Oct 26 03:29:35 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:29:35 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Successfully detached device vdb from instance 980e7a2f-b94d-4544-9e50-03f96fd376fe from the persistent domain config.
Oct 26 03:29:35 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 980e7a2f-b94d-4544-9e50-03f96fd376fe from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:29:35 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:29:35 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:29:35 user nova-compute[74630]:   <source dev="/dev/sde"/>
Oct 26 03:29:35 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:29:35 user nova-compute[74630]:   <serial>f24e78ee-fa99-4bfe-8a91-cbdf1f484719</serial>
Oct 26 03:29:35 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:29:35 user nova-compute[74630]: </disk>
Oct 26 03:29:35 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:29:35 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Deleted allocations for instance a7484e47-3d75-4913-970b-41f8ff66eb93
Oct 26 03:29:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1ba15ec3-5eb5-42ea-b366-3d625e23feaa tempest-VolumesNegativeTest-1151908457 tempest-VolumesNegativeTest-1151908457-project-member] Lock "a7484e47-3d75-4913-970b-41f8ff66eb93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.377s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:36 user nova-compute[74630]: DEBUG nova.compute.manager [req-f163b437-bad4-40af-a61f-f187c69f379d req-3739c412-206c-46cc-890c-4cf78a87a097 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Received event network-vif-plugged-d0ee15a8-0622-4c30-99fc-d18cc5d192cc {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f163b437-bad4-40af-a61f-f187c69f379d req-3739c412-206c-46cc-890c-4cf78a87a097 service nova] Acquiring lock "a7484e47-3d75-4913-970b-41f8ff66eb93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f163b437-bad4-40af-a61f-f187c69f379d req-3739c412-206c-46cc-890c-4cf78a87a097 service nova] Lock "a7484e47-3d75-4913-970b-41f8ff66eb93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f163b437-bad4-40af-a61f-f187c69f379d req-3739c412-206c-46cc-890c-4cf78a87a097 service nova] Lock "a7484e47-3d75-4913-970b-41f8ff66eb93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:36 user nova-compute[74630]: DEBUG nova.compute.manager [req-f163b437-bad4-40af-a61f-f187c69f379d req-3739c412-206c-46cc-890c-4cf78a87a097 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] No waiting events found dispatching network-vif-plugged-d0ee15a8-0622-4c30-99fc-d18cc5d192cc {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:29:36 user nova-compute[74630]: WARNING nova.compute.manager [req-f163b437-bad4-40af-a61f-f187c69f379d req-3739c412-206c-46cc-890c-4cf78a87a097 service nova] [instance: a7484e47-3d75-4913-970b-41f8ff66eb93] Received unexpected event network-vif-plugged-d0ee15a8-0622-4c30-99fc-d18cc5d192cc for instance with vm_state deleted and task_state None.
Oct 26 03:29:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 980e7a2f-b94d-4544-9e50-03f96fd376fe {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:29:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HokzwZVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7576bf64-216a-4d1a-88a2-b90468e61515', 'attached_at': '', 'detached_at': '', 'volume_id': '70059a1a-e77c-467d-885b-6a7378b50c25', 'serial': '70059a1a-e77c-467d-885b-6a7378b50c25'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAgpUSMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '1dc98834-709f-46e3-8e76-06da464f1086'}, 'status': 'reserved', 'instance': '7576bf64-216a-4d1a-88a2-b90468e61515', 'attached_at': '', 'detached_at': '', 'volume_id': '1dc98834-709f-46e3-8e76-06da464f1086', 'serial'} {{(pid=74630) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HokzwZVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:29:40 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:29:40 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:29:40 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[60acb858-27cb-4de0-87f5-fdbd5d7e0582]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:29:40 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f864d982-fc6d-4cf1-8673-2caa09360767]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25] added
Oct 26 03:29:40 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[accabc1d-6cb9-4538-bd22-33743e49487c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a6dc67-8b4a-4f5a-a11b-cd18aaee9b05]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HokzwZVL {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HokzwZVL" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ede6e27-9f52-4cc8-b342-e640f2061280]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HokzwZVL'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[991d1899-479a-47dd-a508-2da6de23b599]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f0a64a-d8ca-48bd-9ac8-b7bd182e0e39]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[524a4aff-20e9-420f-8865-a782214c0812]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260]
Oct 26 03:29:40 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260] successful.
Oct 26 03:29:40 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[72495139-e55d-4d73-b167-05cd70b691f6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c121657a-2245-4390-addd-dd4c18a4c31a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:40 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2840d40f-81e6-414c-81d1-be97e1b20f1f]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:40 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:29:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:29:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HokzwZVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:29:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:29:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23565353537386365', 'path': '/dev/sdc'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:29:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565353537386365', 'path': '/dev/sdc'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:29:41 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lazy-loading 'flavor' on Instance uuid 7576bf64-216a-4d1a-88a2-b90468e61515 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:29:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 149946368 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 262144000 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 407896064 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 562036736 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 682622976 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:29:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 787480576 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 932184064 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 1028653056 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAgpUSMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '1dc98834-709f-46e3-8e76-06da464f1086'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:29:46 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[103854b3-c4b2-4fea-a89f-3ad42686ebd7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:29:46 user nova-compute[74630]: No targets found.
Oct 26 03:29:46 user nova-compute[74630]: iSNS:
Oct 26 03:29:46 user nova-compute[74630]: No targets found.
Oct 26 03:29:46 user nova-compute[74630]: STATIC:
Oct 26 03:29:46 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:29:46 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:46 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:46 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677
Oct 26 03:29:46 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:46 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:46 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665
Oct 26 03:29:46 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:46 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:46 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719
Oct 26 03:29:46 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:46 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:46 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:29:46 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:46 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:46 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25
Oct 26 03:29:46 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:46 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:46 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6
Oct 26 03:29:46 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:46 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:46 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed
Oct 26 03:29:46 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:46 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:46 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086
Oct 26 03:29:46 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:46 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:46 user nova-compute[74630]: FIRMWARE:
Oct 26 03:29:46 user nova-compute[74630]: No targets found.
Oct 26 03:29:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:29:46 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:29:46 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0188ba82-f556-46dd-9603-55d7292c25bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a351355-6d27-4b52-b2b2-ed312daaecf5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 (non-flash)
Oct 26 03:29:46 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3184f3d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086'): ({'sdk'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Removing single pathed devices sdk {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3363142d-6b68-4fa0-95f5-2941d1eb63c1]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c514ce3-4ae4-46f3-91ee-eb3334de8360]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Flushing IO for device /dev/sdk {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[175a14a3-e7ee-480c-b246-07dc63254cf5]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.041s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f614e9-52e2-434a-b945-365588485ca9]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] SCSI volumes sdk have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc305b8-4d99-4edf-9227-96ef472cc496]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50da89b-9f52-4f2e-97af-4ae1685ace51]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086, portal: 172.16.0.220,3260]
Oct 26 03:29:46 user nova-compute[74630]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086, portal: 172.16.0.220,3260] successful.
Oct 26 03:29:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc98834-709f-46e3-8e76-06da464f1086 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2238816-92ea-4fa0-8333-5b3551313de8]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:29:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] <== disconnect_volume: return (393ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:29:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:29:47 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HokzwZVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7576bf64-216a-4d1a-88a2-b90468e61515', 'attached_at': '', 'detached_at': '', 'volume_id': '70059a1a-e77c-467d-885b-6a7378b50c25', 'serial'} {{(pid=74630) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 26 03:29:47 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] swap_volume: removing Cinder connection for volume 1dc98834-709f-46e3-8e76-06da464f1086 {{(pid=74630) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 26 03:29:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] swap_volume: Updating volume 1dc98834-709f-46e3-8e76-06da464f1086 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "HokzwZVL", "auth_password": "iqgmHnFrXSPBMl", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "70059a1a-e77c-467d-885b-6a7378b50c25"}, "status": "reserved", "instance": "7576bf64-216a-4d1a-88a2-b90468e61515", "attached_at": "", "detached_at": "", "volume_id": "70059a1a-e77c-467d-885b-6a7378b50c25", "serial": "70059a1a-e77c-467d-885b-6a7378b50c25"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '70059a1a-e77c-467d-885b-6a7378b50c25', 'no_device': None, 'attachment_id': '9094a73a-e8d3-4fa0-b77f-630531d37418'} {{(pid=74630) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef013652-ab23-45b0-ac92-59ca87b8afc3 tempest-TestVolumeSwap-467092558 tempest-TestVolumeSwap-467092558-project-admin] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 32.791s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:50 user nova-compute[74630]: INFO nova.compute.manager [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Terminating instance
Oct 26 03:29:50 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-63494459-6911-47c9-b324-c98111d6dd61 req-ac174f7c-85a3-479f-94c8-8cc39dbcf130 service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Received event network-vif-unplugged-bea61e08-ab64-488a-bd39-88fd0649d434 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-63494459-6911-47c9-b324-c98111d6dd61 req-ac174f7c-85a3-479f-94c8-8cc39dbcf130 service nova] Acquiring lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-63494459-6911-47c9-b324-c98111d6dd61 req-ac174f7c-85a3-479f-94c8-8cc39dbcf130 service nova] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-63494459-6911-47c9-b324-c98111d6dd61 req-ac174f7c-85a3-479f-94c8-8cc39dbcf130 service nova] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-63494459-6911-47c9-b324-c98111d6dd61 req-ac174f7c-85a3-479f-94c8-8cc39dbcf130 service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] No waiting events found dispatching network-vif-unplugged-bea61e08-ab64-488a-bd39-88fd0649d434 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:29:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-63494459-6911-47c9-b324-c98111d6dd61 req-ac174f7c-85a3-479f-94c8-8cc39dbcf130 service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Received event network-vif-unplugged-bea61e08-ab64-488a-bd39-88fd0649d434 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:51 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Instance destroyed successfully.
Oct 26 03:29:51 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lazy-loading 'resources' on Instance uuid 747e596d-d9b3-4af2-be42-0fd494b6ef9a {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1973172059',display_name='tempest-ServersNegativeTestJSON-server-1973172059',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1973172059',id=3,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:20:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb2fa2469fb44a7ea42666b7ba4eab31',ramdisk_id='',reservation_id='r-079qbhux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-939634393',owner_user_name='tempest-ServersNegativeTestJSON-939634393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:20:37Z,user_data=None,user_id='e3f70e566f1b46b8bd4131758921f49a',uuid=747e596d-d9b3-4af2-be42-0fd494b6ef9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bea61e08-ab64-488a-bd39-88fd0649d434", "address": "fa:16:3e:01:c5:87", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea61e08-ab", "ovs_interfaceid": "bea61e08-ab64-488a-bd39-88fd0649d434", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Converting VIF {"id": "bea61e08-ab64-488a-bd39-88fd0649d434", "address": "fa:16:3e:01:c5:87", "network": {"id": "0c987002-6658-42a0-afe5-c0d349e73477", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-320259667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb2fa2469fb44a7ea42666b7ba4eab31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbea61e08-ab", "ovs_interfaceid": "bea61e08-ab64-488a-bd39-88fd0649d434", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:c5:87,bridge_name='br-int',has_traffic_filtering=True,id=bea61e08-ab64-488a-bd39-88fd0649d434,network=Network(0c987002-6658-42a0-afe5-c0d349e73477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbea61e08-ab') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG os_vif [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:c5:87,bridge_name='br-int',has_traffic_filtering=True,id=bea61e08-ab64-488a-bd39-88fd0649d434,network=Network(0c987002-6658-42a0-afe5-c0d349e73477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbea61e08-ab') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbea61e08-ab, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e513905a-9dd2-44e0-9375-76064da0f4af) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:51 user nova-compute[74630]: INFO os_vif [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:c5:87,bridge_name='br-int',has_traffic_filtering=True,id=bea61e08-ab64-488a-bd39-88fd0649d434,network=Network(0c987002-6658-42a0-afe5-c0d349e73477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbea61e08-ab')
Oct 26 03:29:51 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Deleting instance files /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a_del
Oct 26 03:29:51 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Deletion of /opt/stack/data/nova/instances/747e596d-d9b3-4af2-be42-0fd494b6ef9a_del complete
Oct 26 03:29:51 user nova-compute[74630]: INFO nova.compute.manager [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 26 03:29:51 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:29:51 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:29:52 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:29:52 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Took 0.52 seconds to deallocate network for instance.
Oct 26 03:29:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquiring lock "7576bf64-216a-4d1a-88a2-b90468e61515" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:52 user nova-compute[74630]: INFO nova.compute.manager [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Detaching volume 70059a1a-e77c-467d-885b-6a7378b50c25
Oct 26 03:29:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:52 user nova-compute[74630]: INFO nova.virt.block_device [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Attempting to driver detach volume 70059a1a-e77c-467d-885b-6a7378b50c25 from mountpoint /dev/vdb
Oct 26 03:29:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Attempting to detach device vdb from instance 7576bf64-216a-4d1a-88a2-b90468e61515 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:29:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:29:52 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:29:52 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:29:52 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:29:52 user nova-compute[74630]:   <serial>70059a1a-e77c-467d-885b-6a7378b50c25</serial>
Oct 26 03:29:52 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:29:52 user nova-compute[74630]: </disk>
Oct 26 03:29:52 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:29:52 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Successfully detached device vdb from instance 7576bf64-216a-4d1a-88a2-b90468e61515 from the persistent domain config.
Oct 26 03:29:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7576bf64-216a-4d1a-88a2-b90468e61515 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:29:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:29:52 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:29:52 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:29:52 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:29:52 user nova-compute[74630]:   <serial>70059a1a-e77c-467d-885b-6a7378b50c25</serial>
Oct 26 03:29:52 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:29:52 user nova-compute[74630]: </disk>
Oct 26 03:29:52 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:29:52 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:29:52 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:29:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.525s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:52 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Deleted allocations for instance 747e596d-d9b3-4af2-be42-0fd494b6ef9a
Oct 26 03:29:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7576bf64-216a-4d1a-88a2-b90468e61515 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:29:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c4d1784f-e9da-4670-aee6-2813a6e7141d tempest-ServersNegativeTestJSON-939634393 tempest-ServersNegativeTestJSON-939634393-project-member] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.258s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-3c089ef5-4fb7-45a6-a87a-b4ae42d51f34 req-51bace2f-450a-4fee-ba54-057b507fae2e service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Received event network-vif-plugged-bea61e08-ab64-488a-bd39-88fd0649d434 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3c089ef5-4fb7-45a6-a87a-b4ae42d51f34 req-51bace2f-450a-4fee-ba54-057b507fae2e service nova] Acquiring lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3c089ef5-4fb7-45a6-a87a-b4ae42d51f34 req-51bace2f-450a-4fee-ba54-057b507fae2e service nova] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3c089ef5-4fb7-45a6-a87a-b4ae42d51f34 req-51bace2f-450a-4fee-ba54-057b507fae2e service nova] Lock "747e596d-d9b3-4af2-be42-0fd494b6ef9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-3c089ef5-4fb7-45a6-a87a-b4ae42d51f34 req-51bace2f-450a-4fee-ba54-057b507fae2e service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] No waiting events found dispatching network-vif-plugged-bea61e08-ab64-488a-bd39-88fd0649d434 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:29:52 user nova-compute[74630]: WARNING nova.compute.manager [req-3c089ef5-4fb7-45a6-a87a-b4ae42d51f34 req-51bace2f-450a-4fee-ba54-057b507fae2e service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Received unexpected event network-vif-plugged-bea61e08-ab64-488a-bd39-88fd0649d434 for instance with vm_state deleted and task_state None.
Oct 26 03:29:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-3c089ef5-4fb7-45a6-a87a-b4ae42d51f34 req-51bace2f-450a-4fee-ba54-057b507fae2e service nova] [instance: 747e596d-d9b3-4af2-be42-0fd494b6ef9a] Received event network-vif-deleted-bea61e08-ab64-488a-bd39-88fd0649d434 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:56 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 980e7a2f-b94d-4544-9e50-03f96fd376fe is timed out.
Oct 26 03:29:56 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Successfully detached device vdb from instance 980e7a2f-b94d-4544-9e50-03f96fd376fe from the live domain config.
Oct 26 03:29:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cWMvFshi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:29:56 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[539fff92-0e73-4f6a-8eb8-666a116341a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:29:56 user nova-compute[74630]: No targets found.
Oct 26 03:29:56 user nova-compute[74630]: iSNS:
Oct 26 03:29:56 user nova-compute[74630]: No targets found.
Oct 26 03:29:56 user nova-compute[74630]: STATIC:
Oct 26 03:29:56 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:29:56 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:56 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:56 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677
Oct 26 03:29:56 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:56 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:56 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665
Oct 26 03:29:56 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:56 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:56 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719
Oct 26 03:29:56 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:56 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:56 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:29:56 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:56 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:56 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25
Oct 26 03:29:56 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:56 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:56 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6
Oct 26 03:29:56 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:56 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:56 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed
Oct 26 03:29:56 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:56 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:56 user nova-compute[74630]: FIRMWARE:
Oct 26 03:29:56 user nova-compute[74630]: No targets found.
Oct 26 03:29:56 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:29:56 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:29:56 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f5103f-8f74-402c-bfa8-c2677c1f912c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[47827cad-5240-4478-b6cd-8eb3fa9062c3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:56 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:56 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:56 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:56 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:56 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:56 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:56 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:56 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:56 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:56 user nova-compute[74630]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 (non-flash)
Oct 26 03:29:56 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:56 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:56 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:56 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:56 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:56 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3184626b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719'): ({'sde'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Removing single pathed devices sde {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf1ebea-dcc8-409d-ae9f-c2baffdfa141]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ef6195-c242-4cfd-9eaf-f84d91c5541e]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Flushing IO for device /dev/sde {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd0b8e5-48b0-4996-bba6-e17505491609]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa323383-8083-4f01-a16a-f91bcce1caf7]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] SCSI volumes sde have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[420b8308-63ad-4fb5-8dea-86fe428065d1]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7246cceb-f83a-4fc6-850e-0944f55f84e0]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719, portal: 172.16.0.220,3260]
Oct 26 03:29:56 user nova-compute[74630]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719, portal: 172.16.0.220,3260] successful.
Oct 26 03:29:56 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a79bc9-a725-4374-b189-4a9670fd5a46]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] <== disconnect_volume: return (380ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG nova.compute.manager [req-1565441a-3936-4605-9072-0fd8dbb77a67 req-7128d3e3-4f07-46e5-bb38-aa606e605332 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-changed-47b60220-f566-48bd-8309-1f01ac44210f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG nova.compute.manager [req-1565441a-3936-4605-9072-0fd8dbb77a67 req-7128d3e3-4f07-46e5-bb38-aa606e605332 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing instance network info cache due to event network-changed-47b60220-f566-48bd-8309-1f01ac44210f. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1565441a-3936-4605-9072-0fd8dbb77a67 req-7128d3e3-4f07-46e5-bb38-aa606e605332 service nova] Acquiring lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1565441a-3936-4605-9072-0fd8dbb77a67 req-7128d3e3-4f07-46e5-bb38-aa606e605332 service nova] Acquired lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:29:56 user nova-compute[74630]: DEBUG nova.network.neutron [req-1565441a-3936-4605-9072-0fd8dbb77a67 req-7128d3e3-4f07-46e5-bb38-aa606e605332 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Refreshing network info cache for port 47b60220-f566-48bd-8309-1f01ac44210f {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:29:57 user nova-compute[74630]: DEBUG nova.network.neutron [req-1565441a-3936-4605-9072-0fd8dbb77a67 req-7128d3e3-4f07-46e5-bb38-aa606e605332 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updated VIF entry in instance network info cache for port 47b60220-f566-48bd-8309-1f01ac44210f. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:29:57 user nova-compute[74630]: DEBUG nova.network.neutron [req-1565441a-3936-4605-9072-0fd8dbb77a67 req-7128d3e3-4f07-46e5-bb38-aa606e605332 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updating instance_info_cache with network_info: [{"id": "47b60220-f566-48bd-8309-1f01ac44210f", "address": "fa:16:3e:5c:90:01", "network": {"id": "60b1d36a-bbd2-490b-aee0-e81b6501a8e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-631511684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b60220-f5", "ovs_interfaceid": "47b60220-f566-48bd-8309-1f01ac44210f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "address": "fa:16:3e:d4:5b:5e", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bdc530-6e", "ovs_interfaceid": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35ac986d-579c-4dcb-bee5-536a729a415c", "address": "fa:16:3e:4f:75:e2", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac986d-57", "ovs_interfaceid": "35ac986d-579c-4dcb-bee5-536a729a415c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "address": "fa:16:3e:db:93:52", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c706397-f0", "ovs_interfaceid": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3acfbe-01", "ovs_interfaceid": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2fd53b1-5769-4dea-960f-1797d60e8099", "address": "fa:16:3e:81:96:39", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fd53b1-57", "ovs_interfaceid": "a2fd53b1-5769-4dea-960f-1797d60e8099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b956c51e-f736-461f-956a-29b585d0e31f", "address": "fa:16:3e:a3:a3:f3", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb956c51e-f7", "ovs_interfaceid": "b956c51e-f736-461f-956a-29b585d0e31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:29:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1565441a-3936-4605-9072-0fd8dbb77a67 req-7128d3e3-4f07-46e5-bb38-aa606e605332 service nova] Releasing lock "refresh_cache-ab04a3a9-4a73-49d1-898a-547cb961e43f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:29:57 user nova-compute[74630]: DEBUG nova.objects.instance [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lazy-loading 'flavor' on Instance uuid 980e7a2f-b94d-4544-9e50-03f96fd376fe {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:29:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a44fee75-ade1-47d2-8a27-6d90ed1fe346 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.024s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.894s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "980e7a2f-b94d-4544-9e50-03f96fd376fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:57 user nova-compute[74630]: INFO nova.compute.manager [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Terminating instance
Oct 26 03:29:57 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:29:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-06d6c612-e1d4-440a-bf60-e8f89e8fcfff req-5e35c188-56a6-4d82-b75e-c9a1ac02570d service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Received event network-vif-unplugged-181a6913-fd44-44b4-955e-657f1cc64313 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-06d6c612-e1d4-440a-bf60-e8f89e8fcfff req-5e35c188-56a6-4d82-b75e-c9a1ac02570d service nova] Acquiring lock "980e7a2f-b94d-4544-9e50-03f96fd376fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-06d6c612-e1d4-440a-bf60-e8f89e8fcfff req-5e35c188-56a6-4d82-b75e-c9a1ac02570d service nova] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-06d6c612-e1d4-440a-bf60-e8f89e8fcfff req-5e35c188-56a6-4d82-b75e-c9a1ac02570d service nova] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-06d6c612-e1d4-440a-bf60-e8f89e8fcfff req-5e35c188-56a6-4d82-b75e-c9a1ac02570d service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] No waiting events found dispatching network-vif-unplugged-181a6913-fd44-44b4-955e-657f1cc64313 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-06d6c612-e1d4-440a-bf60-e8f89e8fcfff req-5e35c188-56a6-4d82-b75e-c9a1ac02570d service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Received event network-vif-unplugged-181a6913-fd44-44b4-955e-657f1cc64313 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:58 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Instance destroyed successfully.
Oct 26 03:29:58 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lazy-loading 'resources' on Instance uuid 980e7a2f-b94d-4544-9e50-03f96fd376fe {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2114068153',display_name='tempest-VolumesSnapshotTestJSON-instance-2114068153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2114068153',id=17,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOCT0vn0YsXb1CkO5Oyw6rixHq17p+AwO9Z0ZFEHClyoamLaL9XT38ZItcm46iSysUijhp3lrvUAglF9CZ/iqwUz792qne9BLD9kf8kNrYtKZwsBTzghaakEEtRUrRHjQ==',key_name='tempest-keypair-652259270',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:25:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15963835048c4d1a9186d63fe8ef8688',ramdisk_id='',reservation_id='r-ugoudqqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1574923981',owner_user_name='tempest-VolumesSnapshotTestJSON-1574923981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:25:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e5e3a45981c47488bc2f8718280ebe4',uuid=980e7a2f-b94d-4544-9e50-03f96fd376fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181a6913-fd44-44b4-955e-657f1cc64313", "address": "fa:16:3e:8d:c7:e0", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6913-fd", "ovs_interfaceid": "181a6913-fd44-44b4-955e-657f1cc64313", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Converting VIF {"id": "181a6913-fd44-44b4-955e-657f1cc64313", "address": "fa:16:3e:8d:c7:e0", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6913-fd", "ovs_interfaceid": "181a6913-fd44-44b4-955e-657f1cc64313", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:c7:e0,bridge_name='br-int',has_traffic_filtering=True,id=181a6913-fd44-44b4-955e-657f1cc64313,network=Network(9c576755-a619-4934-af03-3b69276b112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6913-fd') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG os_vif [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:c7:e0,bridge_name='br-int',has_traffic_filtering=True,id=181a6913-fd44-44b4-955e-657f1cc64313,network=Network(9c576755-a619-4934-af03-3b69276b112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6913-fd') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap181a6913-fd, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3aa0d7a-ad41-4104-b091-34ac3b93c099) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:58 user nova-compute[74630]: INFO os_vif [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:c7:e0,bridge_name='br-int',has_traffic_filtering=True,id=181a6913-fd44-44b4-955e-657f1cc64313,network=Network(9c576755-a619-4934-af03-3b69276b112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6913-fd')
Oct 26 03:29:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cWMvFshi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:29:58 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:29:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f512fe4f-f049-456f-a43e-6f68d3126312]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:29:58 user nova-compute[74630]: No targets found.
Oct 26 03:29:58 user nova-compute[74630]: iSNS:
Oct 26 03:29:58 user nova-compute[74630]: No targets found.
Oct 26 03:29:58 user nova-compute[74630]: STATIC:
Oct 26 03:29:58 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:29:58 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:58 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:58 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677
Oct 26 03:29:58 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:58 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:58 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665
Oct 26 03:29:58 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:58 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:58 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:29:58 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:58 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:58 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25
Oct 26 03:29:58 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:58 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:58 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6
Oct 26 03:29:58 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:58 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:58 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed
Oct 26 03:29:58 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:29:58 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:29:58 user nova-compute[74630]: FIRMWARE:
Oct 26 03:29:58 user nova-compute[74630]: No targets found.
Oct 26 03:29:58 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:29:58 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:29:58 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f24e78ee-fa99-4bfe-8a91-cbdf1f484719', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[81906a11-ac53-4889-b69a-71604660e283]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e330d09-6078-4b17-91fd-1abdabe2545b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:58 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:58 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:58 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:58 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:58 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:58 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:58 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:29:58 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:29:58 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:29:58 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:29:58 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:29:58 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:29:58 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:29:58 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c41a9e0>, {}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Disconnecting from: [] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] <== disconnect_volume: return (83ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:29:58 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Deleting instance files /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe_del
Oct 26 03:29:58 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Deletion of /opt/stack/data/nova/instances/980e7a2f-b94d-4544-9e50-03f96fd376fe_del complete
Oct 26 03:29:58 user nova-compute[74630]: INFO nova.compute.manager [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:29:58 user nova-compute[74630]: INFO nova.compute.manager [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Terminating instance
Oct 26 03:29:58 user nova-compute[74630]: DEBUG nova.compute.manager [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:29:59 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Took 0.99 seconds to deallocate network for instance.
Oct 26 03:29:59 user nova-compute[74630]: DEBUG nova.compute.manager [req-1cd02c35-0ba5-4168-aa2d-4a54934286dd req-559108bc-7b0f-4757-b126-e19dce0d6fef service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Received event network-vif-deleted-181a6913-fd44-44b4-955e-657f1cc64313 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:29:59 user nova-compute[74630]: WARNING nova.volume.cinder [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Attachment 72e80e5d-7f3e-46be-90a7-d0616071568c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 72e80e5d-7f3e-46be-90a7-d0616071568c. (HTTP 404) (Request-ID: req-866a1970-f5ef-419b-8e5e-49372cfa1fb9)
Oct 26 03:29:59 user nova-compute[74630]: INFO nova.compute.manager [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Took 0.04 seconds to detach 1 volumes for instance.
Oct 26 03:29:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:29:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Received event network-vif-plugged-181a6913-fd44-44b4-955e-657f1cc64313 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Acquiring lock "980e7a2f-b94d-4544-9e50-03f96fd376fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] No waiting events found dispatching network-vif-plugged-181a6913-fd44-44b4-955e-657f1cc64313 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:00 user nova-compute[74630]: WARNING nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: 980e7a2f-b94d-4544-9e50-03f96fd376fe] Received unexpected event network-vif-plugged-181a6913-fd44-44b4-955e-657f1cc64313 for instance with vm_state deleted and task_state None.
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-unplugged-47b60220-f566-48bd-8309-1f01ac44210f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-unplugged-47b60220-f566-48bd-8309-1f01ac44210f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-unplugged-47b60220-f566-48bd-8309-1f01ac44210f for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-47b60220-f566-48bd-8309-1f01ac44210f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-47b60220-f566-48bd-8309-1f01ac44210f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:00 user nova-compute[74630]: WARNING nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-47b60220-f566-48bd-8309-1f01ac44210f for instance with vm_state active and task_state deleting.
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-unplugged-44bdc530-6e50-4fff-b4fc-4fac53dff73a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-unplugged-44bdc530-6e50-4fff-b4fc-4fac53dff73a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-unplugged-44bdc530-6e50-4fff-b4fc-4fac53dff73a for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-44bdc530-6e50-4fff-b4fc-4fac53dff73a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-44bdc530-6e50-4fff-b4fc-4fac53dff73a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:00 user nova-compute[74630]: WARNING nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-44bdc530-6e50-4fff-b4fc-4fac53dff73a for instance with vm_state active and task_state deleting.
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-unplugged-35ac986d-579c-4dcb-bee5-536a729a415c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-unplugged-35ac986d-579c-4dcb-bee5-536a729a415c {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b766fa03-28fe-41c0-b191-0c7dafd82bb4 req-28852b50-653b-4b17-b92c-bd084b26da11 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-unplugged-35ac986d-579c-4dcb-bee5-536a729a415c for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-f9bfc32d-d363-4061-9cfa-0125e57efc06 req-a7142801-79ed-4223-ac04-e8deaaba3f6f service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-unplugged-2c3acfbe-013e-4bf0-bb79-c84f9898353c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f9bfc32d-d363-4061-9cfa-0125e57efc06 req-a7142801-79ed-4223-ac04-e8deaaba3f6f service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f9bfc32d-d363-4061-9cfa-0125e57efc06 req-a7142801-79ed-4223-ac04-e8deaaba3f6f service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f9bfc32d-d363-4061-9cfa-0125e57efc06 req-a7142801-79ed-4223-ac04-e8deaaba3f6f service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-f9bfc32d-d363-4061-9cfa-0125e57efc06 req-a7142801-79ed-4223-ac04-e8deaaba3f6f service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-unplugged-2c3acfbe-013e-4bf0-bb79-c84f9898353c {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-f9bfc32d-d363-4061-9cfa-0125e57efc06 req-a7142801-79ed-4223-ac04-e8deaaba3f6f service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-unplugged-2c3acfbe-013e-4bf0-bb79-c84f9898353c for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.659s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:00 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Deleted allocations for instance 980e7a2f-b94d-4544-9e50-03f96fd376fe
Oct 26 03:30:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5d558b43-63b1-4b21-8ed1-2b74d0d75f0f tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "980e7a2f-b94d-4544-9e50-03f96fd376fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:00 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Instance destroyed successfully.
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.objects.instance [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lazy-loading 'resources' on Instance uuid ab04a3a9-4a73-49d1-898a-547cb961e43f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47b60220-f566-48bd-8309-1f01ac44210f", "address": "fa:16:3e:5c:90:01", "network": {"id": "60b1d36a-bbd2-490b-aee0-e81b6501a8e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-631511684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b60220-f5", "ovs_interfaceid": "47b60220-f566-48bd-8309-1f01ac44210f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "47b60220-f566-48bd-8309-1f01ac44210f", "address": "fa:16:3e:5c:90:01", "network": {"id": "60b1d36a-bbd2-490b-aee0-e81b6501a8e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-631511684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b60220-f5", "ovs_interfaceid": "47b60220-f566-48bd-8309-1f01ac44210f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:90:01,bridge_name='br-int',has_traffic_filtering=True,id=47b60220-f566-48bd-8309-1f01ac44210f,network=Network(60b1d36a-bbd2-490b-aee0-e81b6501a8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47b60220-f5') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG os_vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:90:01,bridge_name='br-int',has_traffic_filtering=True,id=47b60220-f566-48bd-8309-1f01ac44210f,network=Network(60b1d36a-bbd2-490b-aee0-e81b6501a8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47b60220-f5') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47b60220-f5, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d22908ca-f05c-46df-a903-5b7941823bd7) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: INFO os_vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:90:01,bridge_name='br-int',has_traffic_filtering=True,id=47b60220-f566-48bd-8309-1f01ac44210f,network=Network(60b1d36a-bbd2-490b-aee0-e81b6501a8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47b60220-f5')
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "address": "fa:16:3e:d4:5b:5e", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bdc530-6e", "ovs_interfaceid": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "address": "fa:16:3e:d4:5b:5e", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bdc530-6e", "ovs_interfaceid": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:5b:5e,bridge_name='br-int',has_traffic_filtering=True,id=44bdc530-6e50-4fff-b4fc-4fac53dff73a,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44bdc530-6e') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:5b:5e,bridge_name='br-int',has_traffic_filtering=True,id=44bdc530-6e50-4fff-b4fc-4fac53dff73a,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44bdc530-6e') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44bdc530-6e, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=163118fa-c4dd-4c3c-bcd9-2bb26cb5856c) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: INFO os_vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:5b:5e,bridge_name='br-int',has_traffic_filtering=True,id=44bdc530-6e50-4fff-b4fc-4fac53dff73a,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44bdc530-6e')
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35ac986d-579c-4dcb-bee5-536a729a415c", "address": "fa:16:3e:4f:75:e2", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac986d-57", "ovs_interfaceid": "35ac986d-579c-4dcb-bee5-536a729a415c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "35ac986d-579c-4dcb-bee5-536a729a415c", "address": "fa:16:3e:4f:75:e2", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac986d-57", "ovs_interfaceid": "35ac986d-579c-4dcb-bee5-536a729a415c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:75:e2,bridge_name='br-int',has_traffic_filtering=True,id=35ac986d-579c-4dcb-bee5-536a729a415c,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap35ac986d-57') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:75:e2,bridge_name='br-int',has_traffic_filtering=True,id=35ac986d-579c-4dcb-bee5-536a729a415c,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap35ac986d-57') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35ac986d-57, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f12fa2c-dd20-4f6d-8c9e-01ecae4a9250) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: INFO os_vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:75:e2,bridge_name='br-int',has_traffic_filtering=True,id=35ac986d-579c-4dcb-bee5-536a729a415c,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap35ac986d-57')
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "address": "fa:16:3e:db:93:52", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c706397-f0", "ovs_interfaceid": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "address": "fa:16:3e:db:93:52", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c706397-f0", "ovs_interfaceid": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:93:52,bridge_name='br-int',has_traffic_filtering=True,id=3c706397-f0b9-4d1c-9f03-d7808255fc57,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c706397-f0') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:93:52,bridge_name='br-int',has_traffic_filtering=True,id=3c706397-f0b9-4d1c-9f03-d7808255fc57,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c706397-f0') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c706397-f0, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1d538d0-6763-4cfa-9eed-2d45b5b17f2b) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: INFO os_vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:93:52,bridge_name='br-int',has_traffic_filtering=True,id=3c706397-f0b9-4d1c-9f03-d7808255fc57,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c706397-f0')
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3acfbe-01", "ovs_interfaceid": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3acfbe-01", "ovs_interfaceid": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7c:ae,bridge_name='br-int',has_traffic_filtering=True,id=2c3acfbe-013e-4bf0-bb79-c84f9898353c,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c3acfbe-01') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7c:ae,bridge_name='br-int',has_traffic_filtering=True,id=2c3acfbe-013e-4bf0-bb79-c84f9898353c,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c3acfbe-01') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c3acfbe-01, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73dbb6f4-5e2f-44c0-a1a8-9b9ee53fc238) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: INFO os_vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:7c:ae,bridge_name='br-int',has_traffic_filtering=True,id=2c3acfbe-013e-4bf0-bb79-c84f9898353c,network=Network(c8ed5b35-140c-455c-a96c-584a6cbf7460),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c3acfbe-01')
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2fd53b1-5769-4dea-960f-1797d60e8099", "address": "fa:16:3e:81:96:39", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fd53b1-57", "ovs_interfaceid": "a2fd53b1-5769-4dea-960f-1797d60e8099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "a2fd53b1-5769-4dea-960f-1797d60e8099", "address": "fa:16:3e:81:96:39", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fd53b1-57", "ovs_interfaceid": "a2fd53b1-5769-4dea-960f-1797d60e8099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:96:39,bridge_name='br-int',has_traffic_filtering=True,id=a2fd53b1-5769-4dea-960f-1797d60e8099,network=Network(0ab14735-0308-4373-be67-7d6add5de46c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fd53b1-57') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:96:39,bridge_name='br-int',has_traffic_filtering=True,id=a2fd53b1-5769-4dea-960f-1797d60e8099,network=Network(0ab14735-0308-4373-be67-7d6add5de46c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fd53b1-57') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2fd53b1-57, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bdfbf1fc-ccc0-4df2-8898-a84e39a8cdd4) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-19a7868d-af56-4572-8863-dc07106abd5d req-af0f9a9e-5324-4946-84d7-de2b313f0ead service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-unplugged-a2fd53b1-5769-4dea-960f-1797d60e8099 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-19a7868d-af56-4572-8863-dc07106abd5d req-af0f9a9e-5324-4946-84d7-de2b313f0ead service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-19a7868d-af56-4572-8863-dc07106abd5d req-af0f9a9e-5324-4946-84d7-de2b313f0ead service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-19a7868d-af56-4572-8863-dc07106abd5d req-af0f9a9e-5324-4946-84d7-de2b313f0ead service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-19a7868d-af56-4572-8863-dc07106abd5d req-af0f9a9e-5324-4946-84d7-de2b313f0ead service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-unplugged-a2fd53b1-5769-4dea-960f-1797d60e8099 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-19a7868d-af56-4572-8863-dc07106abd5d req-af0f9a9e-5324-4946-84d7-de2b313f0ead service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-unplugged-a2fd53b1-5769-4dea-960f-1797d60e8099 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-19a7868d-af56-4572-8863-dc07106abd5d req-af0f9a9e-5324-4946-84d7-de2b313f0ead service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-a2fd53b1-5769-4dea-960f-1797d60e8099 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-19a7868d-af56-4572-8863-dc07106abd5d req-af0f9a9e-5324-4946-84d7-de2b313f0ead service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-19a7868d-af56-4572-8863-dc07106abd5d req-af0f9a9e-5324-4946-84d7-de2b313f0ead service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-19a7868d-af56-4572-8863-dc07106abd5d req-af0f9a9e-5324-4946-84d7-de2b313f0ead service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-19a7868d-af56-4572-8863-dc07106abd5d req-af0f9a9e-5324-4946-84d7-de2b313f0ead service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-a2fd53b1-5769-4dea-960f-1797d60e8099 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:01 user nova-compute[74630]: WARNING nova.compute.manager [req-19a7868d-af56-4572-8863-dc07106abd5d req-af0f9a9e-5324-4946-84d7-de2b313f0ead service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-a2fd53b1-5769-4dea-960f-1797d60e8099 for instance with vm_state active and task_state deleting.
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:01 user nova-compute[74630]: INFO os_vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:96:39,bridge_name='br-int',has_traffic_filtering=True,id=a2fd53b1-5769-4dea-960f-1797d60e8099,network=Network(0ab14735-0308-4373-be67-7d6add5de46c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2fd53b1-57')
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T03:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-405950710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-405950710',id=19,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJED7keyR/HbPh/0iDCnBznHRDgsblFgaG8+3jvW46pN0Gwwt0ODzBlflQgtA2zjcW8jwmoz2U1vQHEfh2ZTwu26z4OyKUA0GAslgQq64gV9+9PUlQp0U1TS/kNw5HtCdw==',key_name='tempest-keypair-2004820697',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a9993c7e16f451abd29d628bbc78ff2',ramdisk_id='',reservation_id='r-0965vxec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1281532896',owner_user_name='tempest-TaggedBootDevicesTest-1281532896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a7d636306a941bbbedf02c4ea8edd30',uuid=ab04a3a9-4a73-49d1-898a-547cb961e43f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b956c51e-f736-461f-956a-29b585d0e31f", "address": "fa:16:3e:a3:a3:f3", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb956c51e-f7", "ovs_interfaceid": "b956c51e-f736-461f-956a-29b585d0e31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converting VIF {"id": "b956c51e-f736-461f-956a-29b585d0e31f", "address": "fa:16:3e:a3:a3:f3", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb956c51e-f7", "ovs_interfaceid": "b956c51e-f736-461f-956a-29b585d0e31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:a3:f3,bridge_name='br-int',has_traffic_filtering=True,id=b956c51e-f736-461f-956a-29b585d0e31f,network=Network(0ab14735-0308-4373-be67-7d6add5de46c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb956c51e-f7') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:a3:f3,bridge_name='br-int',has_traffic_filtering=True,id=b956c51e-f736-461f-956a-29b585d0e31f,network=Network(0ab14735-0308-4373-be67-7d6add5de46c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb956c51e-f7') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb956c51e-f7, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1d73ced-a32b-44d5-adc7-9e45e79ef390) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:01 user nova-compute[74630]: INFO os_vif [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:a3:f3,bridge_name='br-int',has_traffic_filtering=True,id=b956c51e-f736-461f-956a-29b585d0e31f,network=Network(0ab14735-0308-4373-be67-7d6add5de46c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb956c51e-f7')
Oct 26 03:30:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jLpbacSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:30:01 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3533790-b609-4fa4-b4f0-9f912ed17e75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:30:01 user nova-compute[74630]: No targets found.
Oct 26 03:30:01 user nova-compute[74630]: iSNS:
Oct 26 03:30:01 user nova-compute[74630]: No targets found.
Oct 26 03:30:01 user nova-compute[74630]: STATIC:
Oct 26 03:30:01 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:30:01 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:01 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:01 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677
Oct 26 03:30:01 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:01 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:01 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665
Oct 26 03:30:01 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:01 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:01 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550
Oct 26 03:30:01 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:01 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:01 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:30:01 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:01 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:01 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25
Oct 26 03:30:01 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:01 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:01 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6
Oct 26 03:30:01 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:01 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:01 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed
Oct 26 03:30:01 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:01 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:01 user nova-compute[74630]: FIRMWARE:
Oct 26 03:30:01 user nova-compute[74630]: No targets found.
Oct 26 03:30:01 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:30:01 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:30:01 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e91e3-405a-4bd5-9beb-62b8f6ea2fa8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7744b23-84ac-40b5-9594-4700417eddd6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:30:01 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:30:01 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:30:01 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:30:01 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:30:01 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:30:01 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:30:01 user nova-compute[74630]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:30:01 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:30:01 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:30:01 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:30:01 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:30:01 user nova-compute[74630]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 (non-flash)
Oct 26 03:30:01 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:30:01 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:30:01 user nova-compute[74630]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:30:01 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c6649d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6'): ({'sdi'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Removing single pathed devices sdi {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[820aa685-8146-4e9e-bb2a-595aca53c154]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[71427ae5-6758-4e4c-a533-959c72522d75]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Flushing IO for device /dev/sdi {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0464a268-bf54-4328-88e5-d62b34c49527]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:30:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd06d6f-9672-49c3-b39d-ee9d1005dd60]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] SCSI volumes sdi have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c433d63-4106-46d4-9e9e-a8ab46423301]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40fd89c-7951-4bae-bd24-2e394467f44b]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6, portal: 172.16.0.220,3260]
Oct 26 03:30:02 user nova-compute[74630]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6, portal: 172.16.0.220,3260] successful.
Oct 26 03:30:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371afae4-ff7a-483d-aeea-94b83bcb16d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc0b8ac-49ed-4e94-a01a-d3b4a2cee069]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] <== disconnect_volume: return (369ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJGprSUW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:30:02 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-35ac986d-579c-4dcb-bee5-536a729a415c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-35ac986d-579c-4dcb-bee5-536a729a415c {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:02 user nova-compute[74630]: WARNING nova.compute.manager [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-35ac986d-579c-4dcb-bee5-536a729a415c for instance with vm_state active and task_state deleting.
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-unplugged-3c706397-f0b9-4d1c-9f03-d7808255fc57 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-unplugged-3c706397-f0b9-4d1c-9f03-d7808255fc57 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-unplugged-3c706397-f0b9-4d1c-9f03-d7808255fc57 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-3c706397-f0b9-4d1c-9f03-d7808255fc57 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-3c706397-f0b9-4d1c-9f03-d7808255fc57 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:02 user nova-compute[74630]: WARNING nova.compute.manager [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-3c706397-f0b9-4d1c-9f03-d7808255fc57 for instance with vm_state active and task_state deleting.
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-unplugged-b956c51e-f736-461f-956a-29b585d0e31f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-unplugged-b956c51e-f736-461f-956a-29b585d0e31f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-unplugged-b956c51e-f736-461f-956a-29b585d0e31f for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-b956c51e-f736-461f-956a-29b585d0e31f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-b956c51e-f736-461f-956a-29b585d0e31f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:02 user nova-compute[74630]: WARNING nova.compute.manager [req-1d010a6f-35db-4d67-8f5e-6de68bf1cd34 req-86ac0164-22f7-4de7-b1e6-20a2c4cb2e6a service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-b956c51e-f736-461f-956a-29b585d0e31f for instance with vm_state active and task_state deleting.
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[34afba26-a9fb-4d88-8027-839e8263fa17]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:30:02 user nova-compute[74630]: No targets found.
Oct 26 03:30:02 user nova-compute[74630]: iSNS:
Oct 26 03:30:02 user nova-compute[74630]: No targets found.
Oct 26 03:30:02 user nova-compute[74630]: STATIC:
Oct 26 03:30:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:30:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677
Oct 26 03:30:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665
Oct 26 03:30:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550
Oct 26 03:30:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:30:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25
Oct 26 03:30:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed
Oct 26 03:30:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:02 user nova-compute[74630]: FIRMWARE:
Oct 26 03:30:02 user nova-compute[74630]: No targets found.
Oct 26 03:30:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:30:02 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:30:02 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[649af7b9-3a97-47c8-9430-7a94df474a96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-6e5d02d1-070b-41b4-90d3-cb58fcf8d4c6 req-76091a23-e8f6-4930-8c13-a9a9753b5cbe service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-plugged-2c3acfbe-013e-4bf0-bb79-c84f9898353c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6e5d02d1-070b-41b4-90d3-cb58fcf8d4c6 req-76091a23-e8f6-4930-8c13-a9a9753b5cbe service nova] Acquiring lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6e5d02d1-070b-41b4-90d3-cb58fcf8d4c6 req-76091a23-e8f6-4930-8c13-a9a9753b5cbe service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6e5d02d1-070b-41b4-90d3-cb58fcf8d4c6 req-76091a23-e8f6-4930-8c13-a9a9753b5cbe service nova] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-6e5d02d1-070b-41b4-90d3-cb58fcf8d4c6 req-76091a23-e8f6-4930-8c13-a9a9753b5cbe service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] No waiting events found dispatching network-vif-plugged-2c3acfbe-013e-4bf0-bb79-c84f9898353c {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:02 user nova-compute[74630]: WARNING nova.compute.manager [req-6e5d02d1-070b-41b4-90d3-cb58fcf8d4c6 req-76091a23-e8f6-4930-8c13-a9a9753b5cbe service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received unexpected event network-vif-plugged-2c3acfbe-013e-4bf0-bb79-c84f9898353c for instance with vm_state active and task_state deleting.
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c4d708-66b5-438a-958b-0b0e836242c1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3184299240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed'): ({'sdg'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Removing single pathed devices sdg {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[18180fa8-c0b9-4739-ac77-600178243419]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[01af8a8c-d37b-48be-b659-7bd3081dc129]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Flushing IO for device /dev/sdg {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d94f465-1464-4034-ab13-465c61bab1cc]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ef14f2-1daa-458e-8e85-b250880a4708]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] SCSI volumes sdg have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b11cc66-d0d2-4768-bd9f-3e0c7a652a2c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ffa5fa-d77c-4497-9676-0c367a7a896c]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed, portal: 172.16.0.220,3260]
Oct 26 03:30:02 user nova-compute[74630]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed, portal: 172.16.0.220,3260] successful.
Oct 26 03:30:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:512737dd-f70d-4cc3-8a77-936583fa73ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee3f309-a8ac-4fc2-b037-25c50110dfca]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] <== disconnect_volume: return (402ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozixcMYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:30:02 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[622cc479-cc41-4a59-8b24-66363be31368]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:30:02 user nova-compute[74630]: No targets found.
Oct 26 03:30:02 user nova-compute[74630]: iSNS:
Oct 26 03:30:02 user nova-compute[74630]: No targets found.
Oct 26 03:30:02 user nova-compute[74630]: STATIC:
Oct 26 03:30:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:30:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677
Oct 26 03:30:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665
Oct 26 03:30:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550
Oct 26 03:30:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:30:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25
Oct 26 03:30:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:02 user nova-compute[74630]: FIRMWARE:
Oct 26 03:30:02 user nova-compute[74630]: No targets found.
Oct 26 03:30:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:30:02 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:30:02 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0e3394-8409-4798-bbd4-6f3f50f5309e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[34de3432-471d-4428-960d-99e95ba898d6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:30:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3184248550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665'): ({'sdj'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Removing single pathed devices sdj {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[038887b2-c585-488c-bb0e-36397636fdcf]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01dc8db-6f53-44cc-b108-88c74d298cd8]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Flushing IO for device /dev/sdj {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bc9b96-e8a7-4bd1-8a2f-e37970d82991]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.055s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8a428f-96f2-44c6-9eb5-c668afbc83b7]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] SCSI volumes sdj have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02ab014-b526-47b3-903f-43836fc74a19]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b0f8e6-c77a-423b-a90f-6091edcc637b]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665, portal: 172.16.0.220,3260]
Oct 26 03:30:02 user nova-compute[74630]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665, portal: 172.16.0.220,3260] successful.
Oct 26 03:30:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ac062cb-4adf-4b35-8b4c-dc4fb71e6665 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c047c6-55bc-4b1d-814a-59783135ae92]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] <== disconnect_volume: return (370ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:30:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:30:02 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Deleting instance files /opt/stack/data/nova/instances/ab04a3a9-4a73-49d1-898a-547cb961e43f_del
Oct 26 03:30:02 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Deletion of /opt/stack/data/nova/instances/ab04a3a9-4a73-49d1-898a-547cb961e43f_del complete
Oct 26 03:30:03 user nova-compute[74630]: INFO nova.compute.manager [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Took 4.07 seconds to destroy the instance on the hypervisor.
Oct 26 03:30:03 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:30:03 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:30:03 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:30:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-7b7b8e45-1f08-44c3-b7c2-0b569c5945a9 req-a835da46-c83b-4e0f-a6d5-7074945ecc2b service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-deleted-b956c51e-f736-461f-956a-29b585d0e31f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:04 user nova-compute[74630]: INFO nova.compute.manager [req-7b7b8e45-1f08-44c3-b7c2-0b569c5945a9 req-a835da46-c83b-4e0f-a6d5-7074945ecc2b service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Neutron deleted interface b956c51e-f736-461f-956a-29b585d0e31f; detaching it from the instance and deleting it from the info cache
Oct 26 03:30:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-7b7b8e45-1f08-44c3-b7c2-0b569c5945a9 req-a835da46-c83b-4e0f-a6d5-7074945ecc2b service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updating instance_info_cache with network_info: [{"id": "47b60220-f566-48bd-8309-1f01ac44210f", "address": "fa:16:3e:5c:90:01", "network": {"id": "60b1d36a-bbd2-490b-aee0-e81b6501a8e7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-631511684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47b60220-f5", "ovs_interfaceid": "47b60220-f566-48bd-8309-1f01ac44210f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "address": "fa:16:3e:d4:5b:5e", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44bdc530-6e", "ovs_interfaceid": "44bdc530-6e50-4fff-b4fc-4fac53dff73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35ac986d-579c-4dcb-bee5-536a729a415c", "address": "fa:16:3e:4f:75:e2", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ac986d-57", "ovs_interfaceid": "35ac986d-579c-4dcb-bee5-536a729a415c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "address": "fa:16:3e:db:93:52", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c706397-f0", "ovs_interfaceid": "3c706397-f0b9-4d1c-9f03-d7808255fc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "address": "fa:16:3e:b4:7c:ae", "network": {"id": "c8ed5b35-140c-455c-a96c-584a6cbf7460", "bridge": "br-int", "label": "tempest-device-tagging-net1-512090629", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c3acfbe-01", "ovs_interfaceid": "2c3acfbe-013e-4bf0-bb79-c84f9898353c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a2fd53b1-5769-4dea-960f-1797d60e8099", "address": "fa:16:3e:81:96:39", "network": {"id": "0ab14735-0308-4373-be67-7d6add5de46c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1050142085", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9a9993c7e16f451abd29d628bbc78ff2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2fd53b1-57", "ovs_interfaceid": "a2fd53b1-5769-4dea-960f-1797d60e8099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:30:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-7b7b8e45-1f08-44c3-b7c2-0b569c5945a9 req-a835da46-c83b-4e0f-a6d5-7074945ecc2b service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Detach interface failed, port_id=b956c51e-f736-461f-956a-29b585d0e31f, reason: Instance ab04a3a9-4a73-49d1-898a-547cb961e43f could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 03:30:06 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:30:06 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Took 3.70 seconds to deallocate network for instance.
Oct 26 03:30:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:06 user nova-compute[74630]: DEBUG nova.compute.manager [req-f30da34d-5b7d-4b63-b8f3-b628948b34bc req-f9e2376c-95be-4940-bc69-c5e3a2485a66 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-deleted-3c706397-f0b9-4d1c-9f03-d7808255fc57 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:06 user nova-compute[74630]: DEBUG nova.compute.manager [req-f30da34d-5b7d-4b63-b8f3-b628948b34bc req-f9e2376c-95be-4940-bc69-c5e3a2485a66 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-deleted-a2fd53b1-5769-4dea-960f-1797d60e8099 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:06 user nova-compute[74630]: DEBUG nova.compute.manager [req-f30da34d-5b7d-4b63-b8f3-b628948b34bc req-f9e2376c-95be-4940-bc69-c5e3a2485a66 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-deleted-47b60220-f566-48bd-8309-1f01ac44210f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:06 user nova-compute[74630]: DEBUG nova.compute.manager [req-f30da34d-5b7d-4b63-b8f3-b628948b34bc req-f9e2376c-95be-4940-bc69-c5e3a2485a66 service nova] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Received event network-vif-deleted-2c3acfbe-013e-4bf0-bb79-c84f9898353c {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:07 user nova-compute[74630]: INFO nova.compute.manager [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Terminating instance
Oct 26 03:30:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:30:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-c8dd4361-9349-49e0-b000-8632de18de36 req-0e0b5bba-c328-4059-b86b-5c2d65a40ab7 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-vif-unplugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c8dd4361-9349-49e0-b000-8632de18de36 req-0e0b5bba-c328-4059-b86b-5c2d65a40ab7 service nova] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c8dd4361-9349-49e0-b000-8632de18de36 req-0e0b5bba-c328-4059-b86b-5c2d65a40ab7 service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c8dd4361-9349-49e0-b000-8632de18de36 req-0e0b5bba-c328-4059-b86b-5c2d65a40ab7 service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-c8dd4361-9349-49e0-b000-8632de18de36 req-0e0b5bba-c328-4059-b86b-5c2d65a40ab7 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] No waiting events found dispatching network-vif-unplugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-c8dd4361-9349-49e0-b000-8632de18de36 req-0e0b5bba-c328-4059-b86b-5c2d65a40ab7 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-vif-unplugged-b965ee06-ed93-40fc-9732-974c808f5c36 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:30:08 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Instance destroyed successfully.
Oct 26 03:30:08 user nova-compute[74630]: DEBUG nova.objects.instance [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lazy-loading 'resources' on Instance uuid 65ff804f-8b98-406d-8c5c-3d73bb52ff18 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1501494997',display_name='tempest-ServerActionsTestOtherB-server-1501494997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1501494997',id=5,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFIeBoj6ZVV6vjKZ5C8Qtaf45gZ5VQLu8uYxcKaMISZ7A/ITCT4P2Cxj8DgdsT8tNJFXq2qSIv9+4+e1q0xZrix9FhWGUlPhtxOjh9fvNN5qcQ+ZdFKB+/mBI3I8ldOaQ==',key_name='tempest-keypair-565299267',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:27:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03fc5bdbf0b947b49f6a6c8d44630ed5',ramdisk_id='',reservation_id='r-4c005us9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-638189769',owner_user_name='tempest-ServerActionsTestOtherB-638189769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:28:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e27a2c56890d4be0a3fb46bd748fa7cf',uuid=65ff804f-8b98-406d-8c5c-3d73bb52ff18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converting VIF {"id": "b965ee06-ed93-40fc-9732-974c808f5c36", "address": "fa:16:3e:51:30:8c", "network": {"id": "7f33ce39-6042-4006-9cad-710fb3b9e82d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-120532424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03fc5bdbf0b947b49f6a6c8d44630ed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb965ee06-ed", "ovs_interfaceid": "b965ee06-ed93-40fc-9732-974c808f5c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_vif [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb965ee06-ed, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6f87aa0-191a-4fb7-91f8-0c9feac1b5b1) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:08 user nova-compute[74630]: INFO os_vif [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:30:8c,bridge_name='br-int',has_traffic_filtering=True,id=b965ee06-ed93-40fc-9732-974c808f5c36,network=Network(7f33ce39-6042-4006-9cad-710fb3b9e82d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb965ee06-ed')
Oct 26 03:30:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxkXluOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:30:08 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[546a83da-a4ff-41cf-8008-0b7e8c45a4d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:30:08 user nova-compute[74630]: No targets found.
Oct 26 03:30:08 user nova-compute[74630]: iSNS:
Oct 26 03:30:08 user nova-compute[74630]: No targets found.
Oct 26 03:30:08 user nova-compute[74630]: STATIC:
Oct 26 03:30:08 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:30:08 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:08 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:08 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677
Oct 26 03:30:08 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:08 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:08 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550
Oct 26 03:30:08 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:08 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:08 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:30:08 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:08 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:08 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25
Oct 26 03:30:08 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:08 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:08 user nova-compute[74630]: FIRMWARE:
Oct 26 03:30:08 user nova-compute[74630]: No targets found.
Oct 26 03:30:08 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:30:08 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:30:08 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[506bc619-382b-43ac-b0b9-dbf6098ad588]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c871cc96-e3c7-4620-b603-0e21b2bb3ab4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:30:08 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:30:08 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:30:08 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:30:08 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:30:08 user nova-compute[74630]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 (non-flash)
Oct 26 03:30:08 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:30:08 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:30:08 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c660e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677'): ({'sdd'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Removing single pathed devices sdd {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dda0728-3e7a-4ac7-b6a9-07107111dd94]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4829b563-ae85-48cb-b6bd-19d345d96d0a]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Flushing IO for device /dev/sdd {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d894c36-64f9-4a06-a6e5-36700a921566]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[15574cef-ed60-433b-ab24-61d99ad2b3fc]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[91827c52-b121-4d61-921a-bc59371ad22c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --logout" returned: 0 in 0.317s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7a3a15-4a05-40c1-b9cd-738bec3a065c]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260]
Oct 26 03:30:08 user nova-compute[74630]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677, portal: 172.16.0.220,3260] successful.
Oct 26 03:30:08 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:173e4b04-308c-4ada-b18c-8539105cb677 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf6c2fc-3ee6-4c57-8c46-d68e8ae4cdec]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.582s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] <== disconnect_volume: return (583ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:30:08 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Deleting instance files /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18_del
Oct 26 03:30:08 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Deletion of /opt/stack/data/nova/instances/65ff804f-8b98-406d-8c5c-3d73bb52ff18_del complete
Oct 26 03:30:08 user nova-compute[74630]: INFO nova.compute.manager [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Took 1.52 seconds to destroy the instance on the hypervisor.
Oct 26 03:30:08 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:30:08 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:30:09 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Took 0.77 seconds to deallocate network for instance.
Oct 26 03:30:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-ef2bacd4-9141-4ada-bbdf-a16e21e678c2 req-38423258-e65a-4c3c-af72-31bfed115feb service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-vif-deleted-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-1d7582d3-6eb1-41d0-8ade-75b7a8567916 req-4c035166-4ac4-422d-8f50-3c51866de3b4 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d7582d3-6eb1-41d0-8ade-75b7a8567916 req-4c035166-4ac4-422d-8f50-3c51866de3b4 service nova] Acquiring lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d7582d3-6eb1-41d0-8ade-75b7a8567916 req-4c035166-4ac4-422d-8f50-3c51866de3b4 service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1d7582d3-6eb1-41d0-8ade-75b7a8567916 req-4c035166-4ac4-422d-8f50-3c51866de3b4 service nova] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-1d7582d3-6eb1-41d0-8ade-75b7a8567916 req-4c035166-4ac4-422d-8f50-3c51866de3b4 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] No waiting events found dispatching network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:09 user nova-compute[74630]: WARNING nova.compute.manager [req-1d7582d3-6eb1-41d0-8ade-75b7a8567916 req-4c035166-4ac4-422d-8f50-3c51866de3b4 service nova] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Received unexpected event network-vif-plugged-b965ee06-ed93-40fc-9732-974c808f5c36 for instance with vm_state active and task_state deleting.
Oct 26 03:30:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-d8cf3fcb-369d-44db-bec7-dc2075b71808 req-1a2c560f-197c-49c7-8b6f-e71e6c588e02 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received event volume-reimaged-ba36f137-d667-483f-9b08-7b0193c3f550 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d8cf3fcb-369d-44db-bec7-dc2075b71808 req-1a2c560f-197c-49c7-8b6f-e71e6c588e02 service nova] Acquiring lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d8cf3fcb-369d-44db-bec7-dc2075b71808 req-1a2c560f-197c-49c7-8b6f-e71e6c588e02 service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d8cf3fcb-369d-44db-bec7-dc2075b71808 req-1a2c560f-197c-49c7-8b6f-e71e6c588e02 service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-d8cf3fcb-369d-44db-bec7-dc2075b71808 req-1a2c560f-197c-49c7-8b6f-e71e6c588e02 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Processing event volume-reimaged-ba36f137-d667-483f-9b08-7b0193c3f550 {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Instance event wait completed in 47 seconds for volume-reimaged {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:30:09 user nova-compute[74630]: INFO nova.virt.block_device [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Booting with volume ba36f137-d667-483f-9b08-7b0193c3f550 at /dev/vda
Oct 26 03:30:09 user nova-compute[74630]: DEBUG os_brick.utils [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7235634-d05c-4225-8685-816e2204d148]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a246ddb8-0e7c-431c-938b-a109d420f615]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb66ff4-00eb-45a6-aea1-e64e843e1d1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a4468e-5d76-436c-8ac8-eed343e05646]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:30:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:30:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:30:10 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:30:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5cd6f3-1ccd-4a35-914a-11fd1367ea1f]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:30:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:30:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:30:10 user nova-compute[74630]: DEBUG os_brick.utils [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:30:10 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Updating existing volume attachment record: 8b47b617-fb9c-4c87-8c97-a655d7a84cb2 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:30:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:10 user nova-compute[74630]: INFO nova.compute.manager [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] [instance: 65ff804f-8b98-406d-8c5c-3d73bb52ff18] Took 1.33 seconds to detach 1 volumes for instance.
Oct 26 03:30:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:11 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:30:11 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:30:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:11 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Deleted allocations for instance 65ff804f-8b98-406d-8c5c-3d73bb52ff18
Oct 26 03:30:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6d3f3d81-6613-4944-a14a-eed29b4509ab tempest-ServerActionsTestOtherB-638189769 tempest-ServerActionsTestOtherB-638189769-project-member] Lock "65ff804f-8b98-406d-8c5c-3d73bb52ff18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.387s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:12 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7576bf64-216a-4d1a-88a2-b90468e61515 is timed out.
Oct 26 03:30:12 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Successfully detached device vdb from instance 7576bf64-216a-4d1a-88a2-b90468e61515 from the live domain config.
Oct 26 03:30:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HokzwZVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '70059a1a-e77c-467d-885b-6a7378b50c25'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:30:12 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:30:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d17e923-9295-4313-bffc-adf60a39ed0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:30:12 user nova-compute[74630]: No targets found.
Oct 26 03:30:12 user nova-compute[74630]: iSNS:
Oct 26 03:30:12 user nova-compute[74630]: No targets found.
Oct 26 03:30:12 user nova-compute[74630]: STATIC:
Oct 26 03:30:12 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:30:12 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:12 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:12 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:30:12 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:12 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:12 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25
Oct 26 03:30:12 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:30:12 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:30:12 user nova-compute[74630]: FIRMWARE:
Oct 26 03:30:12 user nova-compute[74630]: No targets found.
Oct 26 03:30:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:30:12 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:30:12 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[863652e8-5f10-4bc2-b925-6de2cae868f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d015918a-8496-4f6f-803c-090676e7e95e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:30:12 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:30:12 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:30:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:30:12 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:30:12 user nova-compute[74630]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 (non-flash)
Oct 26 03:30:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c794430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25'): ({'sdc'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Removing single pathed devices sdc {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dd583d-06d3-44c7-8c04-b4e67a8dcc9f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[219d5994-4745-4b1c-84d4-2a004bfff799]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Flushing IO for device /dev/sdc {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[159aff0e-3ca0-493e-a8f3-493b2148849e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:30:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb93136-ecc3-4303-9282-79a96f459e09]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8888c5b-f083-4497-b478-3cdddaeafc4c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24a1eed-978b-40fa-ab92-8b05e97a321d]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260]
Oct 26 03:30:13 user nova-compute[74630]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25, portal: 172.16.0.220,3260] successful.
Oct 26 03:30:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70059a1a-e77c-467d-885b-6a7378b50c25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f933a8-56db-4421-a40c-cf9e6dcfdc8f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] <== disconnect_volume: return (317ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:30:13 user nova-compute[74630]: INFO nova.compute.manager [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] [instance: ab04a3a9-4a73-49d1-898a-547cb961e43f] Took 6.68 seconds to detach 3 volumes for instance.
Oct 26 03:30:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:30:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:13 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Deleted allocations for instance ab04a3a9-4a73-49d1-898a-547cb961e43f
Oct 26 03:30:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-19d2410f-2666-4a14-a850-0130135f0f1c tempest-TaggedBootDevicesTest-1281532896 tempest-TaggedBootDevicesTest-1281532896-project-member] Lock "ab04a3a9-4a73-49d1-898a-547cb961e43f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.025s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:14 user nova-compute[74630]: DEBUG nova.objects.instance [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lazy-loading 'flavor' on Instance uuid 7576bf64-216a-4d1a-88a2-b90468e61515 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:30:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1c33a32f-d980-40b0-8172-ca31359f8b5d tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.013s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:30:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:30:20 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:30:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquiring lock "2176994e-875a-4a16-a317-5e8b096ad498" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "2176994e-875a-4a16-a317-5e8b096ad498" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:20 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:30:21 user nova-compute[74630]: INFO nova.compute.claims [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Claim successful on node user
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-fa1dd816-9dc1-4d48-b608-aa0218f22369" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-fa1dd816-9dc1-4d48-b608-aa0218f22369" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid fa1dd816-9dc1-4d48-b608-aa0218f22369 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Updating instance_info_cache with network_info: [{"id": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "address": "fa:16:3e:27:88:e1", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8d8a99-31", "ovs_interfaceid": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.network.neutron [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:30:21 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-fa1dd816-9dc1-4d48-b608-aa0218f22369" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.policy [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4c0145cf998439585bddc5572262d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df98bab6a84d40edaba8d23037a97c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:30:21 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Creating image(s)
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquiring lock "/opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "/opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "/opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.201s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk 1073741824" returned: 0 in 0.136s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.202s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG nova.network.neutron [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Successfully created port: 625775a7-bb89-41a3-80b4-1bdd23e48573 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Cannot resize image /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Ensure instance console log exists: /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.network.neutron [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Successfully updated port: 625775a7-bb89-41a3-80b4-1bdd23e48573 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquiring lock "refresh_cache-2176994e-875a-4a16-a317-5e8b096ad498" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquired lock "refresh_cache-2176994e-875a-4a16-a317-5e8b096ad498" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.network.neutron [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-24379b98-aff7-421d-afc4-660e78383e8f req-308fdc9b-6e1b-46e4-b488-db8d37d78fb8 service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Received event network-changed-625775a7-bb89-41a3-80b4-1bdd23e48573 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-24379b98-aff7-421d-afc4-660e78383e8f req-308fdc9b-6e1b-46e4-b488-db8d37d78fb8 service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Refreshing instance network info cache due to event network-changed-625775a7-bb89-41a3-80b4-1bdd23e48573. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-24379b98-aff7-421d-afc4-660e78383e8f req-308fdc9b-6e1b-46e4-b488-db8d37d78fb8 service nova] Acquiring lock "refresh_cache-2176994e-875a-4a16-a317-5e8b096ad498" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.network.neutron [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.network.neutron [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Updating instance_info_cache with network_info: [{"id": "625775a7-bb89-41a3-80b4-1bdd23e48573", "address": "fa:16:3e:92:75:eb", "network": {"id": "1854c96b-487b-41d7-b6b9-a43a6e98588f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1416087294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df98bab6a84d40edaba8d23037a97c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625775a7-bb", "ovs_interfaceid": "625775a7-bb89-41a3-80b4-1bdd23e48573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Releasing lock "refresh_cache-2176994e-875a-4a16-a317-5e8b096ad498" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Instance network_info: |[{"id": "625775a7-bb89-41a3-80b4-1bdd23e48573", "address": "fa:16:3e:92:75:eb", "network": {"id": "1854c96b-487b-41d7-b6b9-a43a6e98588f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1416087294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df98bab6a84d40edaba8d23037a97c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625775a7-bb", "ovs_interfaceid": "625775a7-bb89-41a3-80b4-1bdd23e48573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-24379b98-aff7-421d-afc4-660e78383e8f req-308fdc9b-6e1b-46e4-b488-db8d37d78fb8 service nova] Acquired lock "refresh_cache-2176994e-875a-4a16-a317-5e8b096ad498" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.network.neutron [req-24379b98-aff7-421d-afc4-660e78383e8f req-308fdc9b-6e1b-46e4-b488-db8d37d78fb8 service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Refreshing network info cache for port 625775a7-bb89-41a3-80b4-1bdd23e48573 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Start _get_guest_xml network_info=[{"id": "625775a7-bb89-41a3-80b4-1bdd23e48573", "address": "fa:16:3e:92:75:eb", "network": {"id": "1854c96b-487b-41d7-b6b9-a43a6e98588f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1416087294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df98bab6a84d40edaba8d23037a97c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625775a7-bb", "ovs_interfaceid": "625775a7-bb89-41a3-80b4-1bdd23e48573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:30:23 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:30:23 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-45123639',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-45123639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4512363',id=24,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRBsGtFDngdAlOnv0jqclT9NV82R+HspPxqbgiiP3/udSCJl4elvfT5uGyChQ/0NiT+k7ULWx6ZSlp4qpVBMQcT5QH9Y74wo9hwpU7dl1lON7mR6yf2/yMlYAbbMXtgIQ==',key_name='tempest-keypair-703259415',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df98bab6a84d40edaba8d23037a97c83',ramdisk_id='',reservation_id='r-wk9u34a2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1156998690',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4c0145cf998439585bddc5572262d77',uuid=2176994e-875a-4a16-a317-5e8b096ad498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "625775a7-bb89-41a3-80b4-1bdd23e48573", "address": "fa:16:3e:92:75:eb", "network": {"id": "1854c96b-487b-41d7-b6b9-a43a6e98588f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1416087294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df98bab6a84d40edaba8d23037a97c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625775a7-bb", "ovs_interfaceid": "625775a7-bb89-41a3-80b4-1bdd23e48573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Converting VIF {"id": "625775a7-bb89-41a3-80b4-1bdd23e48573", "address": "fa:16:3e:92:75:eb", "network": {"id": "1854c96b-487b-41d7-b6b9-a43a6e98588f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1416087294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df98bab6a84d40edaba8d23037a97c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625775a7-bb", "ovs_interfaceid": "625775a7-bb89-41a3-80b4-1bdd23e48573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:75:eb,bridge_name='br-int',has_traffic_filtering=True,id=625775a7-bb89-41a3-80b4-1bdd23e48573,network=Network(1854c96b-487b-41d7-b6b9-a43a6e98588f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625775a7-bb') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:30:23 user nova-compute[74630]: DEBUG nova.objects.instance [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lazy-loading 'pci_devices' on Instance uuid 2176994e-875a-4a16-a317-5e8b096ad498 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:30:24 user nova-compute[74630]:   <uuid>2176994e-875a-4a16-a317-5e8b096ad498</uuid>
Oct 26 03:30:24 user nova-compute[74630]:   <name>instance-00000018</name>
Oct 26 03:30:24 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:30:24 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:30:24 user nova-compute[74630]:   <metadata>
Oct 26 03:30:24 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:30:24 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:30:24 user nova-compute[74630]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-45123639</nova:name>
Oct 26 03:30:24 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:30:23</nova:creationTime>
Oct 26 03:30:24 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:30:24 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:30:24 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:30:24 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:30:24 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:30:24 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:30:24 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:30:24 user nova-compute[74630]:       <nova:owner>
Oct 26 03:30:24 user nova-compute[74630]:         <nova:user uuid="b4c0145cf998439585bddc5572262d77">tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member</nova:user>
Oct 26 03:30:24 user nova-compute[74630]:         <nova:project uuid="df98bab6a84d40edaba8d23037a97c83">tempest-TestServerVolumeAttachScenarioOldVersion-1156998690</nova:project>
Oct 26 03:30:24 user nova-compute[74630]:       </nova:owner>
Oct 26 03:30:24 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:30:24 user nova-compute[74630]:       <nova:ports>
Oct 26 03:30:24 user nova-compute[74630]:         <nova:port uuid="625775a7-bb89-41a3-80b4-1bdd23e48573">
Oct 26 03:30:24 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 03:30:24 user nova-compute[74630]:         </nova:port>
Oct 26 03:30:24 user nova-compute[74630]:       </nova:ports>
Oct 26 03:30:24 user nova-compute[74630]:     </nova:instance>
Oct 26 03:30:24 user nova-compute[74630]:   </metadata>
Oct 26 03:30:24 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:30:24 user nova-compute[74630]:     <system>
Oct 26 03:30:24 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:30:24 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:30:24 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:30:24 user nova-compute[74630]:       <entry name="serial">2176994e-875a-4a16-a317-5e8b096ad498</entry>
Oct 26 03:30:24 user nova-compute[74630]:       <entry name="uuid">2176994e-875a-4a16-a317-5e8b096ad498</entry>
Oct 26 03:30:24 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:30:24 user nova-compute[74630]:     </system>
Oct 26 03:30:24 user nova-compute[74630]:   </sysinfo>
Oct 26 03:30:24 user nova-compute[74630]:   <os>
Oct 26 03:30:24 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:30:24 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:30:24 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:30:24 user nova-compute[74630]:   </os>
Oct 26 03:30:24 user nova-compute[74630]:   <features>
Oct 26 03:30:24 user nova-compute[74630]:     <acpi/>
Oct 26 03:30:24 user nova-compute[74630]:     <apic/>
Oct 26 03:30:24 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:30:24 user nova-compute[74630]:   </features>
Oct 26 03:30:24 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:30:24 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:30:24 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:30:24 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:30:24 user nova-compute[74630]:   </clock>
Oct 26 03:30:24 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:30:24 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:30:24 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:30:24 user nova-compute[74630]:   </cpu>
Oct 26 03:30:24 user nova-compute[74630]:   <devices>
Oct 26 03:30:24 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:30:24 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:30:24 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk"/>
Oct 26 03:30:24 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:30:24 user nova-compute[74630]:     </disk>
Oct 26 03:30:24 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:30:24 user nova-compute[74630]:       <mac address="fa:16:3e:92:75:eb"/>
Oct 26 03:30:24 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:30:24 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:30:24 user nova-compute[74630]:       <target dev="tap625775a7-bb"/>
Oct 26 03:30:24 user nova-compute[74630]:     </interface>
Oct 26 03:30:24 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:30:24 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/console.log" append="off"/>
Oct 26 03:30:24 user nova-compute[74630]:     </serial>
Oct 26 03:30:24 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:30:24 user nova-compute[74630]:     <video>
Oct 26 03:30:24 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:30:24 user nova-compute[74630]:     </video>
Oct 26 03:30:24 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:30:24 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:30:24 user nova-compute[74630]:     </rng>
Oct 26 03:30:24 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:30:24 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:30:24 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:30:24 user nova-compute[74630]:     </memballoon>
Oct 26 03:30:24 user nova-compute[74630]:   </devices>
Oct 26 03:30:24 user nova-compute[74630]: </domain>
Oct 26 03:30:24 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-45123639',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-45123639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4512363',id=24,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRBsGtFDngdAlOnv0jqclT9NV82R+HspPxqbgiiP3/udSCJl4elvfT5uGyChQ/0NiT+k7ULWx6ZSlp4qpVBMQcT5QH9Y74wo9hwpU7dl1lON7mR6yf2/yMlYAbbMXtgIQ==',key_name='tempest-keypair-703259415',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df98bab6a84d40edaba8d23037a97c83',ramdisk_id='',reservation_id='r-wk9u34a2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1156998690',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4c0145cf998439585bddc5572262d77',uuid=2176994e-875a-4a16-a317-5e8b096ad498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "625775a7-bb89-41a3-80b4-1bdd23e48573", "address": "fa:16:3e:92:75:eb", "network": {"id": "1854c96b-487b-41d7-b6b9-a43a6e98588f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1416087294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df98bab6a84d40edaba8d23037a97c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625775a7-bb", "ovs_interfaceid": "625775a7-bb89-41a3-80b4-1bdd23e48573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Converting VIF {"id": "625775a7-bb89-41a3-80b4-1bdd23e48573", "address": "fa:16:3e:92:75:eb", "network": {"id": "1854c96b-487b-41d7-b6b9-a43a6e98588f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1416087294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df98bab6a84d40edaba8d23037a97c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625775a7-bb", "ovs_interfaceid": "625775a7-bb89-41a3-80b4-1bdd23e48573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:75:eb,bridge_name='br-int',has_traffic_filtering=True,id=625775a7-bb89-41a3-80b4-1bdd23e48573,network=Network(1854c96b-487b-41d7-b6b9-a43a6e98588f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625775a7-bb') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG os_vif [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:75:eb,bridge_name='br-int',has_traffic_filtering=True,id=625775a7-bb89-41a3-80b4-1bdd23e48573,network=Network(1854c96b-487b-41d7-b6b9-a43a6e98588f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625775a7-bb') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87c460bf-ba2b-56fa-8a1f-499efeb00d1a', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap625775a7-bb, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap625775a7-bb, col_values=(('qos', UUID('5061aaf6-b001-4276-9786-b88604db629e')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap625775a7-bb, col_values=(('external_ids', {'iface-id': '625775a7-bb89-41a3-80b4-1bdd23e48573', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:75:eb', 'vm-uuid': '2176994e-875a-4a16-a317-5e8b096ad498'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:24 user nova-compute[74630]: INFO os_vif [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:75:eb,bridge_name='br-int',has_traffic_filtering=True,id=625775a7-bb89-41a3-80b4-1bdd23e48573,network=Network(1854c96b-487b-41d7-b6b9-a43a6e98588f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625775a7-bb')
Oct 26 03:30:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] No VIF found with MAC fa:16:3e:92:75:eb, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG nova.network.neutron [req-24379b98-aff7-421d-afc4-660e78383e8f req-308fdc9b-6e1b-46e4-b488-db8d37d78fb8 service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Updated VIF entry in instance network info cache for port 625775a7-bb89-41a3-80b4-1bdd23e48573. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG nova.network.neutron [req-24379b98-aff7-421d-afc4-660e78383e8f req-308fdc9b-6e1b-46e4-b488-db8d37d78fb8 service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Updating instance_info_cache with network_info: [{"id": "625775a7-bb89-41a3-80b4-1bdd23e48573", "address": "fa:16:3e:92:75:eb", "network": {"id": "1854c96b-487b-41d7-b6b9-a43a6e98588f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1416087294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df98bab6a84d40edaba8d23037a97c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625775a7-bb", "ovs_interfaceid": "625775a7-bb89-41a3-80b4-1bdd23e48573", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-24379b98-aff7-421d-afc4-660e78383e8f req-308fdc9b-6e1b-46e4-b488-db8d37d78fb8 service nova] Releasing lock "refresh_cache-2176994e-875a-4a16-a317-5e8b096ad498" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.265s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG nova.compute.manager [req-ca32e5b5-517e-42a6-95cd-f02742102b24 req-ac85daf7-77f3-499a-83c8-4e0c0787330b service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Received event network-vif-plugged-625775a7-bb89-41a3-80b4-1bdd23e48573 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ca32e5b5-517e-42a6-95cd-f02742102b24 req-ac85daf7-77f3-499a-83c8-4e0c0787330b service nova] Acquiring lock "2176994e-875a-4a16-a317-5e8b096ad498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ca32e5b5-517e-42a6-95cd-f02742102b24 req-ac85daf7-77f3-499a-83c8-4e0c0787330b service nova] Lock "2176994e-875a-4a16-a317-5e8b096ad498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ca32e5b5-517e-42a6-95cd-f02742102b24 req-ac85daf7-77f3-499a-83c8-4e0c0787330b service nova] Lock "2176994e-875a-4a16-a317-5e8b096ad498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG nova.compute.manager [req-ca32e5b5-517e-42a6-95cd-f02742102b24 req-ac85daf7-77f3-499a-83c8-4e0c0787330b service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] No waiting events found dispatching network-vif-plugged-625775a7-bb89-41a3-80b4-1bdd23e48573 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:25 user nova-compute[74630]: WARNING nova.compute.manager [req-ca32e5b5-517e-42a6-95cd-f02742102b24 req-ac85daf7-77f3-499a-83c8-4e0c0787330b service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Received unexpected event network-vif-plugged-625775a7-bb89-41a3-80b4-1bdd23e48573 for instance with vm_state building and task_state spawning.
Oct 26 03:30:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:26 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:30:26 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:30:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=7535MB free_disk=25.236583709716797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f5441872-864e-44d9-8632-e05c5d71bd90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7576bf64-216a-4d1a-88a2-b90468e61515 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 73ac3b23-4f52-4107-989a-bcb38b9e0a00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e748e6b1-72d5-4832-a992-32070d237064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 2176994e-875a-4a16-a317-5e8b096ad498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:30:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:30:27 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:30:27 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:30:27 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:30:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.682s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:30:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:30:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:30:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:30:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-8dfb2b5c-cefe-44a7-a371-91c0b38b1416 req-454da7d4-1ae1-443f-a7d2-01eabdf528a6 service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Received event network-vif-plugged-625775a7-bb89-41a3-80b4-1bdd23e48573 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8dfb2b5c-cefe-44a7-a371-91c0b38b1416 req-454da7d4-1ae1-443f-a7d2-01eabdf528a6 service nova] Acquiring lock "2176994e-875a-4a16-a317-5e8b096ad498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8dfb2b5c-cefe-44a7-a371-91c0b38b1416 req-454da7d4-1ae1-443f-a7d2-01eabdf528a6 service nova] Lock "2176994e-875a-4a16-a317-5e8b096ad498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8dfb2b5c-cefe-44a7-a371-91c0b38b1416 req-454da7d4-1ae1-443f-a7d2-01eabdf528a6 service nova] Lock "2176994e-875a-4a16-a317-5e8b096ad498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-8dfb2b5c-cefe-44a7-a371-91c0b38b1416 req-454da7d4-1ae1-443f-a7d2-01eabdf528a6 service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] No waiting events found dispatching network-vif-plugged-625775a7-bb89-41a3-80b4-1bdd23e48573 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:27 user nova-compute[74630]: WARNING nova.compute.manager [req-8dfb2b5c-cefe-44a7-a371-91c0b38b1416 req-454da7d4-1ae1-443f-a7d2-01eabdf528a6 service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Received unexpected event network-vif-plugged-625775a7-bb89-41a3-80b4-1bdd23e48573 for instance with vm_state building and task_state spawning.
Oct 26 03:30:28 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:30:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:30:28 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Instance spawned successfully.
Oct 26 03:30:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:30:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:30:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:30:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:30:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:30:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:30:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:30:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:28 user nova-compute[74630]: INFO nova.compute.manager [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Took 6.24 seconds to spawn the instance on the hypervisor.
Oct 26 03:30:28 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:30:28 user nova-compute[74630]: INFO nova.compute.manager [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Took 7.28 seconds to build instance.
Oct 26 03:30:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f4d8e03a-7272-442d-85ba-39cc0642c2b5 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "2176994e-875a-4a16-a317-5e8b096ad498" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.423s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:30:30 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Creating image(s)
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Ensure instance console log exists: /opt/stack/data/nova/instances/90dc2dc2-0ea2-4a8c-b4c9-794523df32f0/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Start _get_guest_xml network_info=[{"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxqRWiIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '90dc2dc2-0ea2-4a8c-b4c9-794523df32f0', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba36f137-d667-483f-9b08-7b0193c3f550', 'serial': 'ba36f137-d667-483f-9b08-7b0193c3f550'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '8b47b617-fb9c-4c87-8c97-a655d7a84cb2', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:30:30 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 03:30:30 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.objects.instance [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lazy-loading 'vcpu_model' on Instance uuid 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxqRWiIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:30:30 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 03:30:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:30:30 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 03:30:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:30:30 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9fb774-dcaf-4abf-9941-7241e48c2bd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:30:30 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17c6b23-1376-4230-a16c-4bfcd5dd877b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550] added
Oct 26 03:30:30 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d624372-3284-4cdc-a58e-1795dd41cbe4]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b601fce-9402-4570-b120-16dd8e917a97]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NxqRWiIC {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NxqRWiIC" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d713315f-ae4b-4f5b-9003-9f20cfc22366]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NxqRWiIC'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a066a8fd-c182-4b32-9ff2-7d22bffdf5f6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0cd430-7481-4057-b15d-b2a188d5a435]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:30:30 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:30:30 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:30:30 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:30:30 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:30:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[270bc6b7-c45b-4f85-b7cd-38000b726293]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260]
Oct 26 03:30:31 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260] successful.
Oct 26 03:30:31 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.045s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[71016057-2626-43d1-a851-3a05b430972a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0041b487-287d-46b2-92a3-7a7724b43a77]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:30:31 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:30:31 user nova-compute[74630]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:30:31 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:30:31 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:30:31 user nova-compute[74630]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:30:31 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5907e3-d469-4cd0-8ed3-f8e7595bd245]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:30:31 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxqRWiIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23165333036653935', 'path': '/dev/sdc'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165333036653935', 'path': '/dev/sdc'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T03:26:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-593771189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-415578365',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJud6mpHVea5l3TmFMj7TUo36YSkBpoQyMbTjtpYD/dGU90azzgcRr8MHCroAaS2zs20gbK6yileVVDApGs2uHRxNL2W5M/4qgb3zIJ0sK0u5dluv9CMLCmmumrj5e/PUA==',key_name='tempest-keypair-1033500048',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9079bef72e74a65956113a03d158599',ramdisk_id='',reservation_id='r-ye3e7o2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-310127885',owner_user_name='tempest-ServerActionsV293TestJSON-310127885-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:30:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61f0a167683a42fcacac8fd8532812ba',uuid=90dc2dc2-0ea2-4a8c-b4c9-794523df32f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Converting VIF {"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:dc:ae,bridge_name='br-int',has_traffic_filtering=True,id=3918526e-3b7f-40b0-a4fa-e3960470392b,network=Network(9282a8c0-6bcd-433f-a357-1c399e425972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3918526e-3b') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:30:32 user nova-compute[74630]:   <uuid>90dc2dc2-0ea2-4a8c-b4c9-794523df32f0</uuid>
Oct 26 03:30:32 user nova-compute[74630]:   <name>instance-00000014</name>
Oct 26 03:30:32 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:30:32 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:30:32 user nova-compute[74630]:   <metadata>
Oct 26 03:30:32 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:30:32 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:30:32 user nova-compute[74630]:       <nova:name>tempest-ServerActionsV293TestJSON-server-593771189</nova:name>
Oct 26 03:30:32 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:30:30</nova:creationTime>
Oct 26 03:30:32 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:30:32 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:30:32 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:30:32 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:30:32 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:30:32 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:30:32 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:30:32 user nova-compute[74630]:       <nova:owner>
Oct 26 03:30:32 user nova-compute[74630]:         <nova:user uuid="61f0a167683a42fcacac8fd8532812ba">tempest-ServerActionsV293TestJSON-310127885-project-member</nova:user>
Oct 26 03:30:32 user nova-compute[74630]:         <nova:project uuid="a9079bef72e74a65956113a03d158599">tempest-ServerActionsV293TestJSON-310127885</nova:project>
Oct 26 03:30:32 user nova-compute[74630]:       </nova:owner>
Oct 26 03:30:32 user nova-compute[74630]:       <nova:ports>
Oct 26 03:30:32 user nova-compute[74630]:         <nova:port uuid="3918526e-3b7f-40b0-a4fa-e3960470392b">
Oct 26 03:30:32 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 03:30:32 user nova-compute[74630]:         </nova:port>
Oct 26 03:30:32 user nova-compute[74630]:       </nova:ports>
Oct 26 03:30:32 user nova-compute[74630]:     </nova:instance>
Oct 26 03:30:32 user nova-compute[74630]:   </metadata>
Oct 26 03:30:32 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:30:32 user nova-compute[74630]:     <system>
Oct 26 03:30:32 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:30:32 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:30:32 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:30:32 user nova-compute[74630]:       <entry name="serial">90dc2dc2-0ea2-4a8c-b4c9-794523df32f0</entry>
Oct 26 03:30:32 user nova-compute[74630]:       <entry name="uuid">90dc2dc2-0ea2-4a8c-b4c9-794523df32f0</entry>
Oct 26 03:30:32 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:30:32 user nova-compute[74630]:     </system>
Oct 26 03:30:32 user nova-compute[74630]:   </sysinfo>
Oct 26 03:30:32 user nova-compute[74630]:   <os>
Oct 26 03:30:32 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:30:32 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:30:32 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:30:32 user nova-compute[74630]:   </os>
Oct 26 03:30:32 user nova-compute[74630]:   <features>
Oct 26 03:30:32 user nova-compute[74630]:     <acpi/>
Oct 26 03:30:32 user nova-compute[74630]:     <apic/>
Oct 26 03:30:32 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:30:32 user nova-compute[74630]:   </features>
Oct 26 03:30:32 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:30:32 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:30:32 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:30:32 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:30:32 user nova-compute[74630]:   </clock>
Oct 26 03:30:32 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:30:32 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:30:32 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:30:32 user nova-compute[74630]:   </cpu>
Oct 26 03:30:32 user nova-compute[74630]:   <devices>
Oct 26 03:30:32 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:30:32 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:30:32 user nova-compute[74630]:       <source dev="/dev/sdc"/>
Oct 26 03:30:32 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:30:32 user nova-compute[74630]:       <serial>ba36f137-d667-483f-9b08-7b0193c3f550</serial>
Oct 26 03:30:32 user nova-compute[74630]:     </disk>
Oct 26 03:30:32 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:30:32 user nova-compute[74630]:       <mac address="fa:16:3e:26:dc:ae"/>
Oct 26 03:30:32 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:30:32 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:30:32 user nova-compute[74630]:       <target dev="tap3918526e-3b"/>
Oct 26 03:30:32 user nova-compute[74630]:     </interface>
Oct 26 03:30:32 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:30:32 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/90dc2dc2-0ea2-4a8c-b4c9-794523df32f0/console.log" append="off"/>
Oct 26 03:30:32 user nova-compute[74630]:     </serial>
Oct 26 03:30:32 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:30:32 user nova-compute[74630]:     <video>
Oct 26 03:30:32 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:30:32 user nova-compute[74630]:     </video>
Oct 26 03:30:32 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:30:32 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:30:32 user nova-compute[74630]:     </rng>
Oct 26 03:30:32 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:30:32 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:30:32 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:30:32 user nova-compute[74630]:     </memballoon>
Oct 26 03:30:32 user nova-compute[74630]:   </devices>
Oct 26 03:30:32 user nova-compute[74630]: </domain>
Oct 26 03:30:32 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T03:26:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-593771189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-415578365',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJud6mpHVea5l3TmFMj7TUo36YSkBpoQyMbTjtpYD/dGU90azzgcRr8MHCroAaS2zs20gbK6yileVVDApGs2uHRxNL2W5M/4qgb3zIJ0sK0u5dluv9CMLCmmumrj5e/PUA==',key_name='tempest-keypair-1033500048',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a9079bef72e74a65956113a03d158599',ramdisk_id='',reservation_id='r-ye3e7o2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-310127885',owner_user_name='tempest-ServerActionsV293TestJSON-310127885-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:30:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61f0a167683a42fcacac8fd8532812ba',uuid=90dc2dc2-0ea2-4a8c-b4c9-794523df32f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Converting VIF {"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:dc:ae,bridge_name='br-int',has_traffic_filtering=True,id=3918526e-3b7f-40b0-a4fa-e3960470392b,network=Network(9282a8c0-6bcd-433f-a357-1c399e425972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3918526e-3b') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG os_vif [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:dc:ae,bridge_name='br-int',has_traffic_filtering=True,id=3918526e-3b7f-40b0-a4fa-e3960470392b,network=Network(9282a8c0-6bcd-433f-a357-1c399e425972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3918526e-3b') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64c2a095-9f75-5be0-97d1-47781e1fe7a2', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3918526e-3b, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3918526e-3b, col_values=(('qos', UUID('8ce2d7b3-c11d-4979-a11b-2135142391ba')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3918526e-3b, col_values=(('external_ids', {'iface-id': '3918526e-3b7f-40b0-a4fa-e3960470392b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:dc:ae', 'vm-uuid': '90dc2dc2-0ea2-4a8c-b4c9-794523df32f0'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:32 user nova-compute[74630]: INFO os_vif [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:dc:ae,bridge_name='br-int',has_traffic_filtering=True,id=3918526e-3b7f-40b0-a4fa-e3960470392b,network=Network(9282a8c0-6bcd-433f-a357-1c399e425972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3918526e-3b')
Oct 26 03:30:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:30:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] No VIF found with MAC fa:16:3e:26:dc:ae, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:30:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:33 user nova-compute[74630]: DEBUG nova.compute.manager [req-ca40291f-dae9-485a-80a3-82aaf64a04bd req-9070ee6a-046a-4d5e-80dc-becbbd6c8f5c service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received event network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ca40291f-dae9-485a-80a3-82aaf64a04bd req-9070ee6a-046a-4d5e-80dc-becbbd6c8f5c service nova] Acquiring lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ca40291f-dae9-485a-80a3-82aaf64a04bd req-9070ee6a-046a-4d5e-80dc-becbbd6c8f5c service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ca40291f-dae9-485a-80a3-82aaf64a04bd req-9070ee6a-046a-4d5e-80dc-becbbd6c8f5c service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:33 user nova-compute[74630]: DEBUG nova.compute.manager [req-ca40291f-dae9-485a-80a3-82aaf64a04bd req-9070ee6a-046a-4d5e-80dc-becbbd6c8f5c service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] No waiting events found dispatching network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:33 user nova-compute[74630]: WARNING nova.compute.manager [req-ca40291f-dae9-485a-80a3-82aaf64a04bd req-9070ee6a-046a-4d5e-80dc-becbbd6c8f5c service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received unexpected event network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b for instance with vm_state active and task_state rebuild_spawning.
Oct 26 03:30:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG nova.compute.manager [req-56acfa43-cfb9-41a0-98db-9f8736953400 req-70b7eb6e-dcc8-453e-9e66-adf644a7f6b3 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received event network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-56acfa43-cfb9-41a0-98db-9f8736953400 req-70b7eb6e-dcc8-453e-9e66-adf644a7f6b3 service nova] Acquiring lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-56acfa43-cfb9-41a0-98db-9f8736953400 req-70b7eb6e-dcc8-453e-9e66-adf644a7f6b3 service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-56acfa43-cfb9-41a0-98db-9f8736953400 req-70b7eb6e-dcc8-453e-9e66-adf644a7f6b3 service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG nova.compute.manager [req-56acfa43-cfb9-41a0-98db-9f8736953400 req-70b7eb6e-dcc8-453e-9e66-adf644a7f6b3 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] No waiting events found dispatching network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:36 user nova-compute[74630]: WARNING nova.compute.manager [req-56acfa43-cfb9-41a0-98db-9f8736953400 req-70b7eb6e-dcc8-453e-9e66-adf644a7f6b3 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received unexpected event network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b for instance with vm_state active and task_state rebuild_spawning.
Oct 26 03:30:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:30:36 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Instance spawned successfully.
Oct 26 03:30:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG nova.objects.instance [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74630) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 26 03:30:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d8cf3fcb-369d-44db-bec7-dc2075b71808 tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.086s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquiring lock "7576bf64-216a-4d1a-88a2-b90468e61515" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquiring lock "7576bf64-216a-4d1a-88a2-b90468e61515-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "7576bf64-216a-4d1a-88a2-b90468e61515-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "7576bf64-216a-4d1a-88a2-b90468e61515-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:42 user nova-compute[74630]: INFO nova.compute.manager [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Terminating instance
Oct 26 03:30:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:30:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-0c4e7e35-2154-4779-b8fd-35e4b7348970 req-1b4fe1e9-c5ed-4da5-b443-89349b0b9051 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Received event network-vif-unplugged-422780a3-5bb4-45a5-9253-eaddfaccd00f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0c4e7e35-2154-4779-b8fd-35e4b7348970 req-1b4fe1e9-c5ed-4da5-b443-89349b0b9051 service nova] Acquiring lock "7576bf64-216a-4d1a-88a2-b90468e61515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0c4e7e35-2154-4779-b8fd-35e4b7348970 req-1b4fe1e9-c5ed-4da5-b443-89349b0b9051 service nova] Lock "7576bf64-216a-4d1a-88a2-b90468e61515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0c4e7e35-2154-4779-b8fd-35e4b7348970 req-1b4fe1e9-c5ed-4da5-b443-89349b0b9051 service nova] Lock "7576bf64-216a-4d1a-88a2-b90468e61515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-0c4e7e35-2154-4779-b8fd-35e4b7348970 req-1b4fe1e9-c5ed-4da5-b443-89349b0b9051 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] No waiting events found dispatching network-vif-unplugged-422780a3-5bb4-45a5-9253-eaddfaccd00f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-0c4e7e35-2154-4779-b8fd-35e4b7348970 req-1b4fe1e9-c5ed-4da5-b443-89349b0b9051 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Received event network-vif-unplugged-422780a3-5bb4-45a5-9253-eaddfaccd00f for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:30:43 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Instance destroyed successfully.
Oct 26 03:30:43 user nova-compute[74630]: DEBUG nova.objects.instance [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lazy-loading 'resources' on Instance uuid 7576bf64-216a-4d1a-88a2-b90468e61515 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:26:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-812708338',display_name='tempest-TestVolumeSwap-server-812708338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-812708338',id=18,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX0JtCXA+l4SNf9HJpSomTUQ2Om6DV42G3Be7Rw6T9RyFbQzh/ly0Y8XfqgoYvJL2Y2riEQ5ZHj0Jf4pMB5G8fYEVkmlFxD7gaNivTAhrzzLUkCNdkTKXpO4A9jmz7Arg==',key_name='tempest-keypair-1647964059',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:26:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91ca6a73040f4f7ea05ee0328535e97d',ramdisk_id='',reservation_id='r-e0htdtmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1631559412',owner_user_name='tempest-TestVolumeSwap-1631559412-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:26:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9cf888840364a038054291c27c49d8c',uuid=7576bf64-216a-4d1a-88a2-b90468e61515,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "address": "fa:16:3e:7e:9f:cb", "network": {"id": "6d913fbd-592b-4127-984e-51f91cbc0e13", "bridge": "br-int", "label": "tempest-TestVolumeSwap-750416158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91ca6a73040f4f7ea05ee0328535e97d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422780a3-5b", "ovs_interfaceid": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Converting VIF {"id": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "address": "fa:16:3e:7e:9f:cb", "network": {"id": "6d913fbd-592b-4127-984e-51f91cbc0e13", "bridge": "br-int", "label": "tempest-TestVolumeSwap-750416158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91ca6a73040f4f7ea05ee0328535e97d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422780a3-5b", "ovs_interfaceid": "422780a3-5bb4-45a5-9253-eaddfaccd00f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=422780a3-5bb4-45a5-9253-eaddfaccd00f,network=Network(6d913fbd-592b-4127-984e-51f91cbc0e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422780a3-5b') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG os_vif [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=422780a3-5bb4-45a5-9253-eaddfaccd00f,network=Network(6d913fbd-592b-4127-984e-51f91cbc0e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422780a3-5b') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap422780a3-5b, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e13c1bce-9759-43d2-a776-e0e8d68d1f52) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:30:43 user nova-compute[74630]: INFO os_vif [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:9f:cb,bridge_name='br-int',has_traffic_filtering=True,id=422780a3-5bb4-45a5-9253-eaddfaccd00f,network=Network(6d913fbd-592b-4127-984e-51f91cbc0e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422780a3-5b')
Oct 26 03:30:43 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Deleting instance files /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515_del
Oct 26 03:30:43 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Deletion of /opt/stack/data/nova/instances/7576bf64-216a-4d1a-88a2-b90468e61515_del complete
Oct 26 03:30:43 user nova-compute[74630]: INFO nova.compute.manager [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 26 03:30:43 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:30:43 user nova-compute[74630]: DEBUG nova.compute.manager [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:30:43 user nova-compute[74630]: INFO nova.compute.manager [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] instance snapshotting
Oct 26 03:30:43 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Beginning live snapshot process
Oct 26 03:30:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json -f qcow2 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json -f qcow2 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json -f qcow2" returned: 0 in 0.208s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:44 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:30:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-32694c1c-92f4-425a-b958-1af101a88371 req-92582ea1-ebc2-42ac-bf2b-193a151bb155 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Received event network-vif-deleted-422780a3-5bb4-45a5-9253-eaddfaccd00f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:44 user nova-compute[74630]: INFO nova.compute.manager [req-32694c1c-92f4-425a-b958-1af101a88371 req-92582ea1-ebc2-42ac-bf2b-193a151bb155 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Neutron deleted interface 422780a3-5bb4-45a5-9253-eaddfaccd00f; detaching it from the instance and deleting it from the info cache
Oct 26 03:30:44 user nova-compute[74630]: DEBUG nova.network.neutron [req-32694c1c-92f4-425a-b958-1af101a88371 req-92582ea1-ebc2-42ac-bf2b-193a151bb155 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:30:44 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Took 1.04 seconds to deallocate network for instance.
Oct 26 03:30:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.213s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpav2e3sk0/6e150862cd184644a17ebd3d182014cd.delta 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpav2e3sk0/6e150862cd184644a17ebd3d182014cd.delta 1073741824" returned: 0 in 0.062s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:44 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 03:30:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-32694c1c-92f4-425a-b958-1af101a88371 req-92582ea1-ebc2-42ac-bf2b-193a151bb155 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Detach interface failed, port_id=422780a3-5bb4-45a5-9253-eaddfaccd00f, reason: Instance 7576bf64-216a-4d1a-88a2-b90468e61515 could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 03:30:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:45 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:30:45 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:30:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:45 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Deleted allocations for instance 7576bf64-216a-4d1a-88a2-b90468e61515
Oct 26 03:30:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-f5f7ac11-4fb0-4ec6-a096-b0524095ec11 req-c7b7b56c-34a6-4db1-9972-6460af8a15e0 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Received event network-vif-plugged-422780a3-5bb4-45a5-9253-eaddfaccd00f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f5f7ac11-4fb0-4ec6-a096-b0524095ec11 req-c7b7b56c-34a6-4db1-9972-6460af8a15e0 service nova] Acquiring lock "7576bf64-216a-4d1a-88a2-b90468e61515-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f5f7ac11-4fb0-4ec6-a096-b0524095ec11 req-c7b7b56c-34a6-4db1-9972-6460af8a15e0 service nova] Lock "7576bf64-216a-4d1a-88a2-b90468e61515-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f5f7ac11-4fb0-4ec6-a096-b0524095ec11 req-c7b7b56c-34a6-4db1-9972-6460af8a15e0 service nova] Lock "7576bf64-216a-4d1a-88a2-b90468e61515-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-f5f7ac11-4fb0-4ec6-a096-b0524095ec11 req-c7b7b56c-34a6-4db1-9972-6460af8a15e0 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] No waiting events found dispatching network-vif-plugged-422780a3-5bb4-45a5-9253-eaddfaccd00f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:30:45 user nova-compute[74630]: WARNING nova.compute.manager [req-f5f7ac11-4fb0-4ec6-a096-b0524095ec11 req-c7b7b56c-34a6-4db1-9972-6460af8a15e0 service nova] [instance: 7576bf64-216a-4d1a-88a2-b90468e61515] Received unexpected event network-vif-plugged-422780a3-5bb4-45a5-9253-eaddfaccd00f for instance with vm_state deleted and task_state None.
Oct 26 03:30:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-36af4624-dc67-42ec-b5f7-75d72342149f tempest-TestVolumeSwap-1631559412 tempest-TestVolumeSwap-1631559412-project-member] Lock "7576bf64-216a-4d1a-88a2-b90468e61515" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.836s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:30:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] COPY block job progress, current cursor: 74973184 final cursor: 75497472 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:30:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:30:46 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 03:30:46 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:30:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpav2e3sk0/6e150862cd184644a17ebd3d182014cd.delta /opt/stack/data/nova/instances/snapshots/tmpav2e3sk0/6e150862cd184644a17ebd3d182014cd {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpav2e3sk0/6e150862cd184644a17ebd3d182014cd.delta /opt/stack/data/nova/instances/snapshots/tmpav2e3sk0/6e150862cd184644a17ebd3d182014cd" returned: 0 in 0.826s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:47 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Snapshot extracted, beginning image upload
Oct 26 03:30:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:51 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Snapshot image upload complete
Oct 26 03:30:51 user nova-compute[74630]: INFO nova.compute.manager [None req-0f4a291b-9820-4492-b0e9-0f2dda79772f tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Took 7.79 seconds to snapshot the instance on the hypervisor.
Oct 26 03:30:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-01a257f7-ab78-4563-84e6-17b8164c6da7 req-daa6fc73-6d11-4214-b73b-c8e287408234 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-changed-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:30:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-01a257f7-ab78-4563-84e6-17b8164c6da7 req-daa6fc73-6d11-4214-b73b-c8e287408234 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Refreshing instance network info cache due to event network-changed-b75891ea-8201-4c0f-a203-ef383b64938b. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:30:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-01a257f7-ab78-4563-84e6-17b8164c6da7 req-daa6fc73-6d11-4214-b73b-c8e287408234 service nova] Acquiring lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:30:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-01a257f7-ab78-4563-84e6-17b8164c6da7 req-daa6fc73-6d11-4214-b73b-c8e287408234 service nova] Acquired lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:30:51 user nova-compute[74630]: DEBUG nova.network.neutron [req-01a257f7-ab78-4563-84e6-17b8164c6da7 req-daa6fc73-6d11-4214-b73b-c8e287408234 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Refreshing network info cache for port b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:30:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e748e6b1-72d5-4832-a992-32070d237064" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG nova.objects.instance [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'flavor' on Instance uuid e748e6b1-72d5-4832-a992-32070d237064 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e748e6b1-72d5-4832-a992-32070d237064" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e748e6b1-72d5-4832-a992-32070d237064" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:30:52 user nova-compute[74630]: INFO nova.compute.manager [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Attaching volume 7af0c89b-5b12-4227-bee7-6be65def035b to /dev/vdb
Oct 26 03:30:52 user nova-compute[74630]: DEBUG os_brick.utils [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba6ff75-8b4f-4ca5-b417-11f19615acf7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ceef29-6eb8-40b9-b206-af4bc3e22bdd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[571f1f1a-db3a-48fb-ae04-00cee4f1c8b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbaf8f9-4f48-47e7-b5de-de24d0f5a995]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:30:52 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[966b9589-c43c-44fe-a346-2c826a3a7daa]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG os_brick.utils [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Updating existing volume attachment record: a058d69a-c5a1-4ed2-b152-3a778d4a69c6 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG nova.network.neutron [req-01a257f7-ab78-4563-84e6-17b8164c6da7 req-daa6fc73-6d11-4214-b73b-c8e287408234 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Updated VIF entry in instance network info cache for port b75891ea-8201-4c0f-a203-ef383b64938b. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG nova.network.neutron [req-01a257f7-ab78-4563-84e6-17b8164c6da7 req-daa6fc73-6d11-4214-b73b-c8e287408234 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Updating instance_info_cache with network_info: [{"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:30:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-01a257f7-ab78-4563-84e6-17b8164c6da7 req-daa6fc73-6d11-4214-b73b-c8e287408234 service nova] Releasing lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:30:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:30:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "f5441872-864e-44d9-8632-e05c5d71bd90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f5441872-864e-44d9-8632-e05c5d71bd90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:00 user nova-compute[74630]: INFO nova.compute.manager [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Detaching volume 9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:31:00 user nova-compute[74630]: INFO nova.virt.block_device [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Attempting to driver detach volume 9de496c0-3619-4b18-b4a4-4e490cbfe516 from mountpoint /dev/vdb
Oct 26 03:31:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Attempting to detach device vdb from instance f5441872-864e-44d9-8632-e05c5d71bd90 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:31:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:31:01 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:31:01 user nova-compute[74630]:   <source dev="/dev/sdh"/>
Oct 26 03:31:01 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:31:01 user nova-compute[74630]:   <serial>9de496c0-3619-4b18-b4a4-4e490cbfe516</serial>
Oct 26 03:31:01 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 03:31:01 user nova-compute[74630]: </disk>
Oct 26 03:31:01 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:31:01 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Successfully detached device vdb from instance f5441872-864e-44d9-8632-e05c5d71bd90 from the persistent domain config.
Oct 26 03:31:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5441872-864e-44d9-8632-e05c5d71bd90 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:31:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:31:01 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:31:01 user nova-compute[74630]:   <source dev="/dev/sdh"/>
Oct 26 03:31:01 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:31:01 user nova-compute[74630]:   <serial>9de496c0-3619-4b18-b4a4-4e490cbfe516</serial>
Oct 26 03:31:01 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 03:31:01 user nova-compute[74630]: </disk>
Oct 26 03:31:01 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:31:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5441872-864e-44d9-8632-e05c5d71bd90 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:31:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "dedde109-8cf7-487d-be41-3b8951180c26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:04 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:31:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:31:04 user nova-compute[74630]: INFO nova.compute.claims [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Claim successful on node user
Oct 26 03:31:05 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:31:05 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:31:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:05 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:31:05 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:31:05 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:31:05 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:31:05 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:31:05 user nova-compute[74630]: DEBUG nova.policy [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'adc29c93473b43ac891c0b5a73ee9c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e3bd76b50a465f8a7819fb9666be41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:31:05 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:31:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:31:05 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Creating image(s)
Oct 26 03:31:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "/opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "/opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "/opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.212s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.214s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk 1073741824" returned: 0 in 0.081s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Successfully created port: a61bcc65-236e-4545-a8f3-bb45e1cc018d {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.234s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Cannot resize image /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Ensure instance console log exists: /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Successfully updated port: a61bcc65-236e-4545-a8f3-bb45e1cc018d {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "refresh_cache-dedde109-8cf7-487d-be41-3b8951180c26" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquired lock "refresh_cache-dedde109-8cf7-487d-be41-3b8951180c26" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-9f693783-88b6-4ab8-ba38-555a68e8c4ef req-a6131f91-c314-4c81-8e79-1cea92470bae service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Received event network-changed-a61bcc65-236e-4545-a8f3-bb45e1cc018d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-9f693783-88b6-4ab8-ba38-555a68e8c4ef req-a6131f91-c314-4c81-8e79-1cea92470bae service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Refreshing instance network info cache due to event network-changed-a61bcc65-236e-4545-a8f3-bb45e1cc018d. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9f693783-88b6-4ab8-ba38-555a68e8c4ef req-a6131f91-c314-4c81-8e79-1cea92470bae service nova] Acquiring lock "refresh_cache-dedde109-8cf7-487d-be41-3b8951180c26" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Updating instance_info_cache with network_info: [{"id": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "address": "fa:16:3e:30:29:c4", "network": {"id": "9d5f9542-9f34-4008-bfe5-5472cc3ac9e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1826216881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3bd76b50a465f8a7819fb9666be41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61bcc65-23", "ovs_interfaceid": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Releasing lock "refresh_cache-dedde109-8cf7-487d-be41-3b8951180c26" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Instance network_info: |[{"id": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "address": "fa:16:3e:30:29:c4", "network": {"id": "9d5f9542-9f34-4008-bfe5-5472cc3ac9e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1826216881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3bd76b50a465f8a7819fb9666be41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61bcc65-23", "ovs_interfaceid": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9f693783-88b6-4ab8-ba38-555a68e8c4ef req-a6131f91-c314-4c81-8e79-1cea92470bae service nova] Acquired lock "refresh_cache-dedde109-8cf7-487d-be41-3b8951180c26" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.network.neutron [req-9f693783-88b6-4ab8-ba38-555a68e8c4ef req-a6131f91-c314-4c81-8e79-1cea92470bae service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Refreshing network info cache for port a61bcc65-236e-4545-a8f3-bb45e1cc018d {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Start _get_guest_xml network_info=[{"id": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "address": "fa:16:3e:30:29:c4", "network": {"id": "9d5f9542-9f34-4008-bfe5-5472cc3ac9e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1826216881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3bd76b50a465f8a7819fb9666be41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61bcc65-23", "ovs_interfaceid": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:31:07 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:31:07 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:31:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1426477300',display_name='tempest-TestServerVolumeAttachmentScenario-server-1426477300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1426477300',id=25,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKK41ivvTKu4uM+pYPpwEtvLmSVT9Uqu57O/omNb+XIMnNGEZl7cebbcMy4xCcSYYOtQp4aL0ZERaacvwH1jOqxK9p8JUmacMo8eUATBIKpV20TNWfkQdBOPrTmfpKKjCA==',key_name='tempest-keypair-1416157645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8e3bd76b50a465f8a7819fb9666be41',ramdisk_id='',reservation_id='r-dt7m1g0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-640796290',owner_user_name='tempest-TestServerVolumeAttachmentScenario-640796290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:31:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adc29c93473b43ac891c0b5a73ee9c2b',uuid=dedde109-8cf7-487d-be41-3b8951180c26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "address": "fa:16:3e:30:29:c4", "network": {"id": "9d5f9542-9f34-4008-bfe5-5472cc3ac9e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1826216881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3bd76b50a465f8a7819fb9666be41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61bcc65-23", "ovs_interfaceid": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Converting VIF {"id": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "address": "fa:16:3e:30:29:c4", "network": {"id": "9d5f9542-9f34-4008-bfe5-5472cc3ac9e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1826216881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3bd76b50a465f8a7819fb9666be41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61bcc65-23", "ovs_interfaceid": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:29:c4,bridge_name='br-int',has_traffic_filtering=True,id=a61bcc65-236e-4545-a8f3-bb45e1cc018d,network=Network(9d5f9542-9f34-4008-bfe5-5472cc3ac9e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa61bcc65-23') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lazy-loading 'pci_devices' on Instance uuid dedde109-8cf7-487d-be41-3b8951180c26 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:31:07 user nova-compute[74630]:   <uuid>dedde109-8cf7-487d-be41-3b8951180c26</uuid>
Oct 26 03:31:07 user nova-compute[74630]:   <name>instance-00000019</name>
Oct 26 03:31:07 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:31:07 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:31:07 user nova-compute[74630]:   <metadata>
Oct 26 03:31:07 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:31:07 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:31:07 user nova-compute[74630]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1426477300</nova:name>
Oct 26 03:31:07 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:31:07</nova:creationTime>
Oct 26 03:31:07 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:31:07 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:31:07 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:31:07 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:31:07 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:31:07 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:31:07 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:31:07 user nova-compute[74630]:       <nova:owner>
Oct 26 03:31:07 user nova-compute[74630]:         <nova:user uuid="adc29c93473b43ac891c0b5a73ee9c2b">tempest-TestServerVolumeAttachmentScenario-640796290-project-member</nova:user>
Oct 26 03:31:07 user nova-compute[74630]:         <nova:project uuid="b8e3bd76b50a465f8a7819fb9666be41">tempest-TestServerVolumeAttachmentScenario-640796290</nova:project>
Oct 26 03:31:07 user nova-compute[74630]:       </nova:owner>
Oct 26 03:31:07 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:31:07 user nova-compute[74630]:       <nova:ports>
Oct 26 03:31:07 user nova-compute[74630]:         <nova:port uuid="a61bcc65-236e-4545-a8f3-bb45e1cc018d">
Oct 26 03:31:07 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 03:31:07 user nova-compute[74630]:         </nova:port>
Oct 26 03:31:07 user nova-compute[74630]:       </nova:ports>
Oct 26 03:31:07 user nova-compute[74630]:     </nova:instance>
Oct 26 03:31:07 user nova-compute[74630]:   </metadata>
Oct 26 03:31:07 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:31:07 user nova-compute[74630]:     <system>
Oct 26 03:31:07 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:31:07 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:31:07 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:31:07 user nova-compute[74630]:       <entry name="serial">dedde109-8cf7-487d-be41-3b8951180c26</entry>
Oct 26 03:31:07 user nova-compute[74630]:       <entry name="uuid">dedde109-8cf7-487d-be41-3b8951180c26</entry>
Oct 26 03:31:07 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:31:07 user nova-compute[74630]:     </system>
Oct 26 03:31:07 user nova-compute[74630]:   </sysinfo>
Oct 26 03:31:07 user nova-compute[74630]:   <os>
Oct 26 03:31:07 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:31:07 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:31:07 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:31:07 user nova-compute[74630]:   </os>
Oct 26 03:31:07 user nova-compute[74630]:   <features>
Oct 26 03:31:07 user nova-compute[74630]:     <acpi/>
Oct 26 03:31:07 user nova-compute[74630]:     <apic/>
Oct 26 03:31:07 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:31:07 user nova-compute[74630]:   </features>
Oct 26 03:31:07 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:31:07 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:31:07 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:31:07 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:31:07 user nova-compute[74630]:   </clock>
Oct 26 03:31:07 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:31:07 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:31:07 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:31:07 user nova-compute[74630]:   </cpu>
Oct 26 03:31:07 user nova-compute[74630]:   <devices>
Oct 26 03:31:07 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:31:07 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:31:07 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk"/>
Oct 26 03:31:07 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:31:07 user nova-compute[74630]:     </disk>
Oct 26 03:31:07 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:31:07 user nova-compute[74630]:       <mac address="fa:16:3e:30:29:c4"/>
Oct 26 03:31:07 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:31:07 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:31:07 user nova-compute[74630]:       <target dev="tapa61bcc65-23"/>
Oct 26 03:31:07 user nova-compute[74630]:     </interface>
Oct 26 03:31:07 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:31:07 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/console.log" append="off"/>
Oct 26 03:31:07 user nova-compute[74630]:     </serial>
Oct 26 03:31:07 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:31:07 user nova-compute[74630]:     <video>
Oct 26 03:31:07 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:31:07 user nova-compute[74630]:     </video>
Oct 26 03:31:07 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:31:07 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:31:07 user nova-compute[74630]:     </rng>
Oct 26 03:31:07 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:31:07 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:31:07 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:31:07 user nova-compute[74630]:     </memballoon>
Oct 26 03:31:07 user nova-compute[74630]:   </devices>
Oct 26 03:31:07 user nova-compute[74630]: </domain>
Oct 26 03:31:07 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:31:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1426477300',display_name='tempest-TestServerVolumeAttachmentScenario-server-1426477300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1426477300',id=25,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKK41ivvTKu4uM+pYPpwEtvLmSVT9Uqu57O/omNb+XIMnNGEZl7cebbcMy4xCcSYYOtQp4aL0ZERaacvwH1jOqxK9p8JUmacMo8eUATBIKpV20TNWfkQdBOPrTmfpKKjCA==',key_name='tempest-keypair-1416157645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8e3bd76b50a465f8a7819fb9666be41',ramdisk_id='',reservation_id='r-dt7m1g0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-640796290',owner_user_name='tempest-TestServerVolumeAttachmentScenario-640796290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:31:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adc29c93473b43ac891c0b5a73ee9c2b',uuid=dedde109-8cf7-487d-be41-3b8951180c26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "address": "fa:16:3e:30:29:c4", "network": {"id": "9d5f9542-9f34-4008-bfe5-5472cc3ac9e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1826216881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3bd76b50a465f8a7819fb9666be41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61bcc65-23", "ovs_interfaceid": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Converting VIF {"id": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "address": "fa:16:3e:30:29:c4", "network": {"id": "9d5f9542-9f34-4008-bfe5-5472cc3ac9e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1826216881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3bd76b50a465f8a7819fb9666be41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61bcc65-23", "ovs_interfaceid": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:29:c4,bridge_name='br-int',has_traffic_filtering=True,id=a61bcc65-236e-4545-a8f3-bb45e1cc018d,network=Network(9d5f9542-9f34-4008-bfe5-5472cc3ac9e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa61bcc65-23') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG os_vif [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:29:c4,bridge_name='br-int',has_traffic_filtering=True,id=a61bcc65-236e-4545-a8f3-bb45e1cc018d,network=Network(9d5f9542-9f34-4008-bfe5-5472cc3ac9e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa61bcc65-23') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c52d54c2-095b-5e34-951a-c3498bdc3382', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa61bcc65-23, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa61bcc65-23, col_values=(('qos', UUID('db00a162-3355-4cbd-bf11-7678de216084')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa61bcc65-23, col_values=(('external_ids', {'iface-id': 'a61bcc65-236e-4545-a8f3-bb45e1cc018d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:29:c4', 'vm-uuid': 'dedde109-8cf7-487d-be41-3b8951180c26'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:07 user nova-compute[74630]: INFO os_vif [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:29:c4,bridge_name='br-int',has_traffic_filtering=True,id=a61bcc65-236e-4545-a8f3-bb45e1cc018d,network=Network(9d5f9542-9f34-4008-bfe5-5472cc3ac9e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa61bcc65-23')
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:31:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] No VIF found with MAC fa:16:3e:30:29:c4, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:31:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:08 user nova-compute[74630]: DEBUG nova.network.neutron [req-9f693783-88b6-4ab8-ba38-555a68e8c4ef req-a6131f91-c314-4c81-8e79-1cea92470bae service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Updated VIF entry in instance network info cache for port a61bcc65-236e-4545-a8f3-bb45e1cc018d. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:31:08 user nova-compute[74630]: DEBUG nova.network.neutron [req-9f693783-88b6-4ab8-ba38-555a68e8c4ef req-a6131f91-c314-4c81-8e79-1cea92470bae service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Updating instance_info_cache with network_info: [{"id": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "address": "fa:16:3e:30:29:c4", "network": {"id": "9d5f9542-9f34-4008-bfe5-5472cc3ac9e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1826216881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3bd76b50a465f8a7819fb9666be41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61bcc65-23", "ovs_interfaceid": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:31:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9f693783-88b6-4ab8-ba38-555a68e8c4ef req-a6131f91-c314-4c81-8e79-1cea92470bae service nova] Releasing lock "refresh_cache-dedde109-8cf7-487d-be41-3b8951180c26" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:31:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-078cec03-1b1c-43c7-8df9-9cfea255feec req-0750d6a4-73c8-40ed-9172-f471f6654fff service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Received event network-vif-plugged-a61bcc65-236e-4545-a8f3-bb45e1cc018d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-078cec03-1b1c-43c7-8df9-9cfea255feec req-0750d6a4-73c8-40ed-9172-f471f6654fff service nova] Acquiring lock "dedde109-8cf7-487d-be41-3b8951180c26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-078cec03-1b1c-43c7-8df9-9cfea255feec req-0750d6a4-73c8-40ed-9172-f471f6654fff service nova] Lock "dedde109-8cf7-487d-be41-3b8951180c26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-078cec03-1b1c-43c7-8df9-9cfea255feec req-0750d6a4-73c8-40ed-9172-f471f6654fff service nova] Lock "dedde109-8cf7-487d-be41-3b8951180c26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-078cec03-1b1c-43c7-8df9-9cfea255feec req-0750d6a4-73c8-40ed-9172-f471f6654fff service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] No waiting events found dispatching network-vif-plugged-a61bcc65-236e-4545-a8f3-bb45e1cc018d {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:31:09 user nova-compute[74630]: WARNING nova.compute.manager [req-078cec03-1b1c-43c7-8df9-9cfea255feec req-0750d6a4-73c8-40ed-9172-f471f6654fff service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Received unexpected event network-vif-plugged-a61bcc65-236e-4545-a8f3-bb45e1cc018d for instance with vm_state building and task_state spawning.
Oct 26 03:31:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:31:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:31:11 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Instance spawned successfully.
Oct 26 03:31:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:31:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:31:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:31:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:31:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:31:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:31:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:31:11 user nova-compute[74630]: INFO nova.compute.manager [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Took 5.88 seconds to spawn the instance on the hypervisor.
Oct 26 03:31:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:31:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-8c347aca-496d-4fe2-a13e-3d4b7565185d req-8ca5b213-527c-48d5-9c91-56608a416a86 service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Received event network-vif-plugged-a61bcc65-236e-4545-a8f3-bb45e1cc018d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8c347aca-496d-4fe2-a13e-3d4b7565185d req-8ca5b213-527c-48d5-9c91-56608a416a86 service nova] Acquiring lock "dedde109-8cf7-487d-be41-3b8951180c26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8c347aca-496d-4fe2-a13e-3d4b7565185d req-8ca5b213-527c-48d5-9c91-56608a416a86 service nova] Lock "dedde109-8cf7-487d-be41-3b8951180c26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8c347aca-496d-4fe2-a13e-3d4b7565185d req-8ca5b213-527c-48d5-9c91-56608a416a86 service nova] Lock "dedde109-8cf7-487d-be41-3b8951180c26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-8c347aca-496d-4fe2-a13e-3d4b7565185d req-8ca5b213-527c-48d5-9c91-56608a416a86 service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] No waiting events found dispatching network-vif-plugged-a61bcc65-236e-4545-a8f3-bb45e1cc018d {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:31:11 user nova-compute[74630]: WARNING nova.compute.manager [req-8c347aca-496d-4fe2-a13e-3d4b7565185d req-8ca5b213-527c-48d5-9c91-56608a416a86 service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Received unexpected event network-vif-plugged-a61bcc65-236e-4545-a8f3-bb45e1cc018d for instance with vm_state building and task_state spawning.
Oct 26 03:31:11 user nova-compute[74630]: INFO nova.compute.manager [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Took 6.84 seconds to build instance.
Oct 26 03:31:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5380b35e-4447-49c5-bb79-dca2f13f76a8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.957s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:31:16 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:31:16 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74630) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 03:31:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:31:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 03:31:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] There are 0 instances to clean {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 03:31:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "571ada6a-d632-4596-be98-9f72cab3b5f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:31:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:17 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:31:17 user nova-compute[74630]: INFO nova.compute.claims [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Claim successful on node user
Oct 26 03:31:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG nova.network.neutron [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:31:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:31:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG nova.policy [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e5e3a45981c47488bc2f8718280ebe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15963835048c4d1a9186d63fe8ef8688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:31:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Creating image(s)
Oct 26 03:31:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "/opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "/opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "/opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.228s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.213s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk 1073741824" returned: 0 in 0.053s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG nova.network.neutron [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Successfully created port: 86372de7-53c3-423b-85b4-185aa7bfce4a {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.193s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Checking if we can resize image /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Cannot resize image /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Ensure instance console log exists: /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:19 user nova-compute[74630]: DEBUG nova.network.neutron [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Successfully updated port: 86372de7-53c3-423b-85b4-185aa7bfce4a {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "refresh_cache-571ada6a-d632-4596-be98-9f72cab3b5f2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquired lock "refresh_cache-571ada6a-d632-4596-be98-9f72cab3b5f2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.network.neutron [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-931e4446-b70c-469d-a9b7-d34dcb0fc109 req-7773d4f4-aec2-4d1e-97c2-401f64d37099 service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Received event network-changed-86372de7-53c3-423b-85b4-185aa7bfce4a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-931e4446-b70c-469d-a9b7-d34dcb0fc109 req-7773d4f4-aec2-4d1e-97c2-401f64d37099 service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Refreshing instance network info cache due to event network-changed-86372de7-53c3-423b-85b4-185aa7bfce4a. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-931e4446-b70c-469d-a9b7-d34dcb0fc109 req-7773d4f4-aec2-4d1e-97c2-401f64d37099 service nova] Acquiring lock "refresh_cache-571ada6a-d632-4596-be98-9f72cab3b5f2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.network.neutron [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.network.neutron [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Updating instance_info_cache with network_info: [{"id": "86372de7-53c3-423b-85b4-185aa7bfce4a", "address": "fa:16:3e:98:90:02", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86372de7-53", "ovs_interfaceid": "86372de7-53c3-423b-85b4-185aa7bfce4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Releasing lock "refresh_cache-571ada6a-d632-4596-be98-9f72cab3b5f2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.compute.manager [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Instance network_info: |[{"id": "86372de7-53c3-423b-85b4-185aa7bfce4a", "address": "fa:16:3e:98:90:02", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86372de7-53", "ovs_interfaceid": "86372de7-53c3-423b-85b4-185aa7bfce4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-931e4446-b70c-469d-a9b7-d34dcb0fc109 req-7773d4f4-aec2-4d1e-97c2-401f64d37099 service nova] Acquired lock "refresh_cache-571ada6a-d632-4596-be98-9f72cab3b5f2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.network.neutron [req-931e4446-b70c-469d-a9b7-d34dcb0fc109 req-7773d4f4-aec2-4d1e-97c2-401f64d37099 service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Refreshing network info cache for port 86372de7-53c3-423b-85b4-185aa7bfce4a {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Start _get_guest_xml network_info=[{"id": "86372de7-53c3-423b-85b4-185aa7bfce4a", "address": "fa:16:3e:98:90:02", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86372de7-53", "ovs_interfaceid": "86372de7-53c3-423b-85b4-185aa7bfce4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:31:20 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:31:20 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2120837458',display_name='tempest-VolumesSnapshotTestJSON-instance-2120837458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2120837458',id=26,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPRQ6Hln4uUE74Qq8QVTVCrbS3ZUAigR+PbAeRxKPq+5NeyBisvyebkAe7sAzY+2hpbuae4q/ZjcJ4PapmhqN4ANM9uT2WFz5xYM+O/pdYbI2sXAg7Zp0RARoemzrrl3w==',key_name='tempest-keypair-1585261013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15963835048c4d1a9186d63fe8ef8688',ramdisk_id='',reservation_id='r-i2qde3mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1574923981',owner_user_name='tempest-VolumesSnapshotTestJSON-1574923981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:31:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e5e3a45981c47488bc2f8718280ebe4',uuid=571ada6a-d632-4596-be98-9f72cab3b5f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86372de7-53c3-423b-85b4-185aa7bfce4a", "address": "fa:16:3e:98:90:02", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86372de7-53", "ovs_interfaceid": "86372de7-53c3-423b-85b4-185aa7bfce4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Converting VIF {"id": "86372de7-53c3-423b-85b4-185aa7bfce4a", "address": "fa:16:3e:98:90:02", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86372de7-53", "ovs_interfaceid": "86372de7-53c3-423b-85b4-185aa7bfce4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:90:02,bridge_name='br-int',has_traffic_filtering=True,id=86372de7-53c3-423b-85b4-185aa7bfce4a,network=Network(9c576755-a619-4934-af03-3b69276b112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86372de7-53') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.objects.instance [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lazy-loading 'pci_devices' on Instance uuid 571ada6a-d632-4596-be98-9f72cab3b5f2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:31:20 user nova-compute[74630]:   <uuid>571ada6a-d632-4596-be98-9f72cab3b5f2</uuid>
Oct 26 03:31:20 user nova-compute[74630]:   <name>instance-0000001a</name>
Oct 26 03:31:20 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:31:20 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:31:20 user nova-compute[74630]:   <metadata>
Oct 26 03:31:20 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:31:20 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:31:20 user nova-compute[74630]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2120837458</nova:name>
Oct 26 03:31:20 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:31:20</nova:creationTime>
Oct 26 03:31:20 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:31:20 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:31:20 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:31:20 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:31:20 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:31:20 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:31:20 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:31:20 user nova-compute[74630]:       <nova:owner>
Oct 26 03:31:20 user nova-compute[74630]:         <nova:user uuid="0e5e3a45981c47488bc2f8718280ebe4">tempest-VolumesSnapshotTestJSON-1574923981-project-member</nova:user>
Oct 26 03:31:20 user nova-compute[74630]:         <nova:project uuid="15963835048c4d1a9186d63fe8ef8688">tempest-VolumesSnapshotTestJSON-1574923981</nova:project>
Oct 26 03:31:20 user nova-compute[74630]:       </nova:owner>
Oct 26 03:31:20 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:31:20 user nova-compute[74630]:       <nova:ports>
Oct 26 03:31:20 user nova-compute[74630]:         <nova:port uuid="86372de7-53c3-423b-85b4-185aa7bfce4a">
Oct 26 03:31:20 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 03:31:20 user nova-compute[74630]:         </nova:port>
Oct 26 03:31:20 user nova-compute[74630]:       </nova:ports>
Oct 26 03:31:20 user nova-compute[74630]:     </nova:instance>
Oct 26 03:31:20 user nova-compute[74630]:   </metadata>
Oct 26 03:31:20 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:31:20 user nova-compute[74630]:     <system>
Oct 26 03:31:20 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:31:20 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:31:20 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:31:20 user nova-compute[74630]:       <entry name="serial">571ada6a-d632-4596-be98-9f72cab3b5f2</entry>
Oct 26 03:31:20 user nova-compute[74630]:       <entry name="uuid">571ada6a-d632-4596-be98-9f72cab3b5f2</entry>
Oct 26 03:31:20 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:31:20 user nova-compute[74630]:     </system>
Oct 26 03:31:20 user nova-compute[74630]:   </sysinfo>
Oct 26 03:31:20 user nova-compute[74630]:   <os>
Oct 26 03:31:20 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:31:20 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:31:20 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:31:20 user nova-compute[74630]:   </os>
Oct 26 03:31:20 user nova-compute[74630]:   <features>
Oct 26 03:31:20 user nova-compute[74630]:     <acpi/>
Oct 26 03:31:20 user nova-compute[74630]:     <apic/>
Oct 26 03:31:20 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:31:20 user nova-compute[74630]:   </features>
Oct 26 03:31:20 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:31:20 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:31:20 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:31:20 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:31:20 user nova-compute[74630]:   </clock>
Oct 26 03:31:20 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:31:20 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:31:20 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:31:20 user nova-compute[74630]:   </cpu>
Oct 26 03:31:20 user nova-compute[74630]:   <devices>
Oct 26 03:31:20 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:31:20 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:31:20 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk"/>
Oct 26 03:31:20 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:31:20 user nova-compute[74630]:     </disk>
Oct 26 03:31:20 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:31:20 user nova-compute[74630]:       <mac address="fa:16:3e:98:90:02"/>
Oct 26 03:31:20 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:31:20 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:31:20 user nova-compute[74630]:       <target dev="tap86372de7-53"/>
Oct 26 03:31:20 user nova-compute[74630]:     </interface>
Oct 26 03:31:20 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:31:20 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/console.log" append="off"/>
Oct 26 03:31:20 user nova-compute[74630]:     </serial>
Oct 26 03:31:20 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:31:20 user nova-compute[74630]:     <video>
Oct 26 03:31:20 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:31:20 user nova-compute[74630]:     </video>
Oct 26 03:31:20 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:31:20 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:31:20 user nova-compute[74630]:     </rng>
Oct 26 03:31:20 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:31:20 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:31:20 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:31:20 user nova-compute[74630]:     </memballoon>
Oct 26 03:31:20 user nova-compute[74630]:   </devices>
Oct 26 03:31:20 user nova-compute[74630]: </domain>
Oct 26 03:31:20 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2120837458',display_name='tempest-VolumesSnapshotTestJSON-instance-2120837458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2120837458',id=26,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPRQ6Hln4uUE74Qq8QVTVCrbS3ZUAigR+PbAeRxKPq+5NeyBisvyebkAe7sAzY+2hpbuae4q/ZjcJ4PapmhqN4ANM9uT2WFz5xYM+O/pdYbI2sXAg7Zp0RARoemzrrl3w==',key_name='tempest-keypair-1585261013',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15963835048c4d1a9186d63fe8ef8688',ramdisk_id='',reservation_id='r-i2qde3mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1574923981',owner_user_name='tempest-VolumesSnapshotTestJSON-1574923981-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:31:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e5e3a45981c47488bc2f8718280ebe4',uuid=571ada6a-d632-4596-be98-9f72cab3b5f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86372de7-53c3-423b-85b4-185aa7bfce4a", "address": "fa:16:3e:98:90:02", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86372de7-53", "ovs_interfaceid": "86372de7-53c3-423b-85b4-185aa7bfce4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Converting VIF {"id": "86372de7-53c3-423b-85b4-185aa7bfce4a", "address": "fa:16:3e:98:90:02", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86372de7-53", "ovs_interfaceid": "86372de7-53c3-423b-85b4-185aa7bfce4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:90:02,bridge_name='br-int',has_traffic_filtering=True,id=86372de7-53c3-423b-85b4-185aa7bfce4a,network=Network(9c576755-a619-4934-af03-3b69276b112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86372de7-53') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG os_vif [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:90:02,bridge_name='br-int',has_traffic_filtering=True,id=86372de7-53c3-423b-85b4-185aa7bfce4a,network=Network(9c576755-a619-4934-af03-3b69276b112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86372de7-53') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21a828a4-e767-559f-81c5-ac97e6bbb23b', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86372de7-53, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86372de7-53, col_values=(('qos', UUID('0720e063-05cd-47dc-8480-7ec563ff85fd')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86372de7-53, col_values=(('external_ids', {'iface-id': '86372de7-53c3-423b-85b4-185aa7bfce4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:90:02', 'vm-uuid': '571ada6a-d632-4596-be98-9f72cab3b5f2'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:20 user nova-compute[74630]: INFO os_vif [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:90:02,bridge_name='br-int',has_traffic_filtering=True,id=86372de7-53c3-423b-85b4-185aa7bfce4a,network=Network(9c576755-a619-4934-af03-3b69276b112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86372de7-53')
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] No VIF found with MAC fa:16:3e:98:90:02, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.network.neutron [req-931e4446-b70c-469d-a9b7-d34dcb0fc109 req-7773d4f4-aec2-4d1e-97c2-401f64d37099 service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Updated VIF entry in instance network info cache for port 86372de7-53c3-423b-85b4-185aa7bfce4a. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG nova.network.neutron [req-931e4446-b70c-469d-a9b7-d34dcb0fc109 req-7773d4f4-aec2-4d1e-97c2-401f64d37099 service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Updating instance_info_cache with network_info: [{"id": "86372de7-53c3-423b-85b4-185aa7bfce4a", "address": "fa:16:3e:98:90:02", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86372de7-53", "ovs_interfaceid": "86372de7-53c3-423b-85b4-185aa7bfce4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:31:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-931e4446-b70c-469d-a9b7-d34dcb0fc109 req-7773d4f4-aec2-4d1e-97c2-401f64d37099 service nova] Releasing lock "refresh_cache-571ada6a-d632-4596-be98-9f72cab3b5f2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:31:21 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5441872-864e-44d9-8632-e05c5d71bd90 is timed out.
Oct 26 03:31:21 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Successfully detached device vdb from instance f5441872-864e-44d9-8632-e05c5d71bd90 from the live domain config.
Oct 26 03:31:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZLrARmS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:31:21 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cec8a8-4a75-4ebf-8c5e-54978c4a9eac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:31:21 user nova-compute[74630]: No targets found.
Oct 26 03:31:21 user nova-compute[74630]: iSNS:
Oct 26 03:31:21 user nova-compute[74630]: No targets found.
Oct 26 03:31:21 user nova-compute[74630]: STATIC:
Oct 26 03:31:21 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:31:21 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:31:21 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:31:21 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550
Oct 26 03:31:21 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:31:21 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:31:21 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516
Oct 26 03:31:21 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:31:21 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:31:21 user nova-compute[74630]: FIRMWARE:
Oct 26 03:31:21 user nova-compute[74630]: No targets found.
Oct 26 03:31:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:31:21 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:31:21 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8366b0eb-3baf-4386-bdae-2a70f30f322b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93bbc31-aff2-4949-8257-e94cc2aa1f4f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:31:21 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:31:21 user nova-compute[74630]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:31:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:31:21 user nova-compute[74630]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 (non-flash)
Oct 26 03:31:21 user nova-compute[74630]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:31:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f31846276d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516'): ({'sdh'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Removing single pathed devices sdh {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2effdf-b735-45b5-87c7-ddadc8339f42]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e775b26e-d2ee-4d5b-b89b-84faffaf0ce1]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Flushing IO for device /dev/sdh {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[98170d5f-864c-44c0-961a-ba0b497c67f7]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce1e70a-0b7e-4717-8ef9-ca457e12f22b]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] SCSI volumes sdh have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a155607-931a-4d00-8762-34e1494b6eec]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7a1517-3d86-46d8-ae44-d57e83d227aa]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260]
Oct 26 03:31:21 user nova-compute[74630]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516, portal: 172.16.0.220,3260] successful.
Oct 26 03:31:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:31:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de496c0-3619-4b18-b4a4-4e490cbfe516 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1f6630-6792-4c31-9de7-78bbacbda3fa]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] <== disconnect_volume: return (398ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-64ef8e11-f918-42b7-8f5d-ab1889db4db1 req-70d3e99d-6a79-4a6b-b57a-066b070ee79b service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Received event network-vif-plugged-86372de7-53c3-423b-85b4-185aa7bfce4a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-64ef8e11-f918-42b7-8f5d-ab1889db4db1 req-70d3e99d-6a79-4a6b-b57a-066b070ee79b service nova] Acquiring lock "571ada6a-d632-4596-be98-9f72cab3b5f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-64ef8e11-f918-42b7-8f5d-ab1889db4db1 req-70d3e99d-6a79-4a6b-b57a-066b070ee79b service nova] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-64ef8e11-f918-42b7-8f5d-ab1889db4db1 req-70d3e99d-6a79-4a6b-b57a-066b070ee79b service nova] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-64ef8e11-f918-42b7-8f5d-ab1889db4db1 req-70d3e99d-6a79-4a6b-b57a-066b070ee79b service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] No waiting events found dispatching network-vif-plugged-86372de7-53c3-423b-85b4-185aa7bfce4a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:31:22 user nova-compute[74630]: WARNING nova.compute.manager [req-64ef8e11-f918-42b7-8f5d-ab1889db4db1 req-70d3e99d-6a79-4a6b-b57a-066b070ee79b service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Received unexpected event network-vif-plugged-86372de7-53c3-423b-85b4-185aa7bfce4a for instance with vm_state building and task_state spawning.
Oct 26 03:31:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG nova.compute.manager [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:31:24 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Instance spawned successfully.
Oct 26 03:31:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG nova.compute.manager [req-11e211e4-498c-4bae-a0e5-2b0336a93e00 req-e5ef528f-3706-4858-8a1e-e709de391db0 service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Received event network-vif-plugged-86372de7-53c3-423b-85b4-185aa7bfce4a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-11e211e4-498c-4bae-a0e5-2b0336a93e00 req-e5ef528f-3706-4858-8a1e-e709de391db0 service nova] Acquiring lock "571ada6a-d632-4596-be98-9f72cab3b5f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-11e211e4-498c-4bae-a0e5-2b0336a93e00 req-e5ef528f-3706-4858-8a1e-e709de391db0 service nova] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-11e211e4-498c-4bae-a0e5-2b0336a93e00 req-e5ef528f-3706-4858-8a1e-e709de391db0 service nova] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG nova.compute.manager [req-11e211e4-498c-4bae-a0e5-2b0336a93e00 req-e5ef528f-3706-4858-8a1e-e709de391db0 service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] No waiting events found dispatching network-vif-plugged-86372de7-53c3-423b-85b4-185aa7bfce4a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:31:24 user nova-compute[74630]: WARNING nova.compute.manager [req-11e211e4-498c-4bae-a0e5-2b0336a93e00 req-e5ef528f-3706-4858-8a1e-e709de391db0 service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Received unexpected event network-vif-plugged-86372de7-53c3-423b-85b4-185aa7bfce4a for instance with vm_state building and task_state spawning.
Oct 26 03:31:24 user nova-compute[74630]: INFO nova.compute.manager [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Took 5.85 seconds to spawn the instance on the hypervisor.
Oct 26 03:31:24 user nova-compute[74630]: DEBUG nova.compute.manager [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:31:24 user nova-compute[74630]: INFO nova.compute.manager [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Took 6.92 seconds to build instance.
Oct 26 03:31:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22cb23d2-554d-46d7-ae51-079d9eeb4582 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.080s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:31:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.250s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:31:29 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:31:29 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:31:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=7193MB free_disk=25.161914825439453GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:31:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f5441872-864e-44d9-8632-e05c5d71bd90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 73ac3b23-4f52-4107-989a-bcb38b9e0a00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e748e6b1-72d5-4832-a992-32070d237064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 2176994e-875a-4a16-a317-5e8b096ad498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance dedde109-8cf7-487d-be41-3b8951180c26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 571ada6a-d632-4596-be98-9f72cab3b5f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing inventories for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating ProviderTree inventory for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating inventory in ProviderTree for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing aggregate associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, aggregates: None {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing trait associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, traits: HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:31:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:31 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:31:31 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:31:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:31:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:31:32 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:31:32 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Updating instance_info_cache with network_info: [{"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:31:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-32264781-acf7-4afa-830a-5469b6a4c744" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:31:32 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:31:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:31:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:31:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:31:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:31:32 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG nova.objects.instance [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lazy-loading 'flavor' on Instance uuid f5441872-864e-44d9-8632-e05c5d71bd90 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Lcgwjntf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:31:33 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:31:33 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:31:33 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-438e91c8-e101-40fe-86cf-87c1137067fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f5441872-864e-44d9-8632-e05c5d71bd90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.707s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74013d0-f72a-4542-8644-3e32bb5f99d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:31:33 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8420f1a8-58e7-49fe-ba38-2ef55e5e1546]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b] added
Oct 26 03:31:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[985b46b7-166d-45b0-9c52-2258073edbc6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac6f89d-bfeb-4aee-8c0e-6ffb7d8980f6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Lcgwjntf {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Lcgwjntf" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fbf7d6-a67b-4f7e-a398-8360976f3eec]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Lcgwjntf'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ca5286-3c8a-4e64-9573-3c6c6ff2888e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8837e429-213c-44aa-b337-8639b29d1e81]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:31:33 user nova-compute[74630]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:31:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:31:33 user nova-compute[74630]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:31:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0f4879-2c4f-4107-9385-383d478e2a11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b, portal: 172.16.0.220,3260]
Oct 26 03:31:33 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b, portal: 172.16.0.220,3260] successful.
Oct 26 03:31:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[22516412-9de7-4c4c-a57a-cd54e9f04a96]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91841f8-e009-41fb-90d2-9379195a0ac5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:31:33 user nova-compute[74630]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:31:33 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:31:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:31:33 user nova-compute[74630]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:31:33 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:31:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ad8dc3-6161-43a1-837b-be467c351de6]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:31:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Lcgwjntf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:31:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:31:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23736396665313632', 'path': '/dev/sdd'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:31:35 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736396665313632', 'path': '/dev/sdd'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:31:35 user nova-compute[74630]: DEBUG nova.objects.instance [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'flavor' on Instance uuid e748e6b1-72d5-4832-a992-32070d237064 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:31:35 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:31:35 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:31:35 user nova-compute[74630]:   <source dev="/dev/sdd"/>
Oct 26 03:31:35 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:31:35 user nova-compute[74630]:   <serial>7af0c89b-5b12-4227-bee7-6be65def035b</serial>
Oct 26 03:31:35 user nova-compute[74630]: </disk>
Oct 26 03:31:35 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:31:35 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:31:35 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:31:35 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No VIF found with MAC fa:16:3e:80:af:55, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:31:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7f71bc07-0af0-4731-9af4-7704fa33ea7a tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e748e6b1-72d5-4832-a992-32070d237064" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.368s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:37 user nova-compute[74630]: INFO nova.compute.manager [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Rescuing
Oct 26 03:31:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:31:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquired lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:31:37 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:31:37 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Updating instance_info_cache with network_info: [{"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:31:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Releasing lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:31:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:38 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: e748e6b1-72d5-4832-a992-32070d237064] Instance destroyed successfully.
Oct 26 03:31:38 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Attempting rescue
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74630) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Instance directory exists: not creating {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 03:31:38 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Creating image(s)
Oct 26 03:31:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "/opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "/opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "/opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'trusted_certs' on Instance uuid e748e6b1-72d5-4832-a992-32070d237064 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-f33ffcb7-a066-4947-a92c-5845e8701258 req-752b1aeb-409e-416f-806c-6ef09372b86a service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-unplugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f33ffcb7-a066-4947-a92c-5845e8701258 req-752b1aeb-409e-416f-806c-6ef09372b86a service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f33ffcb7-a066-4947-a92c-5845e8701258 req-752b1aeb-409e-416f-806c-6ef09372b86a service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f33ffcb7-a066-4947-a92c-5845e8701258 req-752b1aeb-409e-416f-806c-6ef09372b86a service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-f33ffcb7-a066-4947-a92c-5845e8701258 req-752b1aeb-409e-416f-806c-6ef09372b86a service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-unplugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:31:38 user nova-compute[74630]: WARNING nova.compute.manager [req-f33ffcb7-a066-4947-a92c-5845e8701258 req-752b1aeb-409e-416f-806c-6ef09372b86a service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-unplugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state active and task_state rescuing.
Oct 26 03:31:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.198s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.rescue {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.rescue" returned: 0 in 0.059s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'migration_context' on Instance uuid e748e6b1-72d5-4832-a992-32070d237064 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.objects.base [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Object Instance<e748e6b1-72d5-4832-a992-32070d237064> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Start _get_guest_xml network_info=[{"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "vif_mac": "fa:16:3e:80:af:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'resources' on Instance uuid e748e6b1-72d5-4832-a992-32070d237064 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.objects.base [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Object Instance<e748e6b1-72d5-4832-a992-32070d237064> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'numa_topology' on Instance uuid e748e6b1-72d5-4832-a992-32070d237064 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.objects.base [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Object Instance<e748e6b1-72d5-4832-a992-32070d237064> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:31:38 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:31:38 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'vcpu_model' on Instance uuid e748e6b1-72d5-4832-a992-32070d237064 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.objects.base [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Object Instance<e748e6b1-72d5-4832-a992-32070d237064> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:28:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-669113886',display_name='tempest-ServerRescueNegativeTestJSON-server-669113886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-669113886',id=23,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ7A+Oi05puuZCxjb1Gla62sCt0xlDzLUfOfZl8W878tAr590CUZ83zWNmE3vYrqMx0mj979VdjN3SFmuveJm926K5vLb2t3sO8Srwh2TvxN2SxREaL3Mizqc4rUoferw==',key_name='tempest-keypair-894050888',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:29:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b652c6f02780451b89d51d74178bf6c7',ramdisk_id='',reservation_id='r-dp6pivuc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2117587238',owner_user_name='tempest-ServerRescueNegativeTestJSON-2117587238-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62370747d10a420b81009d23e3ba324b',uuid=e748e6b1-72d5-4832-a992-32070d237064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "vif_mac": "fa:16:3e:80:af:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converting VIF {"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "vif_mac": "fa:16:3e:80:af:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:af:55,bridge_name='br-int',has_traffic_filtering=True,id=b75891ea-8201-4c0f-a203-ef383b64938b,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb75891ea-82') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'pci_devices' on Instance uuid e748e6b1-72d5-4832-a992-32070d237064 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.objects.base [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Object Instance<e748e6b1-72d5-4832-a992-32070d237064> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:31:38 user nova-compute[74630]:   <uuid>e748e6b1-72d5-4832-a992-32070d237064</uuid>
Oct 26 03:31:38 user nova-compute[74630]:   <name>instance-00000017</name>
Oct 26 03:31:38 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:31:38 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:31:38 user nova-compute[74630]:   <metadata>
Oct 26 03:31:38 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:31:38 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:31:38 user nova-compute[74630]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-669113886</nova:name>
Oct 26 03:31:38 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:31:38</nova:creationTime>
Oct 26 03:31:38 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:31:38 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:31:38 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:31:38 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:31:38 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:31:38 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:31:38 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:31:38 user nova-compute[74630]:       <nova:owner>
Oct 26 03:31:38 user nova-compute[74630]:         <nova:user uuid="62370747d10a420b81009d23e3ba324b">tempest-ServerRescueNegativeTestJSON-2117587238-project-member</nova:user>
Oct 26 03:31:38 user nova-compute[74630]:         <nova:project uuid="b652c6f02780451b89d51d74178bf6c7">tempest-ServerRescueNegativeTestJSON-2117587238</nova:project>
Oct 26 03:31:38 user nova-compute[74630]:       </nova:owner>
Oct 26 03:31:38 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:31:38 user nova-compute[74630]:       <nova:ports>
Oct 26 03:31:38 user nova-compute[74630]:         <nova:port uuid="b75891ea-8201-4c0f-a203-ef383b64938b">
Oct 26 03:31:38 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 03:31:38 user nova-compute[74630]:         </nova:port>
Oct 26 03:31:38 user nova-compute[74630]:       </nova:ports>
Oct 26 03:31:38 user nova-compute[74630]:     </nova:instance>
Oct 26 03:31:38 user nova-compute[74630]:   </metadata>
Oct 26 03:31:38 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:31:38 user nova-compute[74630]:     <system>
Oct 26 03:31:38 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:31:38 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:31:38 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:31:38 user nova-compute[74630]:       <entry name="serial">e748e6b1-72d5-4832-a992-32070d237064</entry>
Oct 26 03:31:38 user nova-compute[74630]:       <entry name="uuid">e748e6b1-72d5-4832-a992-32070d237064</entry>
Oct 26 03:31:38 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:31:38 user nova-compute[74630]:     </system>
Oct 26 03:31:38 user nova-compute[74630]:   </sysinfo>
Oct 26 03:31:38 user nova-compute[74630]:   <os>
Oct 26 03:31:38 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:31:38 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:31:38 user nova-compute[74630]:   </os>
Oct 26 03:31:38 user nova-compute[74630]:   <features>
Oct 26 03:31:38 user nova-compute[74630]:     <acpi/>
Oct 26 03:31:38 user nova-compute[74630]:     <apic/>
Oct 26 03:31:38 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:31:38 user nova-compute[74630]:   </features>
Oct 26 03:31:38 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:31:38 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:31:38 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:31:38 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:31:38 user nova-compute[74630]:   </clock>
Oct 26 03:31:38 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:31:38 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:31:38 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:31:38 user nova-compute[74630]:   </cpu>
Oct 26 03:31:38 user nova-compute[74630]:   <devices>
Oct 26 03:31:38 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:31:38 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:31:38 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.rescue"/>
Oct 26 03:31:38 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:31:38 user nova-compute[74630]:     </disk>
Oct 26 03:31:38 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:31:38 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:31:38 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk"/>
Oct 26 03:31:38 user nova-compute[74630]:       <target dev="vdb" bus="virtio"/>
Oct 26 03:31:38 user nova-compute[74630]:     </disk>
Oct 26 03:31:38 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:31:38 user nova-compute[74630]:       <mac address="fa:16:3e:80:af:55"/>
Oct 26 03:31:38 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:31:38 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:31:38 user nova-compute[74630]:       <target dev="tapb75891ea-82"/>
Oct 26 03:31:38 user nova-compute[74630]:     </interface>
Oct 26 03:31:38 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:31:38 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/console.log" append="off"/>
Oct 26 03:31:38 user nova-compute[74630]:     </serial>
Oct 26 03:31:38 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:31:38 user nova-compute[74630]:     <video>
Oct 26 03:31:38 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:31:38 user nova-compute[74630]:     </video>
Oct 26 03:31:38 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:31:38 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:31:38 user nova-compute[74630]:     </rng>
Oct 26 03:31:38 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:31:38 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:31:38 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:31:38 user nova-compute[74630]:     </memballoon>
Oct 26 03:31:38 user nova-compute[74630]:   </devices>
Oct 26 03:31:38 user nova-compute[74630]: </domain>
Oct 26 03:31:38 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:31:38 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: e748e6b1-72d5-4832-a992-32070d237064] Instance destroyed successfully.
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:31:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] No VIF found with MAC fa:16:3e:80:af:55, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:31:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-229f2f57-7807-4184-9e35-a49b1a496828 req-50b7694c-1564-4471-98de-5b1dba2b10eb service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-229f2f57-7807-4184-9e35-a49b1a496828 req-50b7694c-1564-4471-98de-5b1dba2b10eb service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-229f2f57-7807-4184-9e35-a49b1a496828 req-50b7694c-1564-4471-98de-5b1dba2b10eb service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-229f2f57-7807-4184-9e35-a49b1a496828 req-50b7694c-1564-4471-98de-5b1dba2b10eb service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-229f2f57-7807-4184-9e35-a49b1a496828 req-50b7694c-1564-4471-98de-5b1dba2b10eb service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:31:40 user nova-compute[74630]: WARNING nova.compute.manager [req-229f2f57-7807-4184-9e35-a49b1a496828 req-50b7694c-1564-4471-98de-5b1dba2b10eb service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state active and task_state rescuing.
Oct 26 03:31:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-4027472f-8a5a-482b-85ce-20e54f094f83 req-b34d3dec-6138-4ff5-b02f-41d3978475e8 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4027472f-8a5a-482b-85ce-20e54f094f83 req-b34d3dec-6138-4ff5-b02f-41d3978475e8 service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4027472f-8a5a-482b-85ce-20e54f094f83 req-b34d3dec-6138-4ff5-b02f-41d3978475e8 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4027472f-8a5a-482b-85ce-20e54f094f83 req-b34d3dec-6138-4ff5-b02f-41d3978475e8 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-4027472f-8a5a-482b-85ce-20e54f094f83 req-b34d3dec-6138-4ff5-b02f-41d3978475e8 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:31:42 user nova-compute[74630]: WARNING nova.compute.manager [req-4027472f-8a5a-482b-85ce-20e54f094f83 req-b34d3dec-6138-4ff5-b02f-41d3978475e8 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state active and task_state rescuing.
Oct 26 03:31:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-4027472f-8a5a-482b-85ce-20e54f094f83 req-b34d3dec-6138-4ff5-b02f-41d3978475e8 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4027472f-8a5a-482b-85ce-20e54f094f83 req-b34d3dec-6138-4ff5-b02f-41d3978475e8 service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4027472f-8a5a-482b-85ce-20e54f094f83 req-b34d3dec-6138-4ff5-b02f-41d3978475e8 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4027472f-8a5a-482b-85ce-20e54f094f83 req-b34d3dec-6138-4ff5-b02f-41d3978475e8 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-4027472f-8a5a-482b-85ce-20e54f094f83 req-b34d3dec-6138-4ff5-b02f-41d3978475e8 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:31:42 user nova-compute[74630]: WARNING nova.compute.manager [req-4027472f-8a5a-482b-85ce-20e54f094f83 req-b34d3dec-6138-4ff5-b02f-41d3978475e8 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state active and task_state rescuing.
Oct 26 03:31:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ce5336ec-0083-420e-a65d-5112f396f327 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:31:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "f5441872-864e-44d9-8632-e05c5d71bd90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f5441872-864e-44d9-8632-e05c5d71bd90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:51 user nova-compute[74630]: INFO nova.compute.manager [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Terminating instance
Oct 26 03:31:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:51 user nova-compute[74630]: INFO nova.compute.manager [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Terminating instance
Oct 26 03:31:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-c96d9b13-ad3e-4f3a-acf6-642ed75a6098 req-fb8a5871-4810-4b7c-918f-1630d9f571dd service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received event network-vif-unplugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c96d9b13-ad3e-4f3a-acf6-642ed75a6098 req-fb8a5871-4810-4b7c-918f-1630d9f571dd service nova] Acquiring lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c96d9b13-ad3e-4f3a-acf6-642ed75a6098 req-fb8a5871-4810-4b7c-918f-1630d9f571dd service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c96d9b13-ad3e-4f3a-acf6-642ed75a6098 req-fb8a5871-4810-4b7c-918f-1630d9f571dd service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-c96d9b13-ad3e-4f3a-acf6-642ed75a6098 req-fb8a5871-4810-4b7c-918f-1630d9f571dd service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] No waiting events found dispatching network-vif-unplugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-c96d9b13-ad3e-4f3a-acf6-642ed75a6098 req-fb8a5871-4810-4b7c-918f-1630d9f571dd service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received event network-vif-unplugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Instance destroyed successfully.
Oct 26 03:31:52 user nova-compute[74630]: DEBUG nova.objects.instance [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lazy-loading 'resources' on Instance uuid 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:31:52 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Instance destroyed successfully.
Oct 26 03:31:52 user nova-compute[74630]: DEBUG nova.objects.instance [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lazy-loading 'resources' on Instance uuid f5441872-864e-44d9-8632-e05c5d71bd90 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T03:26:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-593771189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-415578365',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJud6mpHVea5l3TmFMj7TUo36YSkBpoQyMbTjtpYD/dGU90azzgcRr8MHCroAaS2zs20gbK6yileVVDApGs2uHRxNL2W5M/4qgb3zIJ0sK0u5dluv9CMLCmmumrj5e/PUA==',key_name='tempest-keypair-1033500048',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:30:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9079bef72e74a65956113a03d158599',ramdisk_id='',reservation_id='r-ye3e7o2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-310127885',owner_user_name='tempest-ServerActionsV293TestJSON-310127885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:30:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61f0a167683a42fcacac8fd8532812ba',uuid=90dc2dc2-0ea2-4a8c-b4c9-794523df32f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Converting VIF {"id": "3918526e-3b7f-40b0-a4fa-e3960470392b", "address": "fa:16:3e:26:dc:ae", "network": {"id": "9282a8c0-6bcd-433f-a357-1c399e425972", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1985317527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9079bef72e74a65956113a03d158599", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3918526e-3b", "ovs_interfaceid": "3918526e-3b7f-40b0-a4fa-e3960470392b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:dc:ae,bridge_name='br-int',has_traffic_filtering=True,id=3918526e-3b7f-40b0-a4fa-e3960470392b,network=Network(9282a8c0-6bcd-433f-a357-1c399e425972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3918526e-3b') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG os_vif [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:dc:ae,bridge_name='br-int',has_traffic_filtering=True,id=3918526e-3b7f-40b0-a4fa-e3960470392b,network=Network(9282a8c0-6bcd-433f-a357-1c399e425972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3918526e-3b') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T03:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-408750285',display_name='tempest-ServerActionsTestOtherA-server-1153489039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-408750285',id=15,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRQj+j0h8s5l5/c9Kzf5LlZUmn49bhrlJ3uSCaWTItfHpDtTlIsJ4WHGZJvTY9PtPQoKpGGVmQzLPcnzgoq3B+7cpI6c0xMS0qeeWXVorHztRqAqFqwFVzyTc7R0LLXqA==',key_name='tempest-keypair-1000691134',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:28:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51542ffdf7a84ac5a61f14e124eb2087',ramdisk_id='',reservation_id='r-6oe0n30b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-41539930',owner_user_name='tempest-ServerActionsTestOtherA-41539930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:28:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a419737713f4797ab27db62d5aa746c',uuid=f5441872-864e-44d9-8632-e05c5d71bd90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converting VIF {"id": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "address": "fa:16:3e:3d:9b:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd088cb-2d", "ovs_interfaceid": "add088cb-2d9c-4ad2-a72b-64f1138ddfa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:9b:96,bridge_name='br-int',has_traffic_filtering=True,id=add088cb-2d9c-4ad2-a72b-64f1138ddfa2,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd088cb-2d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG os_vif [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:9b:96,bridge_name='br-int',has_traffic_filtering=True,id=add088cb-2d9c-4ad2-a72b-64f1138ddfa2,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd088cb-2d') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3918526e-3b, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadd088cb-2d, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ce2d7b3-c11d-4979-a11b-2135142391ba) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8597558d-31dc-42e3-b955-c19d112e649b) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: INFO os_vif [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:dc:ae,bridge_name='br-int',has_traffic_filtering=True,id=3918526e-3b7f-40b0-a4fa-e3960470392b,network=Network(9282a8c0-6bcd-433f-a357-1c399e425972),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3918526e-3b')
Oct 26 03:31:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxqRWiIC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:31:52 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:31:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:31:52 user nova-compute[74630]: INFO os_vif [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:9b:96,bridge_name='br-int',has_traffic_filtering=True,id=add088cb-2d9c-4ad2-a72b-64f1138ddfa2,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd088cb-2d')
Oct 26 03:31:52 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Deleting instance files /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90_del
Oct 26 03:31:52 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Deletion of /opt/stack/data/nova/instances/f5441872-864e-44d9-8632-e05c5d71bd90_del complete
Oct 26 03:31:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc2627b-75ae-41cb-844f-b3411ee12a45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:31:52 user nova-compute[74630]: No targets found.
Oct 26 03:31:52 user nova-compute[74630]: iSNS:
Oct 26 03:31:52 user nova-compute[74630]: No targets found.
Oct 26 03:31:52 user nova-compute[74630]: STATIC:
Oct 26 03:31:52 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:31:52 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:31:52 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:31:52 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550
Oct 26 03:31:52 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:31:52 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:31:52 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b
Oct 26 03:31:52 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:31:52 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:31:52 user nova-compute[74630]: FIRMWARE:
Oct 26 03:31:52 user nova-compute[74630]: No targets found.
Oct 26 03:31:52 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:31:52 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:31:52 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a16f27-55ca-4f83-880a-5815a7b3e836]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[745837a4-286c-4a12-957c-9fc45d8037d5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:31:52 user nova-compute[74630]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:31:52 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:31:52 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:31:52 user nova-compute[74630]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 (non-flash)
Oct 26 03:31:52 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:31:52 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c280b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550'): ({'sdc'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Removing single pathed devices sdc {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:52 user nova-compute[74630]: INFO nova.compute.manager [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Took 1.62 seconds to destroy the instance on the hypervisor.
Oct 26 03:31:52 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.044s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5026536d-2134-4094-be6a-ffab005f40bd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[65af1500-d4ec-4912-84ad-f12594df89ce]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Flushing IO for device /dev/sdc {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cbabe8-f65d-4b24-9513-8d6af4768aa6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.072s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c403a04-f84e-4b7e-9b9f-aaacd14609e4]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23165333036653935', '/dev/disk/by-id/scsi-1SCST_BIO41d656f8-1e306e9519686997', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_41d656f8') {{(pid=86251) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cafd24d-8971-4dfc-8188-0af38da0f39d]: (4, None) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc288cb-af0b-40f2-a4cc-31b80339d1a5]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[783c7d85-55d0-468d-9f72-6460a6f4a225]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260]
Oct 26 03:31:53 user nova-compute[74630]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550, portal: 172.16.0.220,3260] successful.
Oct 26 03:31:53 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba36f137-d667-483f-9b08-7b0193c3f550 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a48af9-c6ec-400a-9562-a1bb3ebf785c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] <== disconnect_volume: return (476ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:31:53 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Deleting instance files /opt/stack/data/nova/instances/90dc2dc2-0ea2-4a8c-b4c9-794523df32f0_del
Oct 26 03:31:53 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Deletion of /opt/stack/data/nova/instances/90dc2dc2-0ea2-4a8c-b4c9-794523df32f0_del complete
Oct 26 03:31:53 user nova-compute[74630]: INFO nova.compute.manager [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Took 1.63 seconds to destroy the instance on the hypervisor.
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG nova.compute.manager [req-58b2a8e0-bb91-474b-971e-477b8996f8d2 req-f3749602-5191-441d-a128-d8f5a087cace service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received event network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-58b2a8e0-bb91-474b-971e-477b8996f8d2 req-f3749602-5191-441d-a128-d8f5a087cace service nova] Acquiring lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-58b2a8e0-bb91-474b-971e-477b8996f8d2 req-f3749602-5191-441d-a128-d8f5a087cace service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-58b2a8e0-bb91-474b-971e-477b8996f8d2 req-f3749602-5191-441d-a128-d8f5a087cace service nova] Lock "f5441872-864e-44d9-8632-e05c5d71bd90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:53 user nova-compute[74630]: DEBUG nova.compute.manager [req-58b2a8e0-bb91-474b-971e-477b8996f8d2 req-f3749602-5191-441d-a128-d8f5a087cace service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] No waiting events found dispatching network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:31:53 user nova-compute[74630]: WARNING nova.compute.manager [req-58b2a8e0-bb91-474b-971e-477b8996f8d2 req-f3749602-5191-441d-a128-d8f5a087cace service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received unexpected event network-vif-plugged-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 for instance with vm_state active and task_state deleting.
Oct 26 03:31:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-13eea523-7fe0-4478-90cf-8358845154e2 req-f97438fd-acee-49b1-a51d-d251b55278cb service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received event network-vif-unplugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-13eea523-7fe0-4478-90cf-8358845154e2 req-f97438fd-acee-49b1-a51d-d251b55278cb service nova] Acquiring lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-13eea523-7fe0-4478-90cf-8358845154e2 req-f97438fd-acee-49b1-a51d-d251b55278cb service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-13eea523-7fe0-4478-90cf-8358845154e2 req-f97438fd-acee-49b1-a51d-d251b55278cb service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-13eea523-7fe0-4478-90cf-8358845154e2 req-f97438fd-acee-49b1-a51d-d251b55278cb service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] No waiting events found dispatching network-vif-unplugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:31:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-13eea523-7fe0-4478-90cf-8358845154e2 req-f97438fd-acee-49b1-a51d-d251b55278cb service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received event network-vif-unplugged-3918526e-3b7f-40b0-a4fa-e3960470392b for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:31:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "0be74854-6a07-4468-bf1c-c41066af14c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:31:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:31:56 user nova-compute[74630]: INFO nova.compute.claims [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Claim successful on node user
Oct 26 03:31:56 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:31:56 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Took 3.28 seconds to deallocate network for instance.
Oct 26 03:31:56 user nova-compute[74630]: DEBUG nova.compute.manager [req-8e68e114-4e30-4baa-8327-b46987c71889 req-c991a714-46d9-4180-8e5a-273aea1d9a3b service nova] [instance: f5441872-864e-44d9-8632-e05c5d71bd90] Received event network-vif-deleted-add088cb-2d9c-4ad2-a72b-64f1138ddfa2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:56 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:31:56 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:31:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.666s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:31:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.477s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:31:56 user nova-compute[74630]: DEBUG nova.network.neutron [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:31:56 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:31:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:31:57 user nova-compute[74630]: INFO nova.virt.block_device [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Booting with volume-backed-image 8519fea8-ccda-4565-9023-82b90e4bb746 at /dev/vda
Oct 26 03:31:57 user nova-compute[74630]: DEBUG nova.compute.manager [req-d54ef6c0-1afb-4a87-8742-fed089a371f5 req-68f67b25-2345-4fac-90f1-5f1c96882541 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received event network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d54ef6c0-1afb-4a87-8742-fed089a371f5 req-68f67b25-2345-4fac-90f1-5f1c96882541 service nova] Acquiring lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:31:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d54ef6c0-1afb-4a87-8742-fed089a371f5 req-68f67b25-2345-4fac-90f1-5f1c96882541 service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:31:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d54ef6c0-1afb-4a87-8742-fed089a371f5 req-68f67b25-2345-4fac-90f1-5f1c96882541 service nova] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:57 user nova-compute[74630]: DEBUG nova.compute.manager [req-d54ef6c0-1afb-4a87-8742-fed089a371f5 req-68f67b25-2345-4fac-90f1-5f1c96882541 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] No waiting events found dispatching network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:31:57 user nova-compute[74630]: WARNING nova.compute.manager [req-d54ef6c0-1afb-4a87-8742-fed089a371f5 req-68f67b25-2345-4fac-90f1-5f1c96882541 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received unexpected event network-vif-plugged-3918526e-3b7f-40b0-a4fa-e3960470392b for instance with vm_state active and task_state deleting.
Oct 26 03:31:57 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:31:57 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:31:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.594s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:57 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Deleted allocations for instance f5441872-864e-44d9-8632-e05c5d71bd90
Oct 26 03:31:57 user nova-compute[74630]: DEBUG nova.policy [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8694c5db6e34f1e88595b55f8e5fe70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e396316ddc243c594c29f5c434501cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:31:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1e565283-c4fb-41d5-aead-54ecaf84726f tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f5441872-864e-44d9-8632-e05c5d71bd90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.321s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:31:57 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:31:57 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Took 4.39 seconds to deallocate network for instance.
Oct 26 03:31:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-9115b432-d66c-4ce8-8aab-4a10f2c15883 req-ff484969-003a-47d8-96e8-1246d3919aa9 service nova] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Received event network-vif-deleted-3918526e-3b7f-40b0-a4fa-e3960470392b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:31:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:31:59 user nova-compute[74630]: DEBUG nova.network.neutron [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Successfully created port: 81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Successfully updated port: 81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "refresh_cache-0be74854-6a07-4468-bf1c-c41066af14c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquired lock "refresh_cache-0be74854-6a07-4468-bf1c-c41066af14c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-5848672e-d56e-48c0-bcba-92f680bdc1fe req-167d75ea-c8df-43eb-8ec0-ff1c895d574e service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received event network-changed-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-5848672e-d56e-48c0-bcba-92f680bdc1fe req-167d75ea-c8df-43eb-8ec0-ff1c895d574e service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Refreshing instance network info cache due to event network-changed-81e27221-96a7-4492-b72b-a0ed4f496f09. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5848672e-d56e-48c0-bcba-92f680bdc1fe req-167d75ea-c8df-43eb-8ec0-ff1c895d574e service nova] Acquiring lock "refresh_cache-0be74854-6a07-4468-bf1c-c41066af14c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Updating instance_info_cache with network_info: [{"id": "81e27221-96a7-4492-b72b-a0ed4f496f09", "address": "fa:16:3e:21:e1:c5", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e27221-96", "ovs_interfaceid": "81e27221-96a7-4492-b72b-a0ed4f496f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Releasing lock "refresh_cache-0be74854-6a07-4468-bf1c-c41066af14c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Instance network_info: |[{"id": "81e27221-96a7-4492-b72b-a0ed4f496f09", "address": "fa:16:3e:21:e1:c5", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e27221-96", "ovs_interfaceid": "81e27221-96a7-4492-b72b-a0ed4f496f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5848672e-d56e-48c0-bcba-92f680bdc1fe req-167d75ea-c8df-43eb-8ec0-ff1c895d574e service nova] Acquired lock "refresh_cache-0be74854-6a07-4468-bf1c-c41066af14c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG nova.network.neutron [req-5848672e-d56e-48c0-bcba-92f680bdc1fe req-167d75ea-c8df-43eb-8ec0-ff1c895d574e service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Refreshing network info cache for port 81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:32:00 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:32:00 user nova-compute[74630]: INFO nova.compute.claims [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Claim successful on node user
Oct 26 03:32:01 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:32:01 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:32:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.741s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:32:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:32:01 user nova-compute[74630]: DEBUG nova.network.neutron [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:32:01 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:32:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:32:01 user nova-compute[74630]: DEBUG nova.policy [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ac12db50b4d49068be8b20c4ea28651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400857740007472cb751dac6b40d881e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:32:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:32:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:32:01 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Creating image(s)
Oct 26 03:32:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "/opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "/opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-5848672e-d56e-48c0-bcba-92f680bdc1fe req-167d75ea-c8df-43eb-8ec0-ff1c895d574e service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Updated VIF entry in instance network info cache for port 81e27221-96a7-4492-b72b-a0ed4f496f09. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:32:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-5848672e-d56e-48c0-bcba-92f680bdc1fe req-167d75ea-c8df-43eb-8ec0-ff1c895d574e service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Updating instance_info_cache with network_info: [{"id": "81e27221-96a7-4492-b72b-a0ed4f496f09", "address": "fa:16:3e:21:e1:c5", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e27221-96", "ovs_interfaceid": "81e27221-96a7-4492-b72b-a0ed4f496f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:32:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5848672e-d56e-48c0-bcba-92f680bdc1fe req-167d75ea-c8df-43eb-8ec0-ff1c895d574e service nova] Releasing lock "refresh_cache-0be74854-6a07-4468-bf1c-c41066af14c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.182s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk 1073741824" returned: 0 in 0.046s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.203s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Successfully created port: 02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Cannot resize image /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Ensure instance console log exists: /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:02 user nova-compute[74630]: INFO nova.compute.manager [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Took 5.07 seconds to detach 1 volumes for instance.
Oct 26 03:32:02 user nova-compute[74630]: DEBUG nova.compute.manager [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] [instance: 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0] Deleting volume: ba36f137-d667-483f-9b08-7b0193c3f550 {{(pid=74630) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.network.neutron [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Successfully updated port: 02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquired lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.network.neutron [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-ffb5abce-7bf3-48fb-b07f-6998537df9e7 req-08099ac7-54e8-436d-a0a0-8fbea4110b2c service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-changed-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-ffb5abce-7bf3-48fb-b07f-6998537df9e7 req-08099ac7-54e8-436d-a0a0-8fbea4110b2c service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Refreshing instance network info cache due to event network-changed-02a0e249-0a94-475c-9754-2834697559c2. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ffb5abce-7bf3-48fb-b07f-6998537df9e7 req-08099ac7-54e8-436d-a0a0-8fbea4110b2c service nova] Acquiring lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.network.neutron [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.591s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:03 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Deleted allocations for instance 90dc2dc2-0ea2-4a8c-b4c9-794523df32f0
Oct 26 03:32:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56acb56f-2d79-4ff3-9c7d-8ca20ea3b85f tempest-ServerActionsV293TestJSON-310127885 tempest-ServerActionsV293TestJSON-310127885-project-member] Lock "90dc2dc2-0ea2-4a8c-b4c9-794523df32f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.971s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.network.neutron [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Updating instance_info_cache with network_info: [{"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Releasing lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.compute.manager [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Instance network_info: |[{"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ffb5abce-7bf3-48fb-b07f-6998537df9e7 req-08099ac7-54e8-436d-a0a0-8fbea4110b2c service nova] Acquired lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.network.neutron [req-ffb5abce-7bf3-48fb-b07f-6998537df9e7 req-08099ac7-54e8-436d-a0a0-8fbea4110b2c service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Refreshing network info cache for port 02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Start _get_guest_xml network_info=[{"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:32:03 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:32:03 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1868004368',display_name='tempest-ServerStableDeviceRescueTest-server-1868004368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1868004368',id=28,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFC6NXMSPyyw1g6+xSeE/vl9+H/GvU/He8VS7Yjec0ZqF+S6tvl0L4Bk1vv8WgmPnj146MkMUEtWtP4csR+EGR8rXD4vtkUnhByB4CIzoqcFtEPCAqMZloduZRLpZTLz+A==',key_name='tempest-keypair-533323538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='400857740007472cb751dac6b40d881e',ramdisk_id='',reservation_id='r-4nompxck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1839582341',owner_user_name='tempest-ServerStableDeviceRescueTest-1839582341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:32:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ac12db50b4d49068be8b20c4ea28651',uuid=6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Converting VIF {"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:15:28,bridge_name='br-int',has_traffic_filtering=True,id=02a0e249-0a94-475c-9754-2834697559c2,network=Network(14b85bdb-a349-4db4-8fd4-dada8a2eb901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a0e249-0a') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.objects.instance [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:32:03 user nova-compute[74630]:   <uuid>6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9</uuid>
Oct 26 03:32:03 user nova-compute[74630]:   <name>instance-0000001c</name>
Oct 26 03:32:03 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:32:03 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:32:03 user nova-compute[74630]:   <metadata>
Oct 26 03:32:03 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:32:03 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:32:03 user nova-compute[74630]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1868004368</nova:name>
Oct 26 03:32:03 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:32:03</nova:creationTime>
Oct 26 03:32:03 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:32:03 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:32:03 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:32:03 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:32:03 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:32:03 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:32:03 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:32:03 user nova-compute[74630]:       <nova:owner>
Oct 26 03:32:03 user nova-compute[74630]:         <nova:user uuid="6ac12db50b4d49068be8b20c4ea28651">tempest-ServerStableDeviceRescueTest-1839582341-project-member</nova:user>
Oct 26 03:32:03 user nova-compute[74630]:         <nova:project uuid="400857740007472cb751dac6b40d881e">tempest-ServerStableDeviceRescueTest-1839582341</nova:project>
Oct 26 03:32:03 user nova-compute[74630]:       </nova:owner>
Oct 26 03:32:03 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:32:03 user nova-compute[74630]:       <nova:ports>
Oct 26 03:32:03 user nova-compute[74630]:         <nova:port uuid="02a0e249-0a94-475c-9754-2834697559c2">
Oct 26 03:32:03 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 03:32:03 user nova-compute[74630]:         </nova:port>
Oct 26 03:32:03 user nova-compute[74630]:       </nova:ports>
Oct 26 03:32:03 user nova-compute[74630]:     </nova:instance>
Oct 26 03:32:03 user nova-compute[74630]:   </metadata>
Oct 26 03:32:03 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:32:03 user nova-compute[74630]:     <system>
Oct 26 03:32:03 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:32:03 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:32:03 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:32:03 user nova-compute[74630]:       <entry name="serial">6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9</entry>
Oct 26 03:32:03 user nova-compute[74630]:       <entry name="uuid">6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9</entry>
Oct 26 03:32:03 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:32:03 user nova-compute[74630]:     </system>
Oct 26 03:32:03 user nova-compute[74630]:   </sysinfo>
Oct 26 03:32:03 user nova-compute[74630]:   <os>
Oct 26 03:32:03 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:32:03 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:32:03 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:32:03 user nova-compute[74630]:   </os>
Oct 26 03:32:03 user nova-compute[74630]:   <features>
Oct 26 03:32:03 user nova-compute[74630]:     <acpi/>
Oct 26 03:32:03 user nova-compute[74630]:     <apic/>
Oct 26 03:32:03 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:32:03 user nova-compute[74630]:   </features>
Oct 26 03:32:03 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:32:03 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:32:03 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:32:03 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:32:03 user nova-compute[74630]:   </clock>
Oct 26 03:32:03 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:32:03 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:32:03 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:32:03 user nova-compute[74630]:   </cpu>
Oct 26 03:32:03 user nova-compute[74630]:   <devices>
Oct 26 03:32:03 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:32:03 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:32:03 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk"/>
Oct 26 03:32:03 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:32:03 user nova-compute[74630]:     </disk>
Oct 26 03:32:03 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:32:03 user nova-compute[74630]:       <mac address="fa:16:3e:22:15:28"/>
Oct 26 03:32:03 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:32:03 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:32:03 user nova-compute[74630]:       <target dev="tap02a0e249-0a"/>
Oct 26 03:32:03 user nova-compute[74630]:     </interface>
Oct 26 03:32:03 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:32:03 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/console.log" append="off"/>
Oct 26 03:32:03 user nova-compute[74630]:     </serial>
Oct 26 03:32:03 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:32:03 user nova-compute[74630]:     <video>
Oct 26 03:32:03 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:32:03 user nova-compute[74630]:     </video>
Oct 26 03:32:03 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:32:03 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:32:03 user nova-compute[74630]:     </rng>
Oct 26 03:32:03 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:32:03 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:32:03 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:32:03 user nova-compute[74630]:     </memballoon>
Oct 26 03:32:03 user nova-compute[74630]:   </devices>
Oct 26 03:32:03 user nova-compute[74630]: </domain>
Oct 26 03:32:03 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1868004368',display_name='tempest-ServerStableDeviceRescueTest-server-1868004368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1868004368',id=28,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFC6NXMSPyyw1g6+xSeE/vl9+H/GvU/He8VS7Yjec0ZqF+S6tvl0L4Bk1vv8WgmPnj146MkMUEtWtP4csR+EGR8rXD4vtkUnhByB4CIzoqcFtEPCAqMZloduZRLpZTLz+A==',key_name='tempest-keypair-533323538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='400857740007472cb751dac6b40d881e',ramdisk_id='',reservation_id='r-4nompxck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1839582341',owner_user_name='tempest-ServerStableDeviceRescueTest-1839582341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:32:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ac12db50b4d49068be8b20c4ea28651',uuid=6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Converting VIF {"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:15:28,bridge_name='br-int',has_traffic_filtering=True,id=02a0e249-0a94-475c-9754-2834697559c2,network=Network(14b85bdb-a349-4db4-8fd4-dada8a2eb901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a0e249-0a') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG os_vif [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:15:28,bridge_name='br-int',has_traffic_filtering=True,id=02a0e249-0a94-475c-9754-2834697559c2,network=Network(14b85bdb-a349-4db4-8fd4-dada8a2eb901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a0e249-0a') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3665ea45-8448-5faf-a4e9-d631a2d155cc', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02a0e249-0a, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02a0e249-0a, col_values=(('qos', UUID('9f42d993-fb45-4e87-a282-947e305a63f9')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02a0e249-0a, col_values=(('external_ids', {'iface-id': '02a0e249-0a94-475c-9754-2834697559c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:15:28', 'vm-uuid': '6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:32:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:04 user nova-compute[74630]: INFO os_vif [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:15:28,bridge_name='br-int',has_traffic_filtering=True,id=02a0e249-0a94-475c-9754-2834697559c2,network=Network(14b85bdb-a349-4db4-8fd4-dada8a2eb901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a0e249-0a')
Oct 26 03:32:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:32:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] No VIF found with MAC fa:16:3e:22:15:28, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:32:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-ffb5abce-7bf3-48fb-b07f-6998537df9e7 req-08099ac7-54e8-436d-a0a0-8fbea4110b2c service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Updated VIF entry in instance network info cache for port 02a0e249-0a94-475c-9754-2834697559c2. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:32:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-ffb5abce-7bf3-48fb-b07f-6998537df9e7 req-08099ac7-54e8-436d-a0a0-8fbea4110b2c service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Updating instance_info_cache with network_info: [{"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:32:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ffb5abce-7bf3-48fb-b07f-6998537df9e7 req-08099ac7-54e8-436d-a0a0-8fbea4110b2c service nova] Releasing lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:32:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:32:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:32:08 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Instance spawned successfully.
Oct 26 03:32:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:32:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:08 user nova-compute[74630]: INFO nova.compute.manager [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Took 6.30 seconds to spawn the instance on the hypervisor.
Oct 26 03:32:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:32:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:08 user nova-compute[74630]: INFO nova.compute.manager [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Took 7.51 seconds to build instance.
Oct 26 03:32:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-aa2164c6-f665-4bf8-839c-9155e029c7b9 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.601s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:10 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:32:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:10 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:32:10 user nova-compute[74630]: INFO nova.compute.claims [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Claim successful on node user
Oct 26 03:32:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-ce031bb0-ad0b-4ab6-a19b-622348ec5f71 req-77999045-80cb-4c7b-80ae-368e71679518 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:32:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ce031bb0-ad0b-4ab6-a19b-622348ec5f71 req-77999045-80cb-4c7b-80ae-368e71679518 service nova] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ce031bb0-ad0b-4ab6-a19b-622348ec5f71 req-77999045-80cb-4c7b-80ae-368e71679518 service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ce031bb0-ad0b-4ab6-a19b-622348ec5f71 req-77999045-80cb-4c7b-80ae-368e71679518 service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-ce031bb0-ad0b-4ab6-a19b-622348ec5f71 req-77999045-80cb-4c7b-80ae-368e71679518 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] No waiting events found dispatching network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:32:10 user nova-compute[74630]: WARNING nova.compute.manager [req-ce031bb0-ad0b-4ab6-a19b-622348ec5f71 req-77999045-80cb-4c7b-80ae-368e71679518 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received unexpected event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 for instance with vm_state active and task_state None.
Oct 26 03:32:11 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:32:11 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:32:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.274s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:32:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:32:11 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:32:11 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:32:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:32:11 user nova-compute[74630]: DEBUG nova.policy [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ecfe593558b4abc88818fd1cf7bbdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3feb502c9d64505b7fc186fbd271f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:32:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:32:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:32:11 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Creating image(s)
Oct 26 03:32:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "/opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "/opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.245s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.242s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG nova.compute.manager [req-bbaf3648-a920-4800-bb7a-1eca540e6fcc req-124ce9b9-e436-461b-a0d4-4daecefdeefb service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Received event network-changed-625775a7-bb89-41a3-80b4-1bdd23e48573 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG nova.compute.manager [req-bbaf3648-a920-4800-bb7a-1eca540e6fcc req-124ce9b9-e436-461b-a0d4-4daecefdeefb service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Refreshing instance network info cache due to event network-changed-625775a7-bb89-41a3-80b4-1bdd23e48573. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bbaf3648-a920-4800-bb7a-1eca540e6fcc req-124ce9b9-e436-461b-a0d4-4daecefdeefb service nova] Acquiring lock "refresh_cache-2176994e-875a-4a16-a317-5e8b096ad498" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bbaf3648-a920-4800-bb7a-1eca540e6fcc req-124ce9b9-e436-461b-a0d4-4daecefdeefb service nova] Acquired lock "refresh_cache-2176994e-875a-4a16-a317-5e8b096ad498" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG nova.network.neutron [req-bbaf3648-a920-4800-bb7a-1eca540e6fcc req-124ce9b9-e436-461b-a0d4-4daecefdeefb service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Refreshing network info cache for port 625775a7-bb89-41a3-80b4-1bdd23e48573 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk 1073741824" returned: 0 in 0.093s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.227s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG nova.compute.manager [req-300dff8a-0617-45f7-af70-d4ac84655eea req-d529bf0d-2b98-433c-baf4-c9fba5e63cd0 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-300dff8a-0617-45f7-af70-d4ac84655eea req-d529bf0d-2b98-433c-baf4-c9fba5e63cd0 service nova] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-300dff8a-0617-45f7-af70-d4ac84655eea req-d529bf0d-2b98-433c-baf4-c9fba5e63cd0 service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-300dff8a-0617-45f7-af70-d4ac84655eea req-d529bf0d-2b98-433c-baf4-c9fba5e63cd0 service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG nova.compute.manager [req-300dff8a-0617-45f7-af70-d4ac84655eea req-d529bf0d-2b98-433c-baf4-c9fba5e63cd0 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] No waiting events found dispatching network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:32:12 user nova-compute[74630]: WARNING nova.compute.manager [req-300dff8a-0617-45f7-af70-d4ac84655eea req-d529bf0d-2b98-433c-baf4-c9fba5e63cd0 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received unexpected event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 for instance with vm_state active and task_state None.
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Cannot resize image /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Ensure instance console log exists: /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:13 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Successfully created port: d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:32:13 user nova-compute[74630]: DEBUG nova.network.neutron [req-bbaf3648-a920-4800-bb7a-1eca540e6fcc req-124ce9b9-e436-461b-a0d4-4daecefdeefb service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Updated VIF entry in instance network info cache for port 625775a7-bb89-41a3-80b4-1bdd23e48573. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:32:13 user nova-compute[74630]: DEBUG nova.network.neutron [req-bbaf3648-a920-4800-bb7a-1eca540e6fcc req-124ce9b9-e436-461b-a0d4-4daecefdeefb service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Updating instance_info_cache with network_info: [{"id": "625775a7-bb89-41a3-80b4-1bdd23e48573", "address": "fa:16:3e:92:75:eb", "network": {"id": "1854c96b-487b-41d7-b6b9-a43a6e98588f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1416087294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df98bab6a84d40edaba8d23037a97c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625775a7-bb", "ovs_interfaceid": "625775a7-bb89-41a3-80b4-1bdd23e48573", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:32:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bbaf3648-a920-4800-bb7a-1eca540e6fcc req-124ce9b9-e436-461b-a0d4-4daecefdeefb service nova] Releasing lock "refresh_cache-2176994e-875a-4a16-a317-5e8b096ad498" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:32:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Successfully updated port: d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "refresh_cache-e9b77844-67a8-4c26-90f2-afc1809b33d1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquired lock "refresh_cache-e9b77844-67a8-4c26-90f2-afc1809b33d1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Updating instance_info_cache with network_info: [{"id": "d789f079-694d-48c0-91ed-ae69fa259a1a", "address": "fa:16:3e:e1:1e:5c", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd789f079-69", "ovs_interfaceid": "d789f079-694d-48c0-91ed-ae69fa259a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Releasing lock "refresh_cache-e9b77844-67a8-4c26-90f2-afc1809b33d1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Instance network_info: |[{"id": "d789f079-694d-48c0-91ed-ae69fa259a1a", "address": "fa:16:3e:e1:1e:5c", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd789f079-69", "ovs_interfaceid": "d789f079-694d-48c0-91ed-ae69fa259a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Start _get_guest_xml network_info=[{"id": "d789f079-694d-48c0-91ed-ae69fa259a1a", "address": "fa:16:3e:e1:1e:5c", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd789f079-69", "ovs_interfaceid": "d789f079-694d-48c0-91ed-ae69fa259a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:32:14 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:32:14 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-178489544',display_name='tempest-TestStampPattern-server-178489544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-178489544',id=29,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsUi1JFav2rUQ4amatuW91o6BTV1PUkbeAhUKUE9hmgaI99WgwyETHpA4Y+2RpaoFdsnsCe7I0YgyLj8QbS8GQub3NG5km5MaVTjvf64ODji9wzJUh+5eSPSYEe519qTQ==',key_name='tempest-TestStampPattern-1907926505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3feb502c9d64505b7fc186fbd271f98',ramdisk_id='',reservation_id='r-u4sc53qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1086414073',owner_user_name='tempest-TestStampPattern-1086414073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:32:12Z,user_data=None,user_id='2ecfe593558b4abc88818fd1cf7bbdb8',uuid=e9b77844-67a8-4c26-90f2-afc1809b33d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d789f079-694d-48c0-91ed-ae69fa259a1a", "address": "fa:16:3e:e1:1e:5c", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd789f079-69", "ovs_interfaceid": "d789f079-694d-48c0-91ed-ae69fa259a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Converting VIF {"id": "d789f079-694d-48c0-91ed-ae69fa259a1a", "address": "fa:16:3e:e1:1e:5c", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd789f079-69", "ovs_interfaceid": "d789f079-694d-48c0-91ed-ae69fa259a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=d789f079-694d-48c0-91ed-ae69fa259a1a,network=Network(2b989db0-17d0-4283-a2c4-84f29f5cf56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd789f079-69') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lazy-loading 'pci_devices' on Instance uuid e9b77844-67a8-4c26-90f2-afc1809b33d1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:32:14 user nova-compute[74630]:   <uuid>e9b77844-67a8-4c26-90f2-afc1809b33d1</uuid>
Oct 26 03:32:14 user nova-compute[74630]:   <name>instance-0000001d</name>
Oct 26 03:32:14 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:32:14 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:32:14 user nova-compute[74630]:   <metadata>
Oct 26 03:32:14 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:32:14 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:32:14 user nova-compute[74630]:       <nova:name>tempest-TestStampPattern-server-178489544</nova:name>
Oct 26 03:32:14 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:32:14</nova:creationTime>
Oct 26 03:32:14 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:32:14 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:32:14 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:32:14 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:32:14 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:32:14 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:32:14 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:32:14 user nova-compute[74630]:       <nova:owner>
Oct 26 03:32:14 user nova-compute[74630]:         <nova:user uuid="2ecfe593558b4abc88818fd1cf7bbdb8">tempest-TestStampPattern-1086414073-project-member</nova:user>
Oct 26 03:32:14 user nova-compute[74630]:         <nova:project uuid="b3feb502c9d64505b7fc186fbd271f98">tempest-TestStampPattern-1086414073</nova:project>
Oct 26 03:32:14 user nova-compute[74630]:       </nova:owner>
Oct 26 03:32:14 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:32:14 user nova-compute[74630]:       <nova:ports>
Oct 26 03:32:14 user nova-compute[74630]:         <nova:port uuid="d789f079-694d-48c0-91ed-ae69fa259a1a">
Oct 26 03:32:14 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 03:32:14 user nova-compute[74630]:         </nova:port>
Oct 26 03:32:14 user nova-compute[74630]:       </nova:ports>
Oct 26 03:32:14 user nova-compute[74630]:     </nova:instance>
Oct 26 03:32:14 user nova-compute[74630]:   </metadata>
Oct 26 03:32:14 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:32:14 user nova-compute[74630]:     <system>
Oct 26 03:32:14 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:32:14 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:32:14 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:32:14 user nova-compute[74630]:       <entry name="serial">e9b77844-67a8-4c26-90f2-afc1809b33d1</entry>
Oct 26 03:32:14 user nova-compute[74630]:       <entry name="uuid">e9b77844-67a8-4c26-90f2-afc1809b33d1</entry>
Oct 26 03:32:14 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:32:14 user nova-compute[74630]:     </system>
Oct 26 03:32:14 user nova-compute[74630]:   </sysinfo>
Oct 26 03:32:14 user nova-compute[74630]:   <os>
Oct 26 03:32:14 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:32:14 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:32:14 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:32:14 user nova-compute[74630]:   </os>
Oct 26 03:32:14 user nova-compute[74630]:   <features>
Oct 26 03:32:14 user nova-compute[74630]:     <acpi/>
Oct 26 03:32:14 user nova-compute[74630]:     <apic/>
Oct 26 03:32:14 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:32:14 user nova-compute[74630]:   </features>
Oct 26 03:32:14 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:32:14 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:32:14 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:32:14 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:32:14 user nova-compute[74630]:   </clock>
Oct 26 03:32:14 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:32:14 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:32:14 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:32:14 user nova-compute[74630]:   </cpu>
Oct 26 03:32:14 user nova-compute[74630]:   <devices>
Oct 26 03:32:14 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:32:14 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:32:14 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk"/>
Oct 26 03:32:14 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:32:14 user nova-compute[74630]:     </disk>
Oct 26 03:32:14 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:32:14 user nova-compute[74630]:       <mac address="fa:16:3e:e1:1e:5c"/>
Oct 26 03:32:14 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:32:14 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:32:14 user nova-compute[74630]:       <target dev="tapd789f079-69"/>
Oct 26 03:32:14 user nova-compute[74630]:     </interface>
Oct 26 03:32:14 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:32:14 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/console.log" append="off"/>
Oct 26 03:32:14 user nova-compute[74630]:     </serial>
Oct 26 03:32:14 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:32:14 user nova-compute[74630]:     <video>
Oct 26 03:32:14 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:32:14 user nova-compute[74630]:     </video>
Oct 26 03:32:14 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:32:14 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:32:14 user nova-compute[74630]:     </rng>
Oct 26 03:32:14 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:32:14 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:32:14 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:32:14 user nova-compute[74630]:     </memballoon>
Oct 26 03:32:14 user nova-compute[74630]:   </devices>
Oct 26 03:32:14 user nova-compute[74630]: </domain>
Oct 26 03:32:14 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-178489544',display_name='tempest-TestStampPattern-server-178489544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-178489544',id=29,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsUi1JFav2rUQ4amatuW91o6BTV1PUkbeAhUKUE9hmgaI99WgwyETHpA4Y+2RpaoFdsnsCe7I0YgyLj8QbS8GQub3NG5km5MaVTjvf64ODji9wzJUh+5eSPSYEe519qTQ==',key_name='tempest-TestStampPattern-1907926505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3feb502c9d64505b7fc186fbd271f98',ramdisk_id='',reservation_id='r-u4sc53qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1086414073',owner_user_name='tempest-TestStampPattern-1086414073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:32:12Z,user_data=None,user_id='2ecfe593558b4abc88818fd1cf7bbdb8',uuid=e9b77844-67a8-4c26-90f2-afc1809b33d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d789f079-694d-48c0-91ed-ae69fa259a1a", "address": "fa:16:3e:e1:1e:5c", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd789f079-69", "ovs_interfaceid": "d789f079-694d-48c0-91ed-ae69fa259a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Converting VIF {"id": "d789f079-694d-48c0-91ed-ae69fa259a1a", "address": "fa:16:3e:e1:1e:5c", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd789f079-69", "ovs_interfaceid": "d789f079-694d-48c0-91ed-ae69fa259a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=d789f079-694d-48c0-91ed-ae69fa259a1a,network=Network(2b989db0-17d0-4283-a2c4-84f29f5cf56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd789f079-69') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG os_vif [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=d789f079-694d-48c0-91ed-ae69fa259a1a,network=Network(2b989db0-17d0-4283-a2c4-84f29f5cf56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd789f079-69') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'acdaabc3-0502-598a-9abe-92d645d7e954', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd789f079-69, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd789f079-69, col_values=(('qos', UUID('769a2cc5-136f-4d55-a27a-429479126fd8')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd789f079-69, col_values=(('external_ids', {'iface-id': 'd789f079-694d-48c0-91ed-ae69fa259a1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:1e:5c', 'vm-uuid': 'e9b77844-67a8-4c26-90f2-afc1809b33d1'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:14 user nova-compute[74630]: INFO os_vif [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=d789f079-694d-48c0-91ed-ae69fa259a1a,network=Network(2b989db0-17d0-4283-a2c4-84f29f5cf56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd789f079-69')
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] No VIF found with MAC fa:16:3e:e1:1e:5c, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.compute.manager [req-2a27d522-c7c8-44af-8f9f-739f794274fa req-1e6d076f-cd78-42e5-af3e-e22ade69ac96 service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Received event network-changed-d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.compute.manager [req-2a27d522-c7c8-44af-8f9f-739f794274fa req-1e6d076f-cd78-42e5-af3e-e22ade69ac96 service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Refreshing instance network info cache due to event network-changed-d789f079-694d-48c0-91ed-ae69fa259a1a. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2a27d522-c7c8-44af-8f9f-739f794274fa req-1e6d076f-cd78-42e5-af3e-e22ade69ac96 service nova] Acquiring lock "refresh_cache-e9b77844-67a8-4c26-90f2-afc1809b33d1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2a27d522-c7c8-44af-8f9f-739f794274fa req-1e6d076f-cd78-42e5-af3e-e22ade69ac96 service nova] Acquired lock "refresh_cache-e9b77844-67a8-4c26-90f2-afc1809b33d1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:32:14 user nova-compute[74630]: DEBUG nova.network.neutron [req-2a27d522-c7c8-44af-8f9f-739f794274fa req-1e6d076f-cd78-42e5-af3e-e22ade69ac96 service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Refreshing network info cache for port d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:32:15 user nova-compute[74630]: DEBUG nova.network.neutron [req-2a27d522-c7c8-44af-8f9f-739f794274fa req-1e6d076f-cd78-42e5-af3e-e22ade69ac96 service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Updated VIF entry in instance network info cache for port d789f079-694d-48c0-91ed-ae69fa259a1a. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:32:15 user nova-compute[74630]: DEBUG nova.network.neutron [req-2a27d522-c7c8-44af-8f9f-739f794274fa req-1e6d076f-cd78-42e5-af3e-e22ade69ac96 service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Updating instance_info_cache with network_info: [{"id": "d789f079-694d-48c0-91ed-ae69fa259a1a", "address": "fa:16:3e:e1:1e:5c", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd789f079-69", "ovs_interfaceid": "d789f079-694d-48c0-91ed-ae69fa259a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:32:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2a27d522-c7c8-44af-8f9f-739f794274fa req-1e6d076f-cd78-42e5-af3e-e22ade69ac96 service nova] Releasing lock "refresh_cache-e9b77844-67a8-4c26-90f2-afc1809b33d1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:32:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-354c5903-8251-4e8a-bb4e-1455a97f5cc5 req-75b4de6d-4d98-4a97-894b-415f137e618a service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Received event network-vif-plugged-d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:32:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-354c5903-8251-4e8a-bb4e-1455a97f5cc5 req-75b4de6d-4d98-4a97-894b-415f137e618a service nova] Acquiring lock "e9b77844-67a8-4c26-90f2-afc1809b33d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-354c5903-8251-4e8a-bb4e-1455a97f5cc5 req-75b4de6d-4d98-4a97-894b-415f137e618a service nova] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-354c5903-8251-4e8a-bb4e-1455a97f5cc5 req-75b4de6d-4d98-4a97-894b-415f137e618a service nova] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-354c5903-8251-4e8a-bb4e-1455a97f5cc5 req-75b4de6d-4d98-4a97-894b-415f137e618a service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] No waiting events found dispatching network-vif-plugged-d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:32:16 user nova-compute[74630]: WARNING nova.compute.manager [req-354c5903-8251-4e8a-bb4e-1455a97f5cc5 req-75b4de6d-4d98-4a97-894b-415f137e618a service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Received unexpected event network-vif-plugged-d789f079-694d-48c0-91ed-ae69fa259a1a for instance with vm_state building and task_state spawning.
Oct 26 03:32:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-c53f9247-fe22-48ca-b9cd-071caddffdbc req-4e77ddf9-c6b5-4bdc-83d3-f293c454dcff service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Received event network-vif-plugged-d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:32:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c53f9247-fe22-48ca-b9cd-071caddffdbc req-4e77ddf9-c6b5-4bdc-83d3-f293c454dcff service nova] Acquiring lock "e9b77844-67a8-4c26-90f2-afc1809b33d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c53f9247-fe22-48ca-b9cd-071caddffdbc req-4e77ddf9-c6b5-4bdc-83d3-f293c454dcff service nova] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c53f9247-fe22-48ca-b9cd-071caddffdbc req-4e77ddf9-c6b5-4bdc-83d3-f293c454dcff service nova] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-c53f9247-fe22-48ca-b9cd-071caddffdbc req-4e77ddf9-c6b5-4bdc-83d3-f293c454dcff service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] No waiting events found dispatching network-vif-plugged-d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:32:18 user nova-compute[74630]: WARNING nova.compute.manager [req-c53f9247-fe22-48ca-b9cd-071caddffdbc req-4e77ddf9-c6b5-4bdc-83d3-f293c454dcff service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Received unexpected event network-vif-plugged-d789f079-694d-48c0-91ed-ae69fa259a1a for instance with vm_state building and task_state spawning.
Oct 26 03:32:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:32:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:32:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Instance spawned successfully.
Oct 26 03:32:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:32:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:18 user nova-compute[74630]: INFO nova.compute.manager [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Took 6.88 seconds to spawn the instance on the hypervisor.
Oct 26 03:32:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:32:18 user nova-compute[74630]: INFO nova.compute.manager [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Took 8.63 seconds to build instance.
Oct 26 03:32:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ef07b21a-7589-4bf6-955d-e23c7d89d211 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.746s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:32:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:21 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:32:22 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:32:22 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:32:22 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:32:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:22 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:32:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:32:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquiring lock "2176994e-875a-4a16-a317-5e8b096ad498" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "2176994e-875a-4a16-a317-5e8b096ad498" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:26 user nova-compute[74630]: DEBUG nova.objects.instance [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lazy-loading 'flavor' on Instance uuid 2176994e-875a-4a16-a317-5e8b096ad498 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:32:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "2176994e-875a-4a16-a317-5e8b096ad498" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquiring lock "2176994e-875a-4a16-a317-5e8b096ad498" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "2176994e-875a-4a16-a317-5e8b096ad498" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:27 user nova-compute[74630]: INFO nova.compute.manager [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Attaching volume afdada84-a041-4a32-99e5-158d275b97cf to /dev/vdb
Oct 26 03:32:27 user nova-compute[74630]: DEBUG os_brick.utils [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2153aba-4bb4-41b6-a343-aaa665c1d211]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c754a013-a523-49e8-b440-0faf01c3bbe2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[60817040-2d26-4759-9405-df3255903d7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1f60bf-e17d-463b-b842-3abc693172c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:32:27 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a16bb3c-2593-4e55-9dcd-51a627130120]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG os_brick.utils [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Updating existing volume attachment record: 20f474bc-40a4-40fe-89df-33a7930d539f {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:32:28 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:32:28 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=7280MB free_disk=25.11599349975586GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 73ac3b23-4f52-4107-989a-bcb38b9e0a00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e748e6b1-72d5-4832-a992-32070d237064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 2176994e-875a-4a16-a317-5e8b096ad498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance dedde109-8cf7-487d-be41-3b8951180c26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 571ada6a-d632-4596-be98-9f72cab3b5f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 0be74854-6a07-4468-bf1c-c41066af14c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e9b77844-67a8-4c26-90f2-afc1809b33d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG os_brick.utils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a4ee59-5b71-44c6-b41f-5469ad8c02c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a84c680-7ba9-4a07-9086-6079de284181]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a335fd6-d28b-4c53-947d-bfcf26edb257]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e50179-3ffc-4882-8abc-6d7be6f60f8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:32:28 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7eac9c-baac-4ded-a88a-4607fd176a0d]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG os_brick.utils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Updating existing volume attachment record: 346bfe89-b875-45f6-a43d-18325ec04fb6 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:32:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.756s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:29 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:32:29 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:32:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:32:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-7918e3bc-c44b-4be3-871d-e06eb3fd7d49" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:32:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-7918e3bc-c44b-4be3-871d-e06eb3fd7d49" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:32:30 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:32:30 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Updating instance_info_cache with network_info: [{"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:32:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-7918e3bc-c44b-4be3-871d-e06eb3fd7d49" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:32:30 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:32:30 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:32:30 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:32:30 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:32:30 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:32:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "1e9d2b27-a936-4548-b74a-02a64f180234" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "1e9d2b27-a936-4548-b74a-02a64f180234" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:32:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:32:42 user nova-compute[74630]: INFO nova.compute.claims [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Claim successful on node user
Oct 26 03:32:42 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:32:42 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:32:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:32:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:32:42 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:32:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:32:43 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG nova.policy [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc35b87a18e44b3392d122e392a0b8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebfc20893da40c1b25be2444441f0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:32:43 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Creating image(s)
Oct 26 03:32:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "/opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "/opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.245s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.193s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk 1073741824" returned: 0 in 0.076s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Successfully created port: 6245c02f-13dd-4ab2-b490-8156f850a3de {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.213s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:32:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Cannot resize image /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Ensure instance console log exists: /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Successfully updated port: 6245c02f-13dd-4ab2-b490-8156f850a3de {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "refresh_cache-1e9d2b27-a936-4548-b74a-02a64f180234" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquired lock "refresh_cache-1e9d2b27-a936-4548-b74a-02a64f180234" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-3723edc5-b28e-4f7c-a436-a7f9790178ac req-4d6060c3-ee2a-4c80-9d27-2fb9a87e966a service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Received event network-changed-6245c02f-13dd-4ab2-b490-8156f850a3de {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-3723edc5-b28e-4f7c-a436-a7f9790178ac req-4d6060c3-ee2a-4c80-9d27-2fb9a87e966a service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Refreshing instance network info cache due to event network-changed-6245c02f-13dd-4ab2-b490-8156f850a3de. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3723edc5-b28e-4f7c-a436-a7f9790178ac req-4d6060c3-ee2a-4c80-9d27-2fb9a87e966a service nova] Acquiring lock "refresh_cache-1e9d2b27-a936-4548-b74a-02a64f180234" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Updating instance_info_cache with network_info: [{"id": "6245c02f-13dd-4ab2-b490-8156f850a3de", "address": "fa:16:3e:28:df:29", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6245c02f-13", "ovs_interfaceid": "6245c02f-13dd-4ab2-b490-8156f850a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Releasing lock "refresh_cache-1e9d2b27-a936-4548-b74a-02a64f180234" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Instance network_info: |[{"id": "6245c02f-13dd-4ab2-b490-8156f850a3de", "address": "fa:16:3e:28:df:29", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6245c02f-13", "ovs_interfaceid": "6245c02f-13dd-4ab2-b490-8156f850a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3723edc5-b28e-4f7c-a436-a7f9790178ac req-4d6060c3-ee2a-4c80-9d27-2fb9a87e966a service nova] Acquired lock "refresh_cache-1e9d2b27-a936-4548-b74a-02a64f180234" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.network.neutron [req-3723edc5-b28e-4f7c-a436-a7f9790178ac req-4d6060c3-ee2a-4c80-9d27-2fb9a87e966a service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Refreshing network info cache for port 6245c02f-13dd-4ab2-b490-8156f850a3de {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Start _get_guest_xml network_info=[{"id": "6245c02f-13dd-4ab2-b490-8156f850a3de", "address": "fa:16:3e:28:df:29", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6245c02f-13", "ovs_interfaceid": "6245c02f-13dd-4ab2-b490-8156f850a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:32:44 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:32:44 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:32:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2110881862',display_name='tempest-AttachVolumeNegativeTest-server-2110881862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2110881862',id=30,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZV4zYfM2KgqCkScI1E5UsVYaV/+c7WrUQ445qL4s+LA6gAbg7uONb4EqshspoZJbRuNMNALikQ5FY9oowGd/34b4kcyYiHcNeg6RvW2b+iWAaBYzMLN5Vu5oW2uVP11A==',key_name='tempest-keypair-1280320741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ebfc20893da40c1b25be2444441f0c3',ramdisk_id='',reservation_id='r-u4xlh0io',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2146381855',owner_user_name='tempest-AttachVolumeNegativeTest-2146381855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:32:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc35b87a18e44b3392d122e392a0b8fb',uuid=1e9d2b27-a936-4548-b74a-02a64f180234,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6245c02f-13dd-4ab2-b490-8156f850a3de", "address": "fa:16:3e:28:df:29", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6245c02f-13", "ovs_interfaceid": "6245c02f-13dd-4ab2-b490-8156f850a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converting VIF {"id": "6245c02f-13dd-4ab2-b490-8156f850a3de", "address": "fa:16:3e:28:df:29", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6245c02f-13", "ovs_interfaceid": "6245c02f-13dd-4ab2-b490-8156f850a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:df:29,bridge_name='br-int',has_traffic_filtering=True,id=6245c02f-13dd-4ab2-b490-8156f850a3de,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6245c02f-13') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e9d2b27-a936-4548-b74a-02a64f180234 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:32:44 user nova-compute[74630]:   <uuid>1e9d2b27-a936-4548-b74a-02a64f180234</uuid>
Oct 26 03:32:44 user nova-compute[74630]:   <name>instance-0000001e</name>
Oct 26 03:32:44 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:32:44 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:32:44 user nova-compute[74630]:   <metadata>
Oct 26 03:32:44 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:32:44 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:32:44 user nova-compute[74630]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2110881862</nova:name>
Oct 26 03:32:44 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:32:44</nova:creationTime>
Oct 26 03:32:44 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:32:44 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:32:44 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:32:44 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:32:44 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:32:44 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:32:44 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:32:44 user nova-compute[74630]:       <nova:owner>
Oct 26 03:32:44 user nova-compute[74630]:         <nova:user uuid="bc35b87a18e44b3392d122e392a0b8fb">tempest-AttachVolumeNegativeTest-2146381855-project-member</nova:user>
Oct 26 03:32:44 user nova-compute[74630]:         <nova:project uuid="0ebfc20893da40c1b25be2444441f0c3">tempest-AttachVolumeNegativeTest-2146381855</nova:project>
Oct 26 03:32:44 user nova-compute[74630]:       </nova:owner>
Oct 26 03:32:44 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:32:44 user nova-compute[74630]:       <nova:ports>
Oct 26 03:32:44 user nova-compute[74630]:         <nova:port uuid="6245c02f-13dd-4ab2-b490-8156f850a3de">
Oct 26 03:32:44 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 03:32:44 user nova-compute[74630]:         </nova:port>
Oct 26 03:32:44 user nova-compute[74630]:       </nova:ports>
Oct 26 03:32:44 user nova-compute[74630]:     </nova:instance>
Oct 26 03:32:44 user nova-compute[74630]:   </metadata>
Oct 26 03:32:44 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:32:44 user nova-compute[74630]:     <system>
Oct 26 03:32:44 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:32:44 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:32:44 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:32:44 user nova-compute[74630]:       <entry name="serial">1e9d2b27-a936-4548-b74a-02a64f180234</entry>
Oct 26 03:32:44 user nova-compute[74630]:       <entry name="uuid">1e9d2b27-a936-4548-b74a-02a64f180234</entry>
Oct 26 03:32:44 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:32:44 user nova-compute[74630]:     </system>
Oct 26 03:32:44 user nova-compute[74630]:   </sysinfo>
Oct 26 03:32:44 user nova-compute[74630]:   <os>
Oct 26 03:32:44 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:32:44 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:32:44 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:32:44 user nova-compute[74630]:   </os>
Oct 26 03:32:44 user nova-compute[74630]:   <features>
Oct 26 03:32:44 user nova-compute[74630]:     <acpi/>
Oct 26 03:32:44 user nova-compute[74630]:     <apic/>
Oct 26 03:32:44 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:32:44 user nova-compute[74630]:   </features>
Oct 26 03:32:44 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:32:44 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:32:44 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:32:44 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:32:44 user nova-compute[74630]:   </clock>
Oct 26 03:32:44 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:32:44 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:32:44 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:32:44 user nova-compute[74630]:   </cpu>
Oct 26 03:32:44 user nova-compute[74630]:   <devices>
Oct 26 03:32:44 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:32:44 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:32:44 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk"/>
Oct 26 03:32:44 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:32:44 user nova-compute[74630]:     </disk>
Oct 26 03:32:44 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:32:44 user nova-compute[74630]:       <mac address="fa:16:3e:28:df:29"/>
Oct 26 03:32:44 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:32:44 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:32:44 user nova-compute[74630]:       <target dev="tap6245c02f-13"/>
Oct 26 03:32:44 user nova-compute[74630]:     </interface>
Oct 26 03:32:44 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:32:44 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/console.log" append="off"/>
Oct 26 03:32:44 user nova-compute[74630]:     </serial>
Oct 26 03:32:44 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:32:44 user nova-compute[74630]:     <video>
Oct 26 03:32:44 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:32:44 user nova-compute[74630]:     </video>
Oct 26 03:32:44 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:32:44 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:32:44 user nova-compute[74630]:     </rng>
Oct 26 03:32:44 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:32:44 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:32:44 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:32:44 user nova-compute[74630]:     </memballoon>
Oct 26 03:32:44 user nova-compute[74630]:   </devices>
Oct 26 03:32:44 user nova-compute[74630]: </domain>
Oct 26 03:32:44 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:32:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2110881862',display_name='tempest-AttachVolumeNegativeTest-server-2110881862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2110881862',id=30,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZV4zYfM2KgqCkScI1E5UsVYaV/+c7WrUQ445qL4s+LA6gAbg7uONb4EqshspoZJbRuNMNALikQ5FY9oowGd/34b4kcyYiHcNeg6RvW2b+iWAaBYzMLN5Vu5oW2uVP11A==',key_name='tempest-keypair-1280320741',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ebfc20893da40c1b25be2444441f0c3',ramdisk_id='',reservation_id='r-u4xlh0io',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2146381855',owner_user_name='tempest-AttachVolumeNegativeTest-2146381855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:32:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc35b87a18e44b3392d122e392a0b8fb',uuid=1e9d2b27-a936-4548-b74a-02a64f180234,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6245c02f-13dd-4ab2-b490-8156f850a3de", "address": "fa:16:3e:28:df:29", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6245c02f-13", "ovs_interfaceid": "6245c02f-13dd-4ab2-b490-8156f850a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converting VIF {"id": "6245c02f-13dd-4ab2-b490-8156f850a3de", "address": "fa:16:3e:28:df:29", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6245c02f-13", "ovs_interfaceid": "6245c02f-13dd-4ab2-b490-8156f850a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:df:29,bridge_name='br-int',has_traffic_filtering=True,id=6245c02f-13dd-4ab2-b490-8156f850a3de,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6245c02f-13') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG os_vif [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:df:29,bridge_name='br-int',has_traffic_filtering=True,id=6245c02f-13dd-4ab2-b490-8156f850a3de,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6245c02f-13') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67c17530-d6f7-5f3b-a6c5-3d3aebf25435', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6245c02f-13, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6245c02f-13, col_values=(('qos', UUID('34b95158-bc80-45bb-b842-d4e8e0414bbb')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6245c02f-13, col_values=(('external_ids', {'iface-id': '6245c02f-13dd-4ab2-b490-8156f850a3de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:df:29', 'vm-uuid': '1e9d2b27-a936-4548-b74a-02a64f180234'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:32:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:45 user nova-compute[74630]: INFO os_vif [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:df:29,bridge_name='br-int',has_traffic_filtering=True,id=6245c02f-13dd-4ab2-b490-8156f850a3de,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6245c02f-13')
Oct 26 03:32:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:32:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No VIF found with MAC fa:16:3e:28:df:29, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:32:45 user nova-compute[74630]: DEBUG nova.network.neutron [req-3723edc5-b28e-4f7c-a436-a7f9790178ac req-4d6060c3-ee2a-4c80-9d27-2fb9a87e966a service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Updated VIF entry in instance network info cache for port 6245c02f-13dd-4ab2-b490-8156f850a3de. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:32:45 user nova-compute[74630]: DEBUG nova.network.neutron [req-3723edc5-b28e-4f7c-a436-a7f9790178ac req-4d6060c3-ee2a-4c80-9d27-2fb9a87e966a service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Updating instance_info_cache with network_info: [{"id": "6245c02f-13dd-4ab2-b490-8156f850a3de", "address": "fa:16:3e:28:df:29", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6245c02f-13", "ovs_interfaceid": "6245c02f-13dd-4ab2-b490-8156f850a3de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:32:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3723edc5-b28e-4f7c-a436-a7f9790178ac req-4d6060c3-ee2a-4c80-9d27-2fb9a87e966a service nova] Releasing lock "refresh_cache-1e9d2b27-a936-4548-b74a-02a64f180234" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:32:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-15402681-bad7-4151-80b7-2d6f75624eca req-640ce81f-90a7-4d1c-92a5-45b765fca847 service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Received event network-vif-plugged-6245c02f-13dd-4ab2-b490-8156f850a3de {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:32:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-15402681-bad7-4151-80b7-2d6f75624eca req-640ce81f-90a7-4d1c-92a5-45b765fca847 service nova] Acquiring lock "1e9d2b27-a936-4548-b74a-02a64f180234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-15402681-bad7-4151-80b7-2d6f75624eca req-640ce81f-90a7-4d1c-92a5-45b765fca847 service nova] Lock "1e9d2b27-a936-4548-b74a-02a64f180234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-15402681-bad7-4151-80b7-2d6f75624eca req-640ce81f-90a7-4d1c-92a5-45b765fca847 service nova] Lock "1e9d2b27-a936-4548-b74a-02a64f180234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-15402681-bad7-4151-80b7-2d6f75624eca req-640ce81f-90a7-4d1c-92a5-45b765fca847 service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] No waiting events found dispatching network-vif-plugged-6245c02f-13dd-4ab2-b490-8156f850a3de {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:32:46 user nova-compute[74630]: WARNING nova.compute.manager [req-15402681-bad7-4151-80b7-2d6f75624eca req-640ce81f-90a7-4d1c-92a5-45b765fca847 service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Received unexpected event network-vif-plugged-6245c02f-13dd-4ab2-b490-8156f850a3de for instance with vm_state building and task_state spawning.
Oct 26 03:32:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:32:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtWXkfmb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:32:47 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:32:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:32:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:32:47 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:32:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:32:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:32:47 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:32:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[376b627f-07a4-4eab-b1b6-17b9a5ea59a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:32:47 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7697044-a340-4b13-af84-676dabea09c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf] added
Oct 26 03:32:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[557180b1-ffff-452b-b56e-da670bd53a64]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[956d7cee-b463-4e1e-aaf0-4c85ce74913c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtWXkfmb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VtWXkfmb" returned: 0 in 0.054s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a6be6b-6b7c-4efd-9e52-000e72c605e2]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VtWXkfmb'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72600d4-559e-4a66-bc20-f9c515d3d5a4]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[99146b1e-abc1-47ff-9190-48e4f6e0ae10]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:32:48 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:32:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:32:48 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:32:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eec1c89-34e6-487a-9829-b80a83b5be0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf, portal: 172.16.0.220,3260]
Oct 26 03:32:48 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf, portal: 172.16.0.220,3260] successful.
Oct 26 03:32:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[90eddd96-815b-469a-9778-dd8641e162d4]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dcc852-f39f-4a15-acc2-d17ce2673f0d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:32:48 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:32:48 user nova-compute[74630]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf (non-flash)
Oct 26 03:32:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:32:48 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:32:48 user nova-compute[74630]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf (non-flash)
Oct 26 03:32:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.439s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef7797b-3d08-40b9-88ac-b642799790b0]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtWXkfmb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-5d61e35f-4f71-49cc-9e62-e109155bf847 req-57c062c9-d53d-49b4-a758-27451719e201 service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Received event network-vif-plugged-6245c02f-13dd-4ab2-b490-8156f850a3de {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5d61e35f-4f71-49cc-9e62-e109155bf847 req-57c062c9-d53d-49b4-a758-27451719e201 service nova] Acquiring lock "1e9d2b27-a936-4548-b74a-02a64f180234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5d61e35f-4f71-49cc-9e62-e109155bf847 req-57c062c9-d53d-49b4-a758-27451719e201 service nova] Lock "1e9d2b27-a936-4548-b74a-02a64f180234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5d61e35f-4f71-49cc-9e62-e109155bf847 req-57c062c9-d53d-49b4-a758-27451719e201 service nova] Lock "1e9d2b27-a936-4548-b74a-02a64f180234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-5d61e35f-4f71-49cc-9e62-e109155bf847 req-57c062c9-d53d-49b4-a758-27451719e201 service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] No waiting events found dispatching network-vif-plugged-6245c02f-13dd-4ab2-b490-8156f850a3de {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:32:48 user nova-compute[74630]: WARNING nova.compute.manager [req-5d61e35f-4f71-49cc-9e62-e109155bf847 req-57c062c9-d53d-49b4-a758-27451719e201 service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Received unexpected event network-vif-plugged-6245c02f-13dd-4ab2-b490-8156f850a3de for instance with vm_state building and task_state spawning.
Oct 26 03:32:49 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:32:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:32:49 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Instance spawned successfully.
Oct 26 03:32:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:32:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:49 user nova-compute[74630]: INFO nova.compute.manager [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Took 6.09 seconds to spawn the instance on the hypervisor.
Oct 26 03:32:49 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:32:49 user nova-compute[74630]: INFO nova.compute.manager [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Took 7.24 seconds to build instance.
Oct 26 03:32:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:32:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] <== connect_volume: return (1494ms) {'type': 'block', 'scsi_wwn': '26465303137393030', 'path': '/dev/sdc'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:32:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465303137393030', 'path': '/dev/sdc'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:32:49 user nova-compute[74630]: DEBUG nova.objects.instance [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lazy-loading 'flavor' on Instance uuid 2176994e-875a-4a16-a317-5e8b096ad498 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:32:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ab96ddda-989f-403d-b540-66ec95efd6f5 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "1e9d2b27-a936-4548-b74a-02a64f180234" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.363s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:32:49 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:32:49 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:32:49 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:32:49 user nova-compute[74630]:   <serial>afdada84-a041-4a32-99e5-158d275b97cf</serial>
Oct 26 03:32:49 user nova-compute[74630]: </disk>
Oct 26 03:32:49 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] No VIF found with MAC fa:16:3e:92:75:eb, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-3427b43a-d0f8-444a-9856-ec207b673871 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "2176994e-875a-4a16-a317-5e8b096ad498" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.994s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:32:50 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Creating image(s)
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Ensure instance console log exists: /opt/stack/data/nova/instances/0be74854-6a07-4468-bf1c-c41066af14c2/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Start _get_guest_xml network_info=[{"id": "81e27221-96a7-4492-b72b-a0ed4f496f09", "address": "fa:16:3e:21:e1:c5", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e27221-96", "ovs_interfaceid": "81e27221-96a7-4492-b72b-a0ed4f496f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eajGSbBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0be74854-6a07-4468-bf1c-c41066af14c2', 'attached_at': '', 'detached_at': '', 'volume_id': '02cc9efa-096f-4682-b557-ab809630abe4', 'serial': '02cc9efa-096f-4682-b557-ab809630abe4'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '346bfe89-b875-45f6-a43d-18325ec04fb6', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:32:50 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:32:50 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eajGSbBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:32:50 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:32:50 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:32:50 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04022b8-2d5d-44f9-a0eb-712162d0c86d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:32:50 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f56a37-0fd4-4fae-a1ad-1311700e361d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4] added
Oct 26 03:32:50 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[977dd644-922b-4e54-824d-390bf3bb7d17]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e87ea06-18b2-43c5-86b7-e4908df9789e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eajGSbBx {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eajGSbBx" returned: 0 in 0.085s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[879438bf-d492-4857-b5a7-2121a103c3e6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eajGSbBx'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ef6e04-e8ff-49da-93b9-b27ad0969ad3]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66259ce-44e9-4dd6-b01d-7b4a302b0080]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:32:50 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:32:50 user nova-compute[74630]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf (non-flash)
Oct 26 03:32:50 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:32:50 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:32:50 user nova-compute[74630]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf (non-flash)
Oct 26 03:32:50 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[98183403-ada0-4cfa-ba01-1ea73b3380ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4, portal: 172.16.0.220,3260]
Oct 26 03:32:50 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4, portal: 172.16.0.220,3260] successful.
Oct 26 03:32:50 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[208d2779-67cb-42d0-9a29-9f816d591169]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e234ec6b-0705-4786-a2d5-364378b61874]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:32:50 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:32:50 user nova-compute[74630]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf (non-flash)
Oct 26 03:32:50 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:32:50 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:32:50 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:32:50 user nova-compute[74630]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf (non-flash)
Oct 26 03:32:50 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:32:50 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.465s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1697a6-2ac5-42dc-b82d-74daacbc26f2]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:32:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eajGSbBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.513s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] <== connect_volume: return (1515ms) {'type': 'block', 'scsi_wwn': '26661346466653230', 'path': '/dev/sde'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661346466653230', 'path': '/dev/sde'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:31:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1950278964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1950278964',id=27,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e396316ddc243c594c29f5c434501cb',ramdisk_id='',reservation_id='r-014alrj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:31:57Z,user_data=None,user_id='f8694c5db6e34f1e88595b55f8e5fe70',uuid=0be74854-6a07-4468-bf1c-c41066af14c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81e27221-96a7-4492-b72b-a0ed4f496f09", "address": "fa:16:3e:21:e1:c5", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e27221-96", "ovs_interfaceid": "81e27221-96a7-4492-b72b-a0ed4f496f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converting VIF {"id": "81e27221-96a7-4492-b72b-a0ed4f496f09", "address": "fa:16:3e:21:e1:c5", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e27221-96", "ovs_interfaceid": "81e27221-96a7-4492-b72b-a0ed4f496f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:e1:c5,bridge_name='br-int',has_traffic_filtering=True,id=81e27221-96a7-4492-b72b-a0ed4f496f09,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e27221-96') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG nova.objects.instance [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'pci_devices' on Instance uuid 0be74854-6a07-4468-bf1c-c41066af14c2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:32:51 user nova-compute[74630]:   <uuid>0be74854-6a07-4468-bf1c-c41066af14c2</uuid>
Oct 26 03:32:51 user nova-compute[74630]:   <name>instance-0000001b</name>
Oct 26 03:32:51 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:32:51 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:32:51 user nova-compute[74630]:   <metadata>
Oct 26 03:32:51 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:32:51 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:32:51 user nova-compute[74630]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1950278964</nova:name>
Oct 26 03:32:51 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:32:50</nova:creationTime>
Oct 26 03:32:51 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:32:51 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:32:51 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:32:51 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:32:51 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:32:51 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:32:51 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:32:51 user nova-compute[74630]:       <nova:owner>
Oct 26 03:32:51 user nova-compute[74630]:         <nova:user uuid="f8694c5db6e34f1e88595b55f8e5fe70">tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member</nova:user>
Oct 26 03:32:51 user nova-compute[74630]:         <nova:project uuid="1e396316ddc243c594c29f5c434501cb">tempest-ServerBootFromVolumeStableRescueTest-1296515996</nova:project>
Oct 26 03:32:51 user nova-compute[74630]:       </nova:owner>
Oct 26 03:32:51 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:32:51 user nova-compute[74630]:       <nova:ports>
Oct 26 03:32:51 user nova-compute[74630]:         <nova:port uuid="81e27221-96a7-4492-b72b-a0ed4f496f09">
Oct 26 03:32:51 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 03:32:51 user nova-compute[74630]:         </nova:port>
Oct 26 03:32:51 user nova-compute[74630]:       </nova:ports>
Oct 26 03:32:51 user nova-compute[74630]:     </nova:instance>
Oct 26 03:32:51 user nova-compute[74630]:   </metadata>
Oct 26 03:32:51 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:32:51 user nova-compute[74630]:     <system>
Oct 26 03:32:51 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:32:51 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:32:51 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:32:51 user nova-compute[74630]:       <entry name="serial">0be74854-6a07-4468-bf1c-c41066af14c2</entry>
Oct 26 03:32:51 user nova-compute[74630]:       <entry name="uuid">0be74854-6a07-4468-bf1c-c41066af14c2</entry>
Oct 26 03:32:51 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:32:51 user nova-compute[74630]:     </system>
Oct 26 03:32:51 user nova-compute[74630]:   </sysinfo>
Oct 26 03:32:51 user nova-compute[74630]:   <os>
Oct 26 03:32:51 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:32:51 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:32:51 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:32:51 user nova-compute[74630]:   </os>
Oct 26 03:32:51 user nova-compute[74630]:   <features>
Oct 26 03:32:51 user nova-compute[74630]:     <acpi/>
Oct 26 03:32:51 user nova-compute[74630]:     <apic/>
Oct 26 03:32:51 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:32:51 user nova-compute[74630]:   </features>
Oct 26 03:32:51 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:32:51 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:32:51 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:32:51 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:32:51 user nova-compute[74630]:   </clock>
Oct 26 03:32:51 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:32:51 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:32:51 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:32:51 user nova-compute[74630]:   </cpu>
Oct 26 03:32:51 user nova-compute[74630]:   <devices>
Oct 26 03:32:51 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:32:51 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:32:51 user nova-compute[74630]:       <source dev="/dev/sde"/>
Oct 26 03:32:51 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:32:51 user nova-compute[74630]:       <serial>02cc9efa-096f-4682-b557-ab809630abe4</serial>
Oct 26 03:32:51 user nova-compute[74630]:     </disk>
Oct 26 03:32:51 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:32:51 user nova-compute[74630]:       <mac address="fa:16:3e:21:e1:c5"/>
Oct 26 03:32:51 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:32:51 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:32:51 user nova-compute[74630]:       <target dev="tap81e27221-96"/>
Oct 26 03:32:51 user nova-compute[74630]:     </interface>
Oct 26 03:32:51 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:32:51 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/0be74854-6a07-4468-bf1c-c41066af14c2/console.log" append="off"/>
Oct 26 03:32:51 user nova-compute[74630]:     </serial>
Oct 26 03:32:51 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:32:51 user nova-compute[74630]:     <video>
Oct 26 03:32:51 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:32:51 user nova-compute[74630]:     </video>
Oct 26 03:32:51 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:32:51 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:32:51 user nova-compute[74630]:     </rng>
Oct 26 03:32:51 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:32:51 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:32:51 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:32:51 user nova-compute[74630]:     </memballoon>
Oct 26 03:32:51 user nova-compute[74630]:   </devices>
Oct 26 03:32:51 user nova-compute[74630]: </domain>
Oct 26 03:32:51 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:31:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1950278964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1950278964',id=27,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e396316ddc243c594c29f5c434501cb',ramdisk_id='',reservation_id='r-014alrj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:31:57Z,user_data=None,user_id='f8694c5db6e34f1e88595b55f8e5fe70',uuid=0be74854-6a07-4468-bf1c-c41066af14c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81e27221-96a7-4492-b72b-a0ed4f496f09", "address": "fa:16:3e:21:e1:c5", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e27221-96", "ovs_interfaceid": "81e27221-96a7-4492-b72b-a0ed4f496f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converting VIF {"id": "81e27221-96a7-4492-b72b-a0ed4f496f09", "address": "fa:16:3e:21:e1:c5", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e27221-96", "ovs_interfaceid": "81e27221-96a7-4492-b72b-a0ed4f496f09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:e1:c5,bridge_name='br-int',has_traffic_filtering=True,id=81e27221-96a7-4492-b72b-a0ed4f496f09,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e27221-96') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG os_vif [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e1:c5,bridge_name='br-int',has_traffic_filtering=True,id=81e27221-96a7-4492-b72b-a0ed4f496f09,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e27221-96') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c24062a4-5a03-5fca-87fb-dbb7c7c77543', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81e27221-96, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81e27221-96, col_values=(('qos', UUID('05ef291b-3f0f-4227-87f8-6708a5575eaf')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81e27221-96, col_values=(('external_ids', {'iface-id': '81e27221-96a7-4492-b72b-a0ed4f496f09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:e1:c5', 'vm-uuid': '0be74854-6a07-4468-bf1c-c41066af14c2'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:32:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:51 user nova-compute[74630]: INFO os_vif [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e1:c5,bridge_name='br-int',has_traffic_filtering=True,id=81e27221-96a7-4492-b72b-a0ed4f496f09,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e27221-96')
Oct 26 03:32:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:32:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] No VIF found with MAC fa:16:3e:21:e1:c5, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:32:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquiring lock "2176994e-875a-4a16-a317-5e8b096ad498" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "2176994e-875a-4a16-a317-5e8b096ad498" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:52 user nova-compute[74630]: INFO nova.compute.manager [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Detaching volume afdada84-a041-4a32-99e5-158d275b97cf
Oct 26 03:32:52 user nova-compute[74630]: INFO nova.virt.block_device [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Attempting to driver detach volume afdada84-a041-4a32-99e5-158d275b97cf from mountpoint /dev/vdb
Oct 26 03:32:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Attempting to detach device vdb from instance 2176994e-875a-4a16-a317-5e8b096ad498 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:32:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:32:52 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:32:52 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:32:52 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:32:52 user nova-compute[74630]:   <serial>afdada84-a041-4a32-99e5-158d275b97cf</serial>
Oct 26 03:32:52 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:32:52 user nova-compute[74630]: </disk>
Oct 26 03:32:52 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:32:52 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Successfully detached device vdb from instance 2176994e-875a-4a16-a317-5e8b096ad498 from the persistent domain config.
Oct 26 03:32:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2176994e-875a-4a16-a317-5e8b096ad498 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:32:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:32:52 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:32:52 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:32:52 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:32:52 user nova-compute[74630]:   <serial>afdada84-a041-4a32-99e5-158d275b97cf</serial>
Oct 26 03:32:52 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:32:52 user nova-compute[74630]: </disk>
Oct 26 03:32:52 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:32:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:53 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2176994e-875a-4a16-a317-5e8b096ad498 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:32:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:54 user nova-compute[74630]: DEBUG nova.compute.manager [req-83d04c4f-4662-488f-9698-4f1fd87531b7 req-15576a60-cd5c-45d5-b044-f45869e9d61c service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:32:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-83d04c4f-4662-488f-9698-4f1fd87531b7 req-15576a60-cd5c-45d5-b044-f45869e9d61c service nova] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-83d04c4f-4662-488f-9698-4f1fd87531b7 req-15576a60-cd5c-45d5-b044-f45869e9d61c service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-83d04c4f-4662-488f-9698-4f1fd87531b7 req-15576a60-cd5c-45d5-b044-f45869e9d61c service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:54 user nova-compute[74630]: DEBUG nova.compute.manager [req-83d04c4f-4662-488f-9698-4f1fd87531b7 req-15576a60-cd5c-45d5-b044-f45869e9d61c service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] No waiting events found dispatching network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:32:54 user nova-compute[74630]: WARNING nova.compute.manager [req-83d04c4f-4662-488f-9698-4f1fd87531b7 req-15576a60-cd5c-45d5-b044-f45869e9d61c service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received unexpected event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 for instance with vm_state building and task_state spawning.
Oct 26 03:32:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.compute.manager [req-6b7aa01c-d3ef-4541-b747-94f3e41748ec req-0597eb79-e5fd-4efa-a2c1-49aba2c76a49 service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Received event network-changed-a61bcc65-236e-4545-a8f3-bb45e1cc018d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.compute.manager [req-6b7aa01c-d3ef-4541-b747-94f3e41748ec req-0597eb79-e5fd-4efa-a2c1-49aba2c76a49 service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Refreshing instance network info cache due to event network-changed-a61bcc65-236e-4545-a8f3-bb45e1cc018d. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6b7aa01c-d3ef-4541-b747-94f3e41748ec req-0597eb79-e5fd-4efa-a2c1-49aba2c76a49 service nova] Acquiring lock "refresh_cache-dedde109-8cf7-487d-be41-3b8951180c26" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6b7aa01c-d3ef-4541-b747-94f3e41748ec req-0597eb79-e5fd-4efa-a2c1-49aba2c76a49 service nova] Acquired lock "refresh_cache-dedde109-8cf7-487d-be41-3b8951180c26" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.network.neutron [req-6b7aa01c-d3ef-4541-b747-94f3e41748ec req-0597eb79-e5fd-4efa-a2c1-49aba2c76a49 service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Refreshing network info cache for port a61bcc65-236e-4545-a8f3-bb45e1cc018d {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:32:56 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Instance spawned successfully.
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.compute.manager [req-5e617906-f02e-4c5f-8eb3-2755e72e0449 req-af9434cb-ed79-41c0-a2ad-0148877d3edd service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5e617906-f02e-4c5f-8eb3-2755e72e0449 req-af9434cb-ed79-41c0-a2ad-0148877d3edd service nova] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5e617906-f02e-4c5f-8eb3-2755e72e0449 req-af9434cb-ed79-41c0-a2ad-0148877d3edd service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5e617906-f02e-4c5f-8eb3-2755e72e0449 req-af9434cb-ed79-41c0-a2ad-0148877d3edd service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.compute.manager [req-5e617906-f02e-4c5f-8eb3-2755e72e0449 req-af9434cb-ed79-41c0-a2ad-0148877d3edd service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] No waiting events found dispatching network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:32:56 user nova-compute[74630]: WARNING nova.compute.manager [req-5e617906-f02e-4c5f-8eb3-2755e72e0449 req-af9434cb-ed79-41c0-a2ad-0148877d3edd service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received unexpected event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 for instance with vm_state building and task_state spawning.
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.network.neutron [req-6b7aa01c-d3ef-4541-b747-94f3e41748ec req-0597eb79-e5fd-4efa-a2c1-49aba2c76a49 service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Updated VIF entry in instance network info cache for port a61bcc65-236e-4545-a8f3-bb45e1cc018d. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.network.neutron [req-6b7aa01c-d3ef-4541-b747-94f3e41748ec req-0597eb79-e5fd-4efa-a2c1-49aba2c76a49 service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Updating instance_info_cache with network_info: [{"id": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "address": "fa:16:3e:30:29:c4", "network": {"id": "9d5f9542-9f34-4008-bfe5-5472cc3ac9e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1826216881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3bd76b50a465f8a7819fb9666be41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61bcc65-23", "ovs_interfaceid": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6b7aa01c-d3ef-4541-b747-94f3e41748ec req-0597eb79-e5fd-4efa-a2c1-49aba2c76a49 service nova] Releasing lock "refresh_cache-dedde109-8cf7-487d-be41-3b8951180c26" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:32:56 user nova-compute[74630]: INFO nova.compute.manager [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Took 6.55 seconds to spawn the instance on the hypervisor.
Oct 26 03:32:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:32:56 user nova-compute[74630]: INFO nova.compute.manager [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Took 60.82 seconds to build instance.
Oct 26 03:32:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:32:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f9d53d3-c968-49a0-b153-0a4897b6f4d5 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "0be74854-6a07-4468-bf1c-c41066af14c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 60.953s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "dedde109-8cf7-487d-be41-3b8951180c26" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG nova.objects.instance [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lazy-loading 'flavor' on Instance uuid dedde109-8cf7-487d-be41-3b8951180c26 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "dedde109-8cf7-487d-be41-3b8951180c26" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:32:57 user nova-compute[74630]: INFO nova.compute.manager [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Attaching volume 87523dc8-b43f-44b1-8692-4eb1a84c498c to /dev/vdb
Oct 26 03:32:57 user nova-compute[74630]: DEBUG os_brick.utils [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd11007-5a69-490b-ad83-189030f813ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6858927-99e1-44ee-8d40-087bd7279a86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a399e9c6-97e2-4f82-8e8c-9e8a8312b3f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f9c627-5b78-4236-b2ce-90cffa3701ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:32:57 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:32:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[000e59dc-1c7b-457f-9ca6-eb1ac0c7cb66]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG os_brick.utils [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:32:57 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Updating existing volume attachment record: 1bf78b69-5c0c-4c02-91c8-8098703fcf23 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:32:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:33:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:00 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:33:00 user nova-compute[74630]: INFO nova.compute.claims [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Claim successful on node user
Oct 26 03:33:01 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:33:01 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:33:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.848s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:33:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:33:01 user nova-compute[74630]: DEBUG nova.network.neutron [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:33:01 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:33:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:33:01 user nova-compute[74630]: DEBUG nova.policy [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89f51acc12a54e7bbd38e975f2d7632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44335320f77434999514ed6824a2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:33:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG nova.compute.manager [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:33:02 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Creating image(s)
Oct 26 03:33:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "/opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "/opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.256s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.241s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk 1073741824" returned: 0 in 0.069s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.201s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Successfully created port: f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Cannot resize image /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Ensure instance console log exists: /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG nova.network.neutron [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Successfully updated port: f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquired lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG nova.network.neutron [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-582b8cd9-850a-469c-86a2-db2d915a9a75 req-038cea28-87c8-41e9-9164-7d7766e150b7 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received event network-changed-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-582b8cd9-850a-469c-86a2-db2d915a9a75 req-038cea28-87c8-41e9-9164-7d7766e150b7 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Refreshing instance network info cache due to event network-changed-f5f32762-6dc9-47fb-a90d-463f3be1283a. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-582b8cd9-850a-469c-86a2-db2d915a9a75 req-038cea28-87c8-41e9-9164-7d7766e150b7 service nova] Acquiring lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:33:03 user nova-compute[74630]: DEBUG nova.network.neutron [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.network.neutron [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Updating instance_info_cache with network_info: [{"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Releasing lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.compute.manager [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Instance network_info: |[{"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-582b8cd9-850a-469c-86a2-db2d915a9a75 req-038cea28-87c8-41e9-9164-7d7766e150b7 service nova] Acquired lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-582b8cd9-850a-469c-86a2-db2d915a9a75 req-038cea28-87c8-41e9-9164-7d7766e150b7 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Refreshing network info cache for port f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Start _get_guest_xml network_info=[{"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:33:04 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:33:04 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1496039535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1496039535',id=31,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG/wKNBcRL+FImLurheVUXxJaQCN+j/6tyyI7ZspxC0JW8pST9M/flxNHjGMm7/l0OfSdgOLNvLYUlsrZoNQ8hwCUP8SlJPzCSBJ8GUHvHot/N2bjmNrHWhLK/dNtdZsg==',key_name='tempest-keypair-1898419039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f44335320f77434999514ed6824a2e23',ramdisk_id='',reservation_id='r-xzpbz7ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1268856411',owner_user_name='tempest-AttachVolumeShelveTestJSON-1268856411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f51acc12a54e7bbd38e975f2d7632e',uuid=0fb37042-4106-4bcc-a0fa-5e6ae614627f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converting VIF {"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b2:b3,bridge_name='br-int',has_traffic_filtering=True,id=f5f32762-6dc9-47fb-a90d-463f3be1283a,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f32762-6d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.objects.instance [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fb37042-4106-4bcc-a0fa-5e6ae614627f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:33:04 user nova-compute[74630]:   <uuid>0fb37042-4106-4bcc-a0fa-5e6ae614627f</uuid>
Oct 26 03:33:04 user nova-compute[74630]:   <name>instance-0000001f</name>
Oct 26 03:33:04 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:33:04 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:33:04 user nova-compute[74630]:   <metadata>
Oct 26 03:33:04 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:33:04 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:33:04 user nova-compute[74630]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1496039535</nova:name>
Oct 26 03:33:04 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:33:04</nova:creationTime>
Oct 26 03:33:04 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:33:04 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:33:04 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:33:04 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:33:04 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:33:04 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:33:04 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:33:04 user nova-compute[74630]:       <nova:owner>
Oct 26 03:33:04 user nova-compute[74630]:         <nova:user uuid="89f51acc12a54e7bbd38e975f2d7632e">tempest-AttachVolumeShelveTestJSON-1268856411-project-member</nova:user>
Oct 26 03:33:04 user nova-compute[74630]:         <nova:project uuid="f44335320f77434999514ed6824a2e23">tempest-AttachVolumeShelveTestJSON-1268856411</nova:project>
Oct 26 03:33:04 user nova-compute[74630]:       </nova:owner>
Oct 26 03:33:04 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:33:04 user nova-compute[74630]:       <nova:ports>
Oct 26 03:33:04 user nova-compute[74630]:         <nova:port uuid="f5f32762-6dc9-47fb-a90d-463f3be1283a">
Oct 26 03:33:04 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 03:33:04 user nova-compute[74630]:         </nova:port>
Oct 26 03:33:04 user nova-compute[74630]:       </nova:ports>
Oct 26 03:33:04 user nova-compute[74630]:     </nova:instance>
Oct 26 03:33:04 user nova-compute[74630]:   </metadata>
Oct 26 03:33:04 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:33:04 user nova-compute[74630]:     <system>
Oct 26 03:33:04 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:33:04 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:33:04 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:33:04 user nova-compute[74630]:       <entry name="serial">0fb37042-4106-4bcc-a0fa-5e6ae614627f</entry>
Oct 26 03:33:04 user nova-compute[74630]:       <entry name="uuid">0fb37042-4106-4bcc-a0fa-5e6ae614627f</entry>
Oct 26 03:33:04 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:33:04 user nova-compute[74630]:     </system>
Oct 26 03:33:04 user nova-compute[74630]:   </sysinfo>
Oct 26 03:33:04 user nova-compute[74630]:   <os>
Oct 26 03:33:04 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:33:04 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:33:04 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:33:04 user nova-compute[74630]:   </os>
Oct 26 03:33:04 user nova-compute[74630]:   <features>
Oct 26 03:33:04 user nova-compute[74630]:     <acpi/>
Oct 26 03:33:04 user nova-compute[74630]:     <apic/>
Oct 26 03:33:04 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:33:04 user nova-compute[74630]:   </features>
Oct 26 03:33:04 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:33:04 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:33:04 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:33:04 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:33:04 user nova-compute[74630]:   </clock>
Oct 26 03:33:04 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:33:04 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:33:04 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:33:04 user nova-compute[74630]:   </cpu>
Oct 26 03:33:04 user nova-compute[74630]:   <devices>
Oct 26 03:33:04 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:33:04 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:33:04 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk"/>
Oct 26 03:33:04 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:33:04 user nova-compute[74630]:     </disk>
Oct 26 03:33:04 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:33:04 user nova-compute[74630]:       <mac address="fa:16:3e:5d:b2:b3"/>
Oct 26 03:33:04 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:33:04 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:33:04 user nova-compute[74630]:       <target dev="tapf5f32762-6d"/>
Oct 26 03:33:04 user nova-compute[74630]:     </interface>
Oct 26 03:33:04 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:33:04 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/console.log" append="off"/>
Oct 26 03:33:04 user nova-compute[74630]:     </serial>
Oct 26 03:33:04 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:33:04 user nova-compute[74630]:     <video>
Oct 26 03:33:04 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:33:04 user nova-compute[74630]:     </video>
Oct 26 03:33:04 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:33:04 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:33:04 user nova-compute[74630]:     </rng>
Oct 26 03:33:04 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:33:04 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:33:04 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:33:04 user nova-compute[74630]:     </memballoon>
Oct 26 03:33:04 user nova-compute[74630]:   </devices>
Oct 26 03:33:04 user nova-compute[74630]: </domain>
Oct 26 03:33:04 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1496039535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1496039535',id=31,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG/wKNBcRL+FImLurheVUXxJaQCN+j/6tyyI7ZspxC0JW8pST9M/flxNHjGMm7/l0OfSdgOLNvLYUlsrZoNQ8hwCUP8SlJPzCSBJ8GUHvHot/N2bjmNrHWhLK/dNtdZsg==',key_name='tempest-keypair-1898419039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f44335320f77434999514ed6824a2e23',ramdisk_id='',reservation_id='r-xzpbz7ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1268856411',owner_user_name='tempest-AttachVolumeShelveTestJSON-1268856411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f51acc12a54e7bbd38e975f2d7632e',uuid=0fb37042-4106-4bcc-a0fa-5e6ae614627f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converting VIF {"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b2:b3,bridge_name='br-int',has_traffic_filtering=True,id=f5f32762-6dc9-47fb-a90d-463f3be1283a,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f32762-6d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG os_vif [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b2:b3,bridge_name='br-int',has_traffic_filtering=True,id=f5f32762-6dc9-47fb-a90d-463f3be1283a,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f32762-6d') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60c38312-4586-5d75-ac26-3fa8538b65eb', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5f32762-6d, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5f32762-6d, col_values=(('qos', UUID('f3864713-ebc1-4355-b3d2-384476782843')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5f32762-6d, col_values=(('external_ids', {'iface-id': 'f5f32762-6dc9-47fb-a90d-463f3be1283a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:b2:b3', 'vm-uuid': '0fb37042-4106-4bcc-a0fa-5e6ae614627f'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:04 user nova-compute[74630]: INFO os_vif [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b2:b3,bridge_name='br-int',has_traffic_filtering=True,id=f5f32762-6dc9-47fb-a90d-463f3be1283a,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f32762-6d')
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] No VIF found with MAC fa:16:3e:5d:b2:b3, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-582b8cd9-850a-469c-86a2-db2d915a9a75 req-038cea28-87c8-41e9-9164-7d7766e150b7 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Updated VIF entry in instance network info cache for port f5f32762-6dc9-47fb-a90d-463f3be1283a. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-582b8cd9-850a-469c-86a2-db2d915a9a75 req-038cea28-87c8-41e9-9164-7d7766e150b7 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Updating instance_info_cache with network_info: [{"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:33:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-582b8cd9-850a-469c-86a2-db2d915a9a75 req-038cea28-87c8-41e9-9164-7d7766e150b7 service nova] Releasing lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:33:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:06 user nova-compute[74630]: DEBUG nova.compute.manager [req-6b5850cd-42cb-4ccb-a32d-52025a264a09 req-e359b1c4-322b-474b-9a51-fc6246d3c93b service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received event network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:33:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6b5850cd-42cb-4ccb-a32d-52025a264a09 req-e359b1c4-322b-474b-9a51-fc6246d3c93b service nova] Acquiring lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6b5850cd-42cb-4ccb-a32d-52025a264a09 req-e359b1c4-322b-474b-9a51-fc6246d3c93b service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6b5850cd-42cb-4ccb-a32d-52025a264a09 req-e359b1c4-322b-474b-9a51-fc6246d3c93b service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:06 user nova-compute[74630]: DEBUG nova.compute.manager [req-6b5850cd-42cb-4ccb-a32d-52025a264a09 req-e359b1c4-322b-474b-9a51-fc6246d3c93b service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] No waiting events found dispatching network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:33:06 user nova-compute[74630]: WARNING nova.compute.manager [req-6b5850cd-42cb-4ccb-a32d-52025a264a09 req-e359b1c4-322b-474b-9a51-fc6246d3c93b service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received unexpected event network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a for instance with vm_state building and task_state spawning.
Oct 26 03:33:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG nova.compute.manager [req-93be06e5-9e8d-4d10-a935-52186ca86ec7 req-4d50128f-103e-431e-a24b-e0ab71801d04 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received event network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-93be06e5-9e8d-4d10-a935-52186ca86ec7 req-4d50128f-103e-431e-a24b-e0ab71801d04 service nova] Acquiring lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-93be06e5-9e8d-4d10-a935-52186ca86ec7 req-4d50128f-103e-431e-a24b-e0ab71801d04 service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-93be06e5-9e8d-4d10-a935-52186ca86ec7 req-4d50128f-103e-431e-a24b-e0ab71801d04 service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG nova.compute.manager [req-93be06e5-9e8d-4d10-a935-52186ca86ec7 req-4d50128f-103e-431e-a24b-e0ab71801d04 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] No waiting events found dispatching network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:33:08 user nova-compute[74630]: WARNING nova.compute.manager [req-93be06e5-9e8d-4d10-a935-52186ca86ec7 req-4d50128f-103e-431e-a24b-e0ab71801d04 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received unexpected event network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a for instance with vm_state building and task_state spawning.
Oct 26 03:33:08 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Instance spawned successfully.
Oct 26 03:33:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:33:08 user nova-compute[74630]: INFO nova.compute.manager [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Took 6.71 seconds to spawn the instance on the hypervisor.
Oct 26 03:33:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "571ada6a-d632-4596-be98-9f72cab3b5f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lazy-loading 'flavor' on Instance uuid 571ada6a-d632-4596-be98-9f72cab3b5f2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:33:08 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Ignoring supplied device name: /dev/vdb
Oct 26 03:33:08 user nova-compute[74630]: INFO nova.compute.manager [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Took 8.08 seconds to build instance.
Oct 26 03:33:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9fa134c1-dc7a-402a-b23e-0061bdf39a74 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.213s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "571ada6a-d632-4596-be98-9f72cab3b5f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:09 user nova-compute[74630]: INFO nova.compute.manager [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Attaching volume bec64578-1c20-4a78-89d3-062cc96f95a0 to /dev/vdb
Oct 26 03:33:09 user nova-compute[74630]: DEBUG os_brick.utils [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[34248f07-0309-42ff-9ba9-fb0287254a9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9021a5e7-79be-44c3-b823-48a7b0aedad8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc493917-1c88-4a65-996d-4b53af84bc95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8d66cf-5efe-4f20-b4d1-1f7af9bdefcf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:33:09 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:33:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6034b5a1-22f0-4058-8f50-b362c24d3a15]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG os_brick.utils [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Updating existing volume attachment record: ec61a0a4-b4f3-42d7-a925-6787c1c0e170 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:33:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-2eed2264-3f92-49c2-8699-128092812402 req-07046dae-f6e3-4e2b-80c2-8b2707baf885 service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Received event network-changed-86372de7-53c3-423b-85b4-185aa7bfce4a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:33:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-2eed2264-3f92-49c2-8699-128092812402 req-07046dae-f6e3-4e2b-80c2-8b2707baf885 service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Refreshing instance network info cache due to event network-changed-86372de7-53c3-423b-85b4-185aa7bfce4a. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:33:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2eed2264-3f92-49c2-8699-128092812402 req-07046dae-f6e3-4e2b-80c2-8b2707baf885 service nova] Acquiring lock "refresh_cache-571ada6a-d632-4596-be98-9f72cab3b5f2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:33:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2eed2264-3f92-49c2-8699-128092812402 req-07046dae-f6e3-4e2b-80c2-8b2707baf885 service nova] Acquired lock "refresh_cache-571ada6a-d632-4596-be98-9f72cab3b5f2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:33:10 user nova-compute[74630]: DEBUG nova.network.neutron [req-2eed2264-3f92-49c2-8699-128092812402 req-07046dae-f6e3-4e2b-80c2-8b2707baf885 service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Refreshing network info cache for port 86372de7-53c3-423b-85b4-185aa7bfce4a {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:33:11 user nova-compute[74630]: DEBUG nova.network.neutron [req-2eed2264-3f92-49c2-8699-128092812402 req-07046dae-f6e3-4e2b-80c2-8b2707baf885 service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Updated VIF entry in instance network info cache for port 86372de7-53c3-423b-85b4-185aa7bfce4a. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:33:11 user nova-compute[74630]: DEBUG nova.network.neutron [req-2eed2264-3f92-49c2-8699-128092812402 req-07046dae-f6e3-4e2b-80c2-8b2707baf885 service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Updating instance_info_cache with network_info: [{"id": "86372de7-53c3-423b-85b4-185aa7bfce4a", "address": "fa:16:3e:98:90:02", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86372de7-53", "ovs_interfaceid": "86372de7-53c3-423b-85b4-185aa7bfce4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:33:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2eed2264-3f92-49c2-8699-128092812402 req-07046dae-f6e3-4e2b-80c2-8b2707baf885 service nova] Releasing lock "refresh_cache-571ada6a-d632-4596-be98-9f72cab3b5f2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:13 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2176994e-875a-4a16-a317-5e8b096ad498 is timed out.
Oct 26 03:33:13 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Successfully detached device vdb from instance 2176994e-875a-4a16-a317-5e8b096ad498 from the live domain config.
Oct 26 03:33:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VtWXkfmb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:33:13 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ce5f95-9dd4-4075-b696-71dfbb9e9f27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:33:13 user nova-compute[74630]: No targets found.
Oct 26 03:33:13 user nova-compute[74630]: iSNS:
Oct 26 03:33:13 user nova-compute[74630]: No targets found.
Oct 26 03:33:13 user nova-compute[74630]: STATIC:
Oct 26 03:33:13 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:33:13 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:33:13 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:33:13 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b
Oct 26 03:33:13 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:33:13 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:33:13 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4
Oct 26 03:33:13 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:33:13 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:33:13 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf
Oct 26 03:33:13 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:33:13 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:33:13 user nova-compute[74630]: FIRMWARE:
Oct 26 03:33:13 user nova-compute[74630]: No targets found.
Oct 26 03:33:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:33:13 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:33:13 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[845994b5-6f54-46a4-9597-bfdcdc911d25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4998cd-5aa1-4c51-bd19-bd362ab30698]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:33:13 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:33:13 user nova-compute[74630]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf (non-flash)
Oct 26 03:33:13 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:33:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:33:13 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:33:13 user nova-compute[74630]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf (non-flash)
Oct 26 03:33:13 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:33:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f31842981f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf'): ({'sdc'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Removing single pathed devices sdc {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e764a71f-139a-4066-b18d-5b21c352a866]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5096c6a7-8aba-48b8-8acf-e2e2e34a1e39]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Flushing IO for device /dev/sdc {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9424dce6-dc71-4688-9610-2b25ceaba4e1]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[111581b9-23ce-40b3-9979-78b94c1f9a1a]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4973df-64d8-423f-a6eb-5d6499af8624]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b396b26f-46c7-4ee1-8146-08f7d44e812e]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf, portal: 172.16.0.220,3260]
Oct 26 03:33:13 user nova-compute[74630]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf, portal: 172.16.0.220,3260] successful.
Oct 26 03:33:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afdada84-a041-4a32-99e5-158d275b97cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[20018b07-fa7d-4a16-a12d-1e3ae6bf85cd]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] <== disconnect_volume: return (353ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:33:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:33:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:15 user nova-compute[74630]: DEBUG nova.objects.instance [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lazy-loading 'flavor' on Instance uuid 2176994e-875a-4a16-a317-5e8b096ad498 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:33:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e9175dd4-ac8b-40b3-9ea4-3661154a8377 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "2176994e-875a-4a16-a317-5e8b096ad498" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.738s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:20 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:33:22 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:33:22 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:33:23 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:33:23 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:33:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:23 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:33:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:33:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:33:28 user nova-compute[74630]: INFO nova.compute.manager [None req-66046b92-aec6-42fc-ac34-363ecf660e21 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Unrescuing
Oct 26 03:33:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-66046b92-aec6-42fc-ac34-363ecf660e21 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:33:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-66046b92-aec6-42fc-ac34-363ecf660e21 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquired lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:33:28 user nova-compute[74630]: DEBUG nova.network.neutron [None req-66046b92-aec6-42fc-ac34-363ecf660e21 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:33:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.network.neutron [None req-66046b92-aec6-42fc-ac34-363ecf660e21 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Updating instance_info_cache with network_info: [{"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbwnAisH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:33:29 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:33:29 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:33:29 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-66046b92-aec6-42fc-ac34-363ecf660e21 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Releasing lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.objects.instance [None req-66046b92-aec6-42fc-ac34-363ecf660e21 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'flavor' on Instance uuid e748e6b1-72d5-4832-a992-32070d237064 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:29 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:33:29 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=6702MB free_disk=25.017070770263672GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[261a1023-d21b-41c0-b4a2-2977f888177e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:33:29 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad91e7b7-7e5f-4105-b3e4-b73f63853893]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0] added
Oct 26 03:33:29 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1e7def-754d-4640-bf62-1c4c0231becd]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df5eb1d-7c12-4b83-99fa-32b0168a121a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zbwnAisH {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zbwnAisH" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a8e9bc-b92f-4ab4-9c2b-db76de4e714a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zbwnAisH'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe536659-5011-4b71-9436-abbaafac4650]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2377f878-f0aa-4572-a3d1-aa72f4e3eccc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:33:29 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:33:29 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:33:29 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:33:29 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:33:29 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:33:29 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 73ac3b23-4f52-4107-989a-bcb38b9e0a00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e748e6b1-72d5-4832-a992-32070d237064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 2176994e-875a-4a16-a317-5e8b096ad498 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance dedde109-8cf7-487d-be41-3b8951180c26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 571ada6a-d632-4596-be98-9f72cab3b5f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 0be74854-6a07-4468-bf1c-c41066af14c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e9b77844-67a8-4c26-90f2-afc1809b33d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 1e9d2b27-a936-4548-b74a-02a64f180234 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 0fb37042-4106-4bcc-a0fa-5e6ae614627f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c08d83-2865-434a-ae0e-e2dc8001c452]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0, portal: 172.16.0.220,3260]
Oct 26 03:33:29 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0, portal: 172.16.0.220,3260] successful.
Oct 26 03:33:29 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea18629-0e6c-47de-a32a-9289a6a2f3bc]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[298ec6b8-c304-4eaa-86df-dc704b9db3bb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:33:29 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:33:29 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:33:29 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:33:29 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:33:29 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:33:29 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:33:29 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:33:29 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f3919f-68aa-4196-9a5e-611d296a9cd6]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbwnAisH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-e1d1ad0e-26cb-4c11-889b-1fb6107a8ea2 req-43ca41cf-e5e5-4dc3-bd45-3b35e592eaa3 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-unplugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e1d1ad0e-26cb-4c11-889b-1fb6107a8ea2 req-43ca41cf-e5e5-4dc3-bd45-3b35e592eaa3 service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e1d1ad0e-26cb-4c11-889b-1fb6107a8ea2 req-43ca41cf-e5e5-4dc3-bd45-3b35e592eaa3 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e1d1ad0e-26cb-4c11-889b-1fb6107a8ea2 req-43ca41cf-e5e5-4dc3-bd45-3b35e592eaa3 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-e1d1ad0e-26cb-4c11-889b-1fb6107a8ea2 req-43ca41cf-e5e5-4dc3-bd45-3b35e592eaa3 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-unplugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:33:29 user nova-compute[74630]: WARNING nova.compute.manager [req-e1d1ad0e-26cb-4c11-889b-1fb6107a8ea2 req-43ca41cf-e5e5-4dc3-bd45-3b35e592eaa3 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-unplugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:33:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:33:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.692s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:30 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: e748e6b1-72d5-4832-a992-32070d237064] Instance destroyed successfully.
Oct 26 03:33:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:33:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26337633938383433', 'path': '/dev/sdc'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:33:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337633938383433', 'path': '/dev/sdc'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:33:30 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lazy-loading 'flavor' on Instance uuid 571ada6a-d632-4596-be98-9f72cab3b5f2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:33:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:33:30 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:33:30 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:33:30 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:33:30 user nova-compute[74630]:   <serial>bec64578-1c20-4a78-89d3-062cc96f95a0</serial>
Oct 26 03:33:30 user nova-compute[74630]: </disk>
Oct 26 03:33:30 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:33:31 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:33:31 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:33:31 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] No VIF found with MAC fa:16:3e:98:90:02, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:33:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ca817696-bab6-477f-bd6b-fea8bacc7a12 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.562s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-01cc7fc7-7798-40af-8125-8193d9a9efb6 req-dff11a44-9f1e-450e-8efa-12ebf1a23d14 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:33:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-01cc7fc7-7798-40af-8125-8193d9a9efb6 req-dff11a44-9f1e-450e-8efa-12ebf1a23d14 service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-01cc7fc7-7798-40af-8125-8193d9a9efb6 req-dff11a44-9f1e-450e-8efa-12ebf1a23d14 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-01cc7fc7-7798-40af-8125-8193d9a9efb6 req-dff11a44-9f1e-450e-8efa-12ebf1a23d14 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-01cc7fc7-7798-40af-8125-8193d9a9efb6 req-dff11a44-9f1e-450e-8efa-12ebf1a23d14 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:33:31 user nova-compute[74630]: WARNING nova.compute.manager [req-01cc7fc7-7798-40af-8125-8193d9a9efb6 req-dff11a44-9f1e-450e-8efa-12ebf1a23d14 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:33:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:31 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:33:31 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:33:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:33:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:33:32 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:33:32 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Updating instance_info_cache with network_info: [{"id": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "address": "fa:16:3e:1c:d5:8f", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f91f921-53", "ovs_interfaceid": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:33:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:33:32 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:33:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:33:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:33:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:33:32 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:33:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:33 user nova-compute[74630]: DEBUG nova.compute.manager [req-3818a9a3-b219-4efc-a181-e7ed8f7ac967 req-831f84ce-5821-47db-829e-8e4c250f7ca7 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:33:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3818a9a3-b219-4efc-a181-e7ed8f7ac967 req-831f84ce-5821-47db-829e-8e4c250f7ca7 service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3818a9a3-b219-4efc-a181-e7ed8f7ac967 req-831f84ce-5821-47db-829e-8e4c250f7ca7 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3818a9a3-b219-4efc-a181-e7ed8f7ac967 req-831f84ce-5821-47db-829e-8e4c250f7ca7 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:33 user nova-compute[74630]: DEBUG nova.compute.manager [req-3818a9a3-b219-4efc-a181-e7ed8f7ac967 req-831f84ce-5821-47db-829e-8e4c250f7ca7 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:33:33 user nova-compute[74630]: WARNING nova.compute.manager [req-3818a9a3-b219-4efc-a181-e7ed8f7ac967 req-831f84ce-5821-47db-829e-8e4c250f7ca7 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:33:33 user nova-compute[74630]: DEBUG nova.compute.manager [req-3818a9a3-b219-4efc-a181-e7ed8f7ac967 req-831f84ce-5821-47db-829e-8e4c250f7ca7 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:33:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3818a9a3-b219-4efc-a181-e7ed8f7ac967 req-831f84ce-5821-47db-829e-8e4c250f7ca7 service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3818a9a3-b219-4efc-a181-e7ed8f7ac967 req-831f84ce-5821-47db-829e-8e4c250f7ca7 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3818a9a3-b219-4efc-a181-e7ed8f7ac967 req-831f84ce-5821-47db-829e-8e4c250f7ca7 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:33 user nova-compute[74630]: DEBUG nova.compute.manager [req-3818a9a3-b219-4efc-a181-e7ed8f7ac967 req-831f84ce-5821-47db-829e-8e4c250f7ca7 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:33:33 user nova-compute[74630]: WARNING nova.compute.manager [req-3818a9a3-b219-4efc-a181-e7ed8f7ac967 req-831f84ce-5821-47db-829e-8e4c250f7ca7 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:33:34 user nova-compute[74630]: DEBUG nova.compute.manager [None req-66046b92-aec6-42fc-ac34-363ecf660e21 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:33:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-941991b1-b830-4971-8e66-c63af8bc0f73 req-8d206e41-55c8-494f-bf67-5c758ce31ef2 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-changed-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:33:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-941991b1-b830-4971-8e66-c63af8bc0f73 req-8d206e41-55c8-494f-bf67-5c758ce31ef2 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Refreshing instance network info cache due to event network-changed-02a0e249-0a94-475c-9754-2834697559c2. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:33:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-941991b1-b830-4971-8e66-c63af8bc0f73 req-8d206e41-55c8-494f-bf67-5c758ce31ef2 service nova] Acquiring lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:33:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-941991b1-b830-4971-8e66-c63af8bc0f73 req-8d206e41-55c8-494f-bf67-5c758ce31ef2 service nova] Acquired lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:33:51 user nova-compute[74630]: DEBUG nova.network.neutron [req-941991b1-b830-4971-8e66-c63af8bc0f73 req-8d206e41-55c8-494f-bf67-5c758ce31ef2 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Refreshing network info cache for port 02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:33:52 user nova-compute[74630]: DEBUG nova.network.neutron [req-941991b1-b830-4971-8e66-c63af8bc0f73 req-8d206e41-55c8-494f-bf67-5c758ce31ef2 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Updated VIF entry in instance network info cache for port 02a0e249-0a94-475c-9754-2834697559c2. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:33:52 user nova-compute[74630]: DEBUG nova.network.neutron [req-941991b1-b830-4971-8e66-c63af8bc0f73 req-8d206e41-55c8-494f-bf67-5c758ce31ef2 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Updating instance_info_cache with network_info: [{"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:33:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-941991b1-b830-4971-8e66-c63af8bc0f73 req-8d206e41-55c8-494f-bf67-5c758ce31ef2 service nova] Releasing lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:33:52 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:33:52 user nova-compute[74630]: INFO nova.compute.manager [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] instance snapshotting
Oct 26 03:33:52 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Beginning live snapshot process
Oct 26 03:33:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json -f qcow2 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json -f qcow2 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpckcieti8/518989b33d6444e5ba896fd90b0dbb38.delta 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpckcieti8/518989b33d6444e5ba896fd90b0dbb38.delta 1073741824" returned: 0 in 0.053s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:53 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 03:33:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquiring lock "2176994e-875a-4a16-a317-5e8b096ad498" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "2176994e-875a-4a16-a317-5e8b096ad498" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquiring lock "2176994e-875a-4a16-a317-5e8b096ad498-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "2176994e-875a-4a16-a317-5e8b096ad498-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "2176994e-875a-4a16-a317-5e8b096ad498-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:55 user nova-compute[74630]: INFO nova.compute.manager [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Terminating instance
Oct 26 03:33:55 user nova-compute[74630]: DEBUG nova.compute.manager [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:33:55 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 03:33:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpckcieti8/518989b33d6444e5ba896fd90b0dbb38.delta /opt/stack/data/nova/instances/snapshots/tmpckcieti8/518989b33d6444e5ba896fd90b0dbb38 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-26dc1da8-9c33-4561-a924-7d63da867570 req-21c9cf69-77da-47bd-92de-cf1bf18b71d6 service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Received event network-vif-unplugged-625775a7-bb89-41a3-80b4-1bdd23e48573 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-26dc1da8-9c33-4561-a924-7d63da867570 req-21c9cf69-77da-47bd-92de-cf1bf18b71d6 service nova] Acquiring lock "2176994e-875a-4a16-a317-5e8b096ad498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-26dc1da8-9c33-4561-a924-7d63da867570 req-21c9cf69-77da-47bd-92de-cf1bf18b71d6 service nova] Lock "2176994e-875a-4a16-a317-5e8b096ad498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-26dc1da8-9c33-4561-a924-7d63da867570 req-21c9cf69-77da-47bd-92de-cf1bf18b71d6 service nova] Lock "2176994e-875a-4a16-a317-5e8b096ad498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-26dc1da8-9c33-4561-a924-7d63da867570 req-21c9cf69-77da-47bd-92de-cf1bf18b71d6 service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] No waiting events found dispatching network-vif-unplugged-625775a7-bb89-41a3-80b4-1bdd23e48573 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-26dc1da8-9c33-4561-a924-7d63da867570 req-21c9cf69-77da-47bd-92de-cf1bf18b71d6 service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Received event network-vif-unplugged-625775a7-bb89-41a3-80b4-1bdd23e48573 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:55 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Instance destroyed successfully.
Oct 26 03:33:55 user nova-compute[74630]: DEBUG nova.objects.instance [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lazy-loading 'resources' on Instance uuid 2176994e-875a-4a16-a317-5e8b096ad498 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:30:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-45123639',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-45123639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4512363',id=24,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRBsGtFDngdAlOnv0jqclT9NV82R+HspPxqbgiiP3/udSCJl4elvfT5uGyChQ/0NiT+k7ULWx6ZSlp4qpVBMQcT5QH9Y74wo9hwpU7dl1lON7mR6yf2/yMlYAbbMXtgIQ==',key_name='tempest-keypair-703259415',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:30:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df98bab6a84d40edaba8d23037a97c83',ramdisk_id='',reservation_id='r-wk9u34a2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1156998690',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4c0145cf998439585bddc5572262d77',uuid=2176994e-875a-4a16-a317-5e8b096ad498,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "625775a7-bb89-41a3-80b4-1bdd23e48573", "address": "fa:16:3e:92:75:eb", "network": {"id": "1854c96b-487b-41d7-b6b9-a43a6e98588f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1416087294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df98bab6a84d40edaba8d23037a97c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625775a7-bb", "ovs_interfaceid": "625775a7-bb89-41a3-80b4-1bdd23e48573", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Converting VIF {"id": "625775a7-bb89-41a3-80b4-1bdd23e48573", "address": "fa:16:3e:92:75:eb", "network": {"id": "1854c96b-487b-41d7-b6b9-a43a6e98588f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1416087294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df98bab6a84d40edaba8d23037a97c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625775a7-bb", "ovs_interfaceid": "625775a7-bb89-41a3-80b4-1bdd23e48573", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:75:eb,bridge_name='br-int',has_traffic_filtering=True,id=625775a7-bb89-41a3-80b4-1bdd23e48573,network=Network(1854c96b-487b-41d7-b6b9-a43a6e98588f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625775a7-bb') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG os_vif [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:75:eb,bridge_name='br-int',has_traffic_filtering=True,id=625775a7-bb89-41a3-80b4-1bdd23e48573,network=Network(1854c96b-487b-41d7-b6b9-a43a6e98588f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625775a7-bb') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpckcieti8/518989b33d6444e5ba896fd90b0dbb38.delta /opt/stack/data/nova/instances/snapshots/tmpckcieti8/518989b33d6444e5ba896fd90b0dbb38" returned: 0 in 0.706s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:55 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Snapshot extracted, beginning image upload
Oct 26 03:33:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap625775a7-bb, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5061aaf6-b001-4276-9786-b88604db629e) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:33:55 user nova-compute[74630]: INFO os_vif [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:75:eb,bridge_name='br-int',has_traffic_filtering=True,id=625775a7-bb89-41a3-80b4-1bdd23e48573,network=Network(1854c96b-487b-41d7-b6b9-a43a6e98588f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625775a7-bb')
Oct 26 03:33:55 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Deleting instance files /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498_del
Oct 26 03:33:55 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Deletion of /opt/stack/data/nova/instances/2176994e-875a-4a16-a317-5e8b096ad498_del complete
Oct 26 03:33:56 user nova-compute[74630]: INFO nova.compute.manager [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 26 03:33:56 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:33:56 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:33:56 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:33:57 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:33:57 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Took 0.98 seconds to deallocate network for instance.
Oct 26 03:33:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:57 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:33:57 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:33:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:57 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Deleted allocations for instance 2176994e-875a-4a16-a317-5e8b096ad498
Oct 26 03:33:57 user nova-compute[74630]: DEBUG nova.compute.manager [req-7a116a4d-41f1-4286-9740-450161d0289c req-57344a4c-6072-4e2f-87db-28e299acca62 service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Received event network-vif-plugged-625775a7-bb89-41a3-80b4-1bdd23e48573 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:33:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7a116a4d-41f1-4286-9740-450161d0289c req-57344a4c-6072-4e2f-87db-28e299acca62 service nova] Acquiring lock "2176994e-875a-4a16-a317-5e8b096ad498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:33:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7a116a4d-41f1-4286-9740-450161d0289c req-57344a4c-6072-4e2f-87db-28e299acca62 service nova] Lock "2176994e-875a-4a16-a317-5e8b096ad498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:33:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7a116a4d-41f1-4286-9740-450161d0289c req-57344a4c-6072-4e2f-87db-28e299acca62 service nova] Lock "2176994e-875a-4a16-a317-5e8b096ad498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:57 user nova-compute[74630]: DEBUG nova.compute.manager [req-7a116a4d-41f1-4286-9740-450161d0289c req-57344a4c-6072-4e2f-87db-28e299acca62 service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] No waiting events found dispatching network-vif-plugged-625775a7-bb89-41a3-80b4-1bdd23e48573 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:33:57 user nova-compute[74630]: WARNING nova.compute.manager [req-7a116a4d-41f1-4286-9740-450161d0289c req-57344a4c-6072-4e2f-87db-28e299acca62 service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Received unexpected event network-vif-plugged-625775a7-bb89-41a3-80b4-1bdd23e48573 for instance with vm_state deleted and task_state None.
Oct 26 03:33:57 user nova-compute[74630]: DEBUG nova.compute.manager [req-7a116a4d-41f1-4286-9740-450161d0289c req-57344a4c-6072-4e2f-87db-28e299acca62 service nova] [instance: 2176994e-875a-4a16-a317-5e8b096ad498] Received event network-vif-deleted-625775a7-bb89-41a3-80b4-1bdd23e48573 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:33:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-521a3fe5-8d82-4dc1-89b3-4797e6ec7012 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690 tempest-TestServerVolumeAttachScenarioOldVersion-1156998690-project-member] Lock "2176994e-875a-4a16-a317-5e8b096ad498" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.772s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jdPVRBJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:33:58 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:33:58 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:33:58 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e353086-4327-4414-a300-f7b1a7da0803]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:33:58 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d9cfbe-6c3d-4da0-9a7a-737e74da4f9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c] added
Oct 26 03:33:58 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d3828b-adf2-4e09-b7d1-f38f725f7dc2]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4e3258-6133-4dfe-bfd4-9e6539747214]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jdPVRBJT {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jdPVRBJT" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d8c9eb-fed6-4a3d-aaad-6bf771159615]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jdPVRBJT'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.040s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f402da5f-e806-4773-8b57-6f0f4d659208]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9b6dac-b62a-4106-b968-9bc2853a9d6b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:33:58 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:33:58 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:33:58 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:33:58 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:33:58 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:33:58 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:33:58 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:33:58 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd07f317-42b1-43f5-9db7-3db0dfd2508f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c, portal: 172.16.0.220,3260]
Oct 26 03:33:58 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c, portal: 172.16.0.220,3260] successful.
Oct 26 03:33:58 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[52879e54-f603-4279-b0c1-ff5572621f24]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e830e33-e81a-490c-9246-d86d4d541d60]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:33:58 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:33:58 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:33:58 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:33:58 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:33:58 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:33:58 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:33:58 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:33:58 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:33:58 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:33:58 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8877e2d-5eec-4123-b62b-8e7628bdf38f]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:33:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jdPVRBJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:33:58 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Snapshot image upload complete
Oct 26 03:33:58 user nova-compute[74630]: INFO nova.compute.manager [None req-4e2ff152-1f2a-478d-8f89-545f00ebe05e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Took 6.01 seconds to snapshot the instance on the hypervisor.
Oct 26 03:33:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:33:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23133653166623536', 'path': '/dev/sdf'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:33:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133653166623536', 'path': '/dev/sdf'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:33:59 user nova-compute[74630]: DEBUG nova.objects.instance [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lazy-loading 'flavor' on Instance uuid dedde109-8cf7-487d-be41-3b8951180c26 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:33:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:33:59 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:33:59 user nova-compute[74630]:   <source dev="/dev/sdf"/>
Oct 26 03:33:59 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:33:59 user nova-compute[74630]:   <serial>87523dc8-b43f-44b1-8692-4eb1a84c498c</serial>
Oct 26 03:33:59 user nova-compute[74630]: </disk>
Oct 26 03:33:59 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:34:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:34:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:34:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] No VIF found with MAC fa:16:3e:30:29:c4, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:34:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9ad30ca9-c680-4059-a2a7-6175a9a44402 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 62.871s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:34:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "11c75096-6769-4f10-8515-c96b592958a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:02 user nova-compute[74630]: DEBUG nova.compute.manager [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:34:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:34:02 user nova-compute[74630]: INFO nova.compute.claims [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Claim successful on node user
Oct 26 03:34:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-a15a746d-07d0-42e3-abf1-7f85f3c44f2e req-4f5cf887-3c7b-4631-b2c1-f059007681af service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Received event network-changed-d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:34:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-a15a746d-07d0-42e3-abf1-7f85f3c44f2e req-4f5cf887-3c7b-4631-b2c1-f059007681af service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Refreshing instance network info cache due to event network-changed-d789f079-694d-48c0-91ed-ae69fa259a1a. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:34:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a15a746d-07d0-42e3-abf1-7f85f3c44f2e req-4f5cf887-3c7b-4631-b2c1-f059007681af service nova] Acquiring lock "refresh_cache-e9b77844-67a8-4c26-90f2-afc1809b33d1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:34:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a15a746d-07d0-42e3-abf1-7f85f3c44f2e req-4f5cf887-3c7b-4631-b2c1-f059007681af service nova] Acquired lock "refresh_cache-e9b77844-67a8-4c26-90f2-afc1809b33d1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:34:02 user nova-compute[74630]: DEBUG nova.network.neutron [req-a15a746d-07d0-42e3-abf1-7f85f3c44f2e req-4f5cf887-3c7b-4631-b2c1-f059007681af service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Refreshing network info cache for port d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:34:02 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:34:02 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.679s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG nova.compute.manager [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG nova.compute.manager [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG nova.network.neutron [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:34:03 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:34:03 user nova-compute[74630]: DEBUG nova.compute.manager [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:34:03 user nova-compute[74630]: INFO nova.virt.block_device [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Booting with volume 1b57f591-6788-40fb-b889-6c0117ae1794 at /dev/vda
Oct 26 03:34:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG nova.policy [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a419737713f4797ab27db62d5aa746c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51542ffdf7a84ac5a61f14e124eb2087', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG os_brick.utils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG nova.objects.instance [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lazy-loading 'flavor' on Instance uuid e9b77844-67a8-4c26-90f2-afc1809b33d1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51f3d4c-83a1-4758-8090-e512fa8e1f3f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2420b4d3-cc2a-45df-99a3-d6c4c367ef67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[566a536a-2b87-4273-a238-d2392ebf63e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b5e6ff-e96b-4dba-a9d3-f8e40b5e2652]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:34:03 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b27b98-5d04-479c-9f11-381b165b243e]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG os_brick.utils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] <== get_connector_properties: return (206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Updating existing volume attachment record: 551850f5-4a96-4ef9-ba80-81fea0d83670 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG nova.network.neutron [req-a15a746d-07d0-42e3-abf1-7f85f3c44f2e req-4f5cf887-3c7b-4631-b2c1-f059007681af service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Updated VIF entry in instance network info cache for port d789f079-694d-48c0-91ed-ae69fa259a1a. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG nova.network.neutron [req-a15a746d-07d0-42e3-abf1-7f85f3c44f2e req-4f5cf887-3c7b-4631-b2c1-f059007681af service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Updating instance_info_cache with network_info: [{"id": "d789f079-694d-48c0-91ed-ae69fa259a1a", "address": "fa:16:3e:e1:1e:5c", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd789f079-69", "ovs_interfaceid": "d789f079-694d-48c0-91ed-ae69fa259a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a15a746d-07d0-42e3-abf1-7f85f3c44f2e req-4f5cf887-3c7b-4631-b2c1-f059007681af service nova] Releasing lock "refresh_cache-e9b77844-67a8-4c26-90f2-afc1809b33d1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:03 user nova-compute[74630]: INFO nova.compute.manager [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Attaching volume 94837b5c-b6c7-4955-92cf-b431e71ca8dc to /dev/vdb
Oct 26 03:34:03 user nova-compute[74630]: DEBUG os_brick.utils [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aab81ff-8587-4271-995e-210a39d22a72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e2b3e9-489d-4a3f-a3ec-b017a46566cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6948cd5-9281-4277-af2b-e4382f5a86de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8570ea56-d5ea-478d-b9f8-0973b4c0fbc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:34:04 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:34:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2f1618-ac00-4b84-9c79-64ef7a75392f]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG os_brick.utils [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Updating existing volume attachment record: 9c17f2af-3681-4f68-960f-405c9dc31b1d {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG nova.network.neutron [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Successfully created port: 3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "dedde109-8cf7-487d-be41-3b8951180c26" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG nova.objects.instance [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lazy-loading 'flavor' on Instance uuid dedde109-8cf7-487d-be41-3b8951180c26 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG nova.network.neutron [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Successfully updated port: 3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquired lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG nova.network.neutron [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "dedde109-8cf7-487d-be41-3b8951180c26" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:04 user nova-compute[74630]: INFO nova.compute.manager [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Attaching volume af5bb213-c9eb-4be4-8097-0db89ef69d31 to /dev/vdc
Oct 26 03:34:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-8cfa02b8-cd87-4abe-9710-bfb642df712e req-eca7126e-fa39-4205-be92-83c47f15e702 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-changed-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-8cfa02b8-cd87-4abe-9710-bfb642df712e req-eca7126e-fa39-4205-be92-83c47f15e702 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Refreshing instance network info cache due to event network-changed-3c4b3126-d447-40d7-821e-2395434c6d58. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8cfa02b8-cd87-4abe-9710-bfb642df712e req-eca7126e-fa39-4205-be92-83c47f15e702 service nova] Acquiring lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG nova.network.neutron [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG os_brick.utils [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9d6901-ae0d-4342-9331-812dfa6bdbbf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d33297-db68-45cd-8a5d-81ed415ad01e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1b3ae6-cb12-469f-aab0-026e089bf60d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a75d0c0-053b-421a-bd54-df511b0005d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:34:05 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[98761fe4-aa00-41e0-b8fb-14827674905b]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG os_brick.utils [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Updating existing volume attachment record: 9e9451ac-13e7-46d3-9e47-f3c76f6324fa {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG nova.network.neutron [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Updating instance_info_cache with network_info: [{"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Releasing lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG nova.compute.manager [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Instance network_info: |[{"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8cfa02b8-cd87-4abe-9710-bfb642df712e req-eca7126e-fa39-4205-be92-83c47f15e702 service nova] Acquired lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG nova.network.neutron [req-8cfa02b8-cd87-4abe-9710-bfb642df712e req-eca7126e-fa39-4205-be92-83c47f15e702 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Refreshing network info cache for port 3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG nova.network.neutron [req-8cfa02b8-cd87-4abe-9710-bfb642df712e req-eca7126e-fa39-4205-be92-83c47f15e702 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Updated VIF entry in instance network info cache for port 3c4b3126-d447-40d7-821e-2395434c6d58. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG nova.network.neutron [req-8cfa02b8-cd87-4abe-9710-bfb642df712e req-eca7126e-fa39-4205-be92-83c47f15e702 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Updating instance_info_cache with network_info: [{"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8cfa02b8-cd87-4abe-9710-bfb642df712e req-eca7126e-fa39-4205-be92-83c47f15e702 service nova] Releasing lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:34:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:22 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:34:23 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:34:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsEQpceN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:34:24 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:34:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:34:24 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:34:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:34:24 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c97dc0-5133-4110-8afa-17e5ddf0fbb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:34:24 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab9309a-d885-4033-8274-6512abb933fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31] added
Oct 26 03:34:24 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[051f2f6a-7450-4fce-8acc-7ba62c6fd83c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[532f7ea6-e806-462b-a598-5550cfe4710e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vsEQpceN {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vsEQpceN" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a14315-ffee-4e2b-af80-17c4be8cca72]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vsEQpceN'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2926a372-45c9-40cd-b132-9b4bff934fc1]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[218e4a0d-b10c-41a7-95c9-d72bb44730bd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:34:24 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:34:24 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:34:24 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:34:24 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:34:24 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:34:24 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:34:24 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:34:24 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:34:24 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:34:24 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6762c224-306f-4ddc-8fca-2bbe0e54100a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31, portal: 172.16.0.220,3260]
Oct 26 03:34:24 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31, portal: 172.16.0.220,3260] successful.
Oct 26 03:34:24 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[12008ceb-2c06-4cc7-a681-d63c5f1580a0]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceca98f-ab6c-449e-bc9a-9affdf4c7b08]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:34:25 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:34:25 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:34:25 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:34:25 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:34:25 user nova-compute[74630]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 (non-flash)
Oct 26 03:34:25 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:34:25 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:34:25 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:34:25 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:34:25 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:34:25 user nova-compute[74630]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 (non-flash)
Oct 26 03:34:25 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeae06ca-93f2-417c-9fb2-9d5dd74597c6]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsEQpceN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26637336166363438', 'path': '/dev/sdg'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637336166363438', 'path': '/dev/sdg'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG nova.objects.instance [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lazy-loading 'flavor' on Instance uuid dedde109-8cf7-487d-be41-3b8951180c26 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:34:26 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:34:26 user nova-compute[74630]:   <source dev="/dev/sdg"/>
Oct 26 03:34:26 user nova-compute[74630]:   <target dev="vdc" bus="virtio"/>
Oct 26 03:34:26 user nova-compute[74630]:   <serial>af5bb213-c9eb-4be4-8097-0db89ef69d31</serial>
Oct 26 03:34:26 user nova-compute[74630]: </disk>
Oct 26 03:34:26 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] No VIF found with MAC fa:16:3e:30:29:c4, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22304fe6-1586-41bf-939e-3423df677c77 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.747s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "dedde109-8cf7-487d-be41-3b8951180c26" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:27 user nova-compute[74630]: INFO nova.compute.manager [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Detaching volume af5bb213-c9eb-4be4-8097-0db89ef69d31
Oct 26 03:34:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:27 user nova-compute[74630]: INFO nova.virt.block_device [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Attempting to driver detach volume af5bb213-c9eb-4be4-8097-0db89ef69d31 from mountpoint /dev/vdc
Oct 26 03:34:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Attempting to detach device vdc from instance dedde109-8cf7-487d-be41-3b8951180c26 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:34:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:34:27 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:34:27 user nova-compute[74630]:   <source dev="/dev/sdg"/>
Oct 26 03:34:27 user nova-compute[74630]:   <target dev="vdc" bus="virtio"/>
Oct 26 03:34:27 user nova-compute[74630]:   <serial>af5bb213-c9eb-4be4-8097-0db89ef69d31</serial>
Oct 26 03:34:27 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 03:34:27 user nova-compute[74630]: </disk>
Oct 26 03:34:27 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:34:27 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Successfully detached device vdc from instance dedde109-8cf7-487d-be41-3b8951180c26 from the persistent domain config.
Oct 26 03:34:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance dedde109-8cf7-487d-be41-3b8951180c26 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:34:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:34:27 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:34:27 user nova-compute[74630]:   <source dev="/dev/sdg"/>
Oct 26 03:34:27 user nova-compute[74630]:   <target dev="vdc" bus="virtio"/>
Oct 26 03:34:27 user nova-compute[74630]:   <serial>af5bb213-c9eb-4be4-8097-0db89ef69d31</serial>
Oct 26 03:34:27 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 03:34:27 user nova-compute[74630]: </disk>
Oct 26 03:34:27 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:34:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:34:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:34:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance dedde109-8cf7-487d-be41-3b8951180c26 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:34:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:34:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:34:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:34:30 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:34:30 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:34:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=6851MB free_disk=24.95612335205078GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:34:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 73ac3b23-4f52-4107-989a-bcb38b9e0a00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e748e6b1-72d5-4832-a992-32070d237064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance dedde109-8cf7-487d-be41-3b8951180c26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 571ada6a-d632-4596-be98-9f72cab3b5f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 0be74854-6a07-4468-bf1c-c41066af14c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e9b77844-67a8-4c26-90f2-afc1809b33d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 1e9d2b27-a936-4548-b74a-02a64f180234 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 0fb37042-4106-4bcc-a0fa-5e6ae614627f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 11c75096-6769-4f10-8515-c96b592958a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:34:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:34:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:34:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:34:32 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:34:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:34:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:34:32 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Updating instance_info_cache with network_info: [{"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG nova.compute.manager [req-f4af2348-a1ab-4548-b0f5-a7ccf2727ec6 req-bedd79e0-e472-498d-b5fd-315ebd7ce26d service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Received event network-changed-6245c02f-13dd-4ab2-b490-8156f850a3de {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG nova.compute.manager [req-f4af2348-a1ab-4548-b0f5-a7ccf2727ec6 req-bedd79e0-e472-498d-b5fd-315ebd7ce26d service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Refreshing instance network info cache due to event network-changed-6245c02f-13dd-4ab2-b490-8156f850a3de. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f4af2348-a1ab-4548-b0f5-a7ccf2727ec6 req-bedd79e0-e472-498d-b5fd-315ebd7ce26d service nova] Acquiring lock "refresh_cache-1e9d2b27-a936-4548-b74a-02a64f180234" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f4af2348-a1ab-4548-b0f5-a7ccf2727ec6 req-bedd79e0-e472-498d-b5fd-315ebd7ce26d service nova] Acquired lock "refresh_cache-1e9d2b27-a936-4548-b74a-02a64f180234" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG nova.network.neutron [req-f4af2348-a1ab-4548-b0f5-a7ccf2727ec6 req-bedd79e0-e472-498d-b5fd-315ebd7ce26d service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Refreshing network info cache for port 6245c02f-13dd-4ab2-b490-8156f850a3de {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG nova.network.neutron [req-f4af2348-a1ab-4548-b0f5-a7ccf2727ec6 req-bedd79e0-e472-498d-b5fd-315ebd7ce26d service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Updated VIF entry in instance network info cache for port 6245c02f-13dd-4ab2-b490-8156f850a3de. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG nova.network.neutron [req-f4af2348-a1ab-4548-b0f5-a7ccf2727ec6 req-bedd79e0-e472-498d-b5fd-315ebd7ce26d service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Updating instance_info_cache with network_info: [{"id": "6245c02f-13dd-4ab2-b490-8156f850a3de", "address": "fa:16:3e:28:df:29", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6245c02f-13", "ovs_interfaceid": "6245c02f-13dd-4ab2-b490-8156f850a3de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:34:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f4af2348-a1ab-4548-b0f5-a7ccf2727ec6 req-bedd79e0-e472-498d-b5fd-315ebd7ce26d service nova] Releasing lock "refresh_cache-1e9d2b27-a936-4548-b74a-02a64f180234" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:34:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:37 user nova-compute[74630]: INFO nova.compute.manager [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Rescuing
Oct 26 03:34:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "refresh_cache-0be74854-6a07-4468-bf1c-c41066af14c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:34:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquired lock "refresh_cache-0be74854-6a07-4468-bf1c-c41066af14c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:34:37 user nova-compute[74630]: DEBUG nova.network.neutron [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:34:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:38 user nova-compute[74630]: DEBUG nova.network.neutron [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Updating instance_info_cache with network_info: [{"id": "81e27221-96a7-4492-b72b-a0ed4f496f09", "address": "fa:16:3e:21:e1:c5", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e27221-96", "ovs_interfaceid": "81e27221-96a7-4492-b72b-a0ed4f496f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:34:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Releasing lock "refresh_cache-0be74854-6a07-4468-bf1c-c41066af14c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:34:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:39 user nova-compute[74630]: DEBUG nova.compute.manager [req-9e1a7736-3aae-4b0f-a13f-3bb0361b30d3 req-5ee7f980-b164-4926-9114-8f78243f5836 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received event network-vif-unplugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:34:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9e1a7736-3aae-4b0f-a13f-3bb0361b30d3 req-5ee7f980-b164-4926-9114-8f78243f5836 service nova] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9e1a7736-3aae-4b0f-a13f-3bb0361b30d3 req-5ee7f980-b164-4926-9114-8f78243f5836 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9e1a7736-3aae-4b0f-a13f-3bb0361b30d3 req-5ee7f980-b164-4926-9114-8f78243f5836 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:34:39 user nova-compute[74630]: DEBUG nova.compute.manager [req-9e1a7736-3aae-4b0f-a13f-3bb0361b30d3 req-5ee7f980-b164-4926-9114-8f78243f5836 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] No waiting events found dispatching network-vif-unplugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:34:39 user nova-compute[74630]: WARNING nova.compute.manager [req-9e1a7736-3aae-4b0f-a13f-3bb0361b30d3 req-5ee7f980-b164-4926-9114-8f78243f5836 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received unexpected event network-vif-unplugged-81e27221-96a7-4492-b72b-a0ed4f496f09 for instance with vm_state active and task_state rescuing.
Oct 26 03:34:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:39 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Instance destroyed successfully.
Oct 26 03:34:39 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Attempting a stable device rescue
Oct 26 03:34:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74630) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 03:34:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Instance directory exists: not creating {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 03:34:39 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Creating image(s)
Oct 26 03:34:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "/opt/stack/data/nova/instances/0be74854-6a07-4468-bf1c-c41066af14c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "/opt/stack/data/nova/instances/0be74854-6a07-4468-bf1c-c41066af14c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "/opt/stack/data/nova/instances/0be74854-6a07-4468-bf1c-c41066af14c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:34:39 user nova-compute[74630]: DEBUG nova.objects.instance [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0be74854-6a07-4468-bf1c-c41066af14c2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:34:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "1a55ee76dab11daa408798d5c85e1b874548b0a9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "1a55ee76dab11daa408798d5c85e1b874548b0a9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a55ee76dab11daa408798d5c85e1b874548b0a9.part --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "1e9d2b27-a936-4548-b74a-02a64f180234" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "1e9d2b27-a936-4548-b74a-02a64f180234" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:40 user nova-compute[74630]: DEBUG nova.objects.instance [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'flavor' on Instance uuid 1e9d2b27-a936-4548-b74a-02a64f180234 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:34:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "1e9d2b27-a936-4548-b74a-02a64f180234" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a55ee76dab11daa408798d5c85e1b874548b0a9.part --force-share --output=json" returned: 0 in 0.172s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG nova.virt.images [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] 3e4eb6b1-015c-4924-af32-5ed79c0b66a3 was qcow2, converting to raw {{(pid=74630) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1a55ee76dab11daa408798d5c85e1b874548b0a9.part /opt/stack/data/nova/instances/_base/1a55ee76dab11daa408798d5c85e1b874548b0a9.converted {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "1e9d2b27-a936-4548-b74a-02a64f180234" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "1e9d2b27-a936-4548-b74a-02a64f180234" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:41 user nova-compute[74630]: INFO nova.compute.manager [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Attaching volume ebf9bd14-fef2-469a-a7c4-57ba638131e8 to /dev/vdb
Oct 26 03:34:41 user nova-compute[74630]: DEBUG os_brick.utils [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34ade13-e1d1-4f84-a23d-b8240beae227]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a495f174-8e59-44f2-ac70-48bb28660641]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f71ae5-968e-4e70-907f-facdbd72f5a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a58815-15d0-4231-9a37-90c0d6c560ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-4470a56f-d79f-4e5f-a0aa-a52aaa09e820 req-01546516-044c-4adc-aae2-331026343e71 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4470a56f-d79f-4e5f-a0aa-a52aaa09e820 req-01546516-044c-4adc-aae2-331026343e71 service nova] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4470a56f-d79f-4e5f-a0aa-a52aaa09e820 req-01546516-044c-4adc-aae2-331026343e71 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4470a56f-d79f-4e5f-a0aa-a52aaa09e820 req-01546516-044c-4adc-aae2-331026343e71 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-4470a56f-d79f-4e5f-a0aa-a52aaa09e820 req-01546516-044c-4adc-aae2-331026343e71 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] No waiting events found dispatching network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:34:41 user nova-compute[74630]: WARNING nova.compute.manager [req-4470a56f-d79f-4e5f-a0aa-a52aaa09e820 req-01546516-044c-4adc-aae2-331026343e71 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received unexpected event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 for instance with vm_state active and task_state rescuing.
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:34:41 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad7b6b9-6aeb-4514-bc06-356bd3a43b93]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG os_brick.utils [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Updating existing volume attachment record: 52256495-190e-4e12-9790-6af2c6a839fa {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1a55ee76dab11daa408798d5c85e1b874548b0a9.part /opt/stack/data/nova/instances/_base/1a55ee76dab11daa408798d5c85e1b874548b0a9.converted" returned: 0 in 0.594s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a55ee76dab11daa408798d5c85e1b874548b0a9.converted --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a55ee76dab11daa408798d5c85e1b874548b0a9.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "1a55ee76dab11daa408798d5c85e1b874548b0a9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.019s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "1a55ee76dab11daa408798d5c85e1b874548b0a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "1a55ee76dab11daa408798d5c85e1b874548b0a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a55ee76dab11daa408798d5c85e1b874548b0a9 --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a55ee76dab11daa408798d5c85e1b874548b0a9 --force-share --output=json" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a55ee76dab11daa408798d5c85e1b874548b0a9,backing_fmt=raw /opt/stack/data/nova/instances/0be74854-6a07-4468-bf1c-c41066af14c2/disk.rescue {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a55ee76dab11daa408798d5c85e1b874548b0a9,backing_fmt=raw /opt/stack/data/nova/instances/0be74854-6a07-4468-bf1c-c41066af14c2/disk.rescue" returned: 0 in 0.053s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "1a55ee76dab11daa408798d5c85e1b874548b0a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.objects.instance [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'migration_context' on Instance uuid 0be74854-6a07-4468-bf1c-c41066af14c2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.objects.base [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Object Instance<0be74854-6a07-4468-bf1c-c41066af14c2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Start _get_guest_xml network_info=[{"id": "81e27221-96a7-4492-b72b-a0ed4f496f09", "address": "fa:16:3e:21:e1:c5", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "vif_mac": "fa:16:3e:21:e1:c5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e27221-96", "ovs_interfaceid": "81e27221-96a7-4492-b72b-a0ed4f496f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3e4eb6b1-015c-4924-af32-5ed79c0b66a3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eajGSbBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '0be74854-6a07-4468-bf1c-c41066af14c2', 'attached_at': '', 'detached_at': '', 'volume_id': '02cc9efa-096f-4682-b557-ab809630abe4', 'serial': '02cc9efa-096f-4682-b557-ab809630abe4'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '346bfe89-b875-45f6-a43d-18325ec04fb6', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.objects.instance [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'resources' on Instance uuid 0be74854-6a07-4468-bf1c-c41066af14c2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.objects.base [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Object Instance<0be74854-6a07-4468-bf1c-c41066af14c2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.objects.instance [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'numa_topology' on Instance uuid 0be74854-6a07-4468-bf1c-c41066af14c2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.objects.base [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Object Instance<0be74854-6a07-4468-bf1c-c41066af14c2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:34:42 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:34:42 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.objects.instance [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0be74854-6a07-4468-bf1c-c41066af14c2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.objects.base [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Object Instance<0be74854-6a07-4468-bf1c-c41066af14c2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eajGSbBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:34:42 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:34:42 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:34:42 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cf53d9-4d50-4bb7-b5d3-548ac88357d5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = eajGSbBx\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 03:34:42 user nova-compute[74630]: node.name = iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4
Oct 26 03:34:42 user nova-compute[74630]: node.tpgt = -1
Oct 26 03:34:42 user nova-compute[74630]: node.startup = automatic
Oct 26 03:34:42 user nova-compute[74630]: node.leading_login = No
Oct 26 03:34:42 user nova-compute[74630]: iface.iscsi_ifacename = default
Oct 26 03:34:42 user nova-compute[74630]: iface.net_ifacename = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.ipaddress = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.prefix_len = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.hwaddress = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.transport_name = tcp
Oct 26 03:34:42 user nova-compute[74630]: iface.initiatorname = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.state = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.vlan_id = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.vlan_priority = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.vlan_state = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.iface_num = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.mtu = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.port = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.bootproto = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.subnet_mask = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.gateway = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.dhcp_alt_client_id = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.dhcp_dns = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.dhcp_learn_iqn = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.dhcp_vendor_id_state = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.dhcp_vendor_id = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.dhcp_slp_da = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.fragmentation = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.gratuitous_arp = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.incoming_forwarding = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.tos_state = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.tos = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.ttl = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.delayed_ack = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.tcp_nagle = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.tcp_wsf_state = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.tcp_wsf = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.tcp_timer_scale = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.tcp_timestamp = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.redirect = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.def_task_mgmt_timeout = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.header_digest = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.data_digest = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.immediate_data = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.initial_r2t = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.data_seq_inorder = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.data_pdu_inorder = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.erl = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.max_receive_data_len = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.first_burst_len = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.max_outstanding_r2t = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.max_burst_len = 0
Oct 26 03:34:42 user nova-compute[74630]: iface.chap_auth = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.bidi_chap = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.strict_login_compliance = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.discovery_auth = <empty>
Oct 26 03:34:42 user nova-compute[74630]: iface.discovery_logout = <empty>
Oct 26 03:34:42 user nova-compute[74630]: node.discovery_address = <empty>
Oct 26 03:34:42 user nova-compute[74630]: node.discovery_port = 0
Oct 26 03:34:42 user nova-compute[74630]: node.discovery_type = static
Oct 26 03:34:42 user nova-compute[74630]: node.session.initial_cmdsn = 0
Oct 26 03:34:42 user nova-compute[74630]: node.session.initial_login_retry_max = 8
Oct 26 03:34:42 user nova-compute[74630]: node.session.xmit_thread_priority = -20
Oct 26 03:34:42 user nova-compute[74630]: node.session.cmds_max = 128
Oct 26 03:34:42 user nova-compute[74630]: node.session.queue_depth = 32
Oct 26 03:34:42 user nova-compute[74630]: node.session.nr_sessions = 1
Oct 26 03:34:42 user nova-compute[74630]: node.session.auth.authmethod = CHAP
Oct 26 03:34:42 user nova-compute[74630]: node.session.auth.username = eajGSbBx
Oct 26 03:34:42 user nova-compute[74630]: node.session.auth.password = ***
Oct 26 03:34:42 user nova-compute[74630]: node.session.auth.username_in = <empty>
Oct 26 03:34:42 user nova-compute[74630]: node.session.auth.password_in = <empty>
Oct 26 03:34:42 user nova-compute[74630]: node.session.auth.chap_algs = MD5
Oct 26 03:34:42 user nova-compute[74630]: node.session.timeo.replacement_timeout = 120
Oct 26 03:34:42 user nova-compute[74630]: node.session.err_timeo.abort_timeout = 15
Oct 26 03:34:42 user nova-compute[74630]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 03:34:42 user nova-compute[74630]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 03:34:42 user nova-compute[74630]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 03:34:42 user nova-compute[74630]: node.session.iscsi.FastAbort = Yes
Oct 26 03:34:42 user nova-compute[74630]: node.session.iscsi.InitialR2T = No
Oct 26 03:34:42 user nova-compute[74630]: node.session.iscsi.ImmediateData = Yes
Oct 26 03:34:42 user nova-compute[74630]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 03:34:42 user nova-compute[74630]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 03:34:42 user nova-compute[74630]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 03:34:42 user nova-compute[74630]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 03:34:42 user nova-compute[74630]: node.session.iscsi.MaxConnections = 1
Oct 26 03:34:42 user nova-compute[74630]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 03:34:42 user nova-compute[74630]: node.session.iscsi.ERL = 0
Oct 26 03:34:42 user nova-compute[74630]: node.session.scan = manual
Oct 26 03:34:42 user nova-compute[74630]: node.session.reopen_max = 0
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].address = 172.16.0.220
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].port = 3260
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].startup = manual
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].tcp.window_size = 524288
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].tcp.type_of_service = 0
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].timeo.logout_timeout = 15
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].timeo.login_timeout = 15
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].timeo.auth_timeout = 45
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].iscsi.DataDigest = None
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].iscsi.IFMarker = No
Oct 26 03:34:42 user nova-compute[74630]: node.conn[0].iscsi.OFMarker = No
Oct 26 03:34:42 user nova-compute[74630]: # END RECORD
Oct 26 03:34:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[38444856-749c-413a-93b6-2536168e8a51]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9054b1c8-0a0b-4e98-8b34-81c7ea3b50a2]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eajGSbBx {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eajGSbBx" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd59730-0dd6-465b-93d9-79576715e585]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eajGSbBx'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f204046-755f-44cb-9756-ba36268b786b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[584f2f82-22c8-48e4-a051-ac175520a441]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:34:42 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:34:42 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:34:42 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:34:42 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:34:42 user nova-compute[74630]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 (non-flash)
Oct 26 03:34:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:34:42 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:34:42 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:34:42 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:34:42 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:34:42 user nova-compute[74630]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 (non-flash)
Oct 26 03:34:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] HCTL ('36', '0', '0', 0) found on session 28 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f533b5a-b8d6-4238-82dc-b367dd419ad1]: (4, ('0 0 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Searching for a device in session 28 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eajGSbBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.180s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] <== connect_volume: return (182ms) {'type': 'block', 'scsi_wwn': '26661346466653230', 'path': '/dev/sde'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661346466653230', 'path': '/dev/sde'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:31:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1950278964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1950278964',id=27,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:32:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e396316ddc243c594c29f5c434501cb',ramdisk_id='',reservation_id='r-014alrj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:32:57Z,user_data=None,user_id='f8694c5db6e34f1e88595b55f8e5fe70',uuid=0be74854-6a07-4468-bf1c-c41066af14c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81e27221-96a7-4492-b72b-a0ed4f496f09", "address": "fa:16:3e:21:e1:c5", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "vif_mac": "fa:16:3e:21:e1:c5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e27221-96", "ovs_interfaceid": "81e27221-96a7-4492-b72b-a0ed4f496f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converting VIF {"id": "81e27221-96a7-4492-b72b-a0ed4f496f09", "address": "fa:16:3e:21:e1:c5", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "vif_mac": "fa:16:3e:21:e1:c5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e27221-96", "ovs_interfaceid": "81e27221-96a7-4492-b72b-a0ed4f496f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:e1:c5,bridge_name='br-int',has_traffic_filtering=True,id=81e27221-96a7-4492-b72b-a0ed4f496f09,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e27221-96') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.objects.instance [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'pci_devices' on Instance uuid 0be74854-6a07-4468-bf1c-c41066af14c2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.objects.base [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Object Instance<0be74854-6a07-4468-bf1c-c41066af14c2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:34:42 user nova-compute[74630]:   <uuid>0be74854-6a07-4468-bf1c-c41066af14c2</uuid>
Oct 26 03:34:42 user nova-compute[74630]:   <name>instance-0000001b</name>
Oct 26 03:34:42 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:34:42 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:34:42 user nova-compute[74630]:   <metadata>
Oct 26 03:34:42 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:34:42 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:34:42 user nova-compute[74630]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1950278964</nova:name>
Oct 26 03:34:42 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:34:42</nova:creationTime>
Oct 26 03:34:42 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:34:42 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:34:42 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:34:42 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:34:42 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:34:42 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:34:42 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:34:42 user nova-compute[74630]:       <nova:owner>
Oct 26 03:34:42 user nova-compute[74630]:         <nova:user uuid="f8694c5db6e34f1e88595b55f8e5fe70">tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member</nova:user>
Oct 26 03:34:42 user nova-compute[74630]:         <nova:project uuid="1e396316ddc243c594c29f5c434501cb">tempest-ServerBootFromVolumeStableRescueTest-1296515996</nova:project>
Oct 26 03:34:42 user nova-compute[74630]:       </nova:owner>
Oct 26 03:34:42 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:34:42 user nova-compute[74630]:       <nova:ports>
Oct 26 03:34:42 user nova-compute[74630]:         <nova:port uuid="81e27221-96a7-4492-b72b-a0ed4f496f09">
Oct 26 03:34:42 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 03:34:42 user nova-compute[74630]:         </nova:port>
Oct 26 03:34:42 user nova-compute[74630]:       </nova:ports>
Oct 26 03:34:42 user nova-compute[74630]:     </nova:instance>
Oct 26 03:34:42 user nova-compute[74630]:   </metadata>
Oct 26 03:34:42 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:34:42 user nova-compute[74630]:     <system>
Oct 26 03:34:42 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:34:42 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:34:42 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:34:42 user nova-compute[74630]:       <entry name="serial">0be74854-6a07-4468-bf1c-c41066af14c2</entry>
Oct 26 03:34:42 user nova-compute[74630]:       <entry name="uuid">0be74854-6a07-4468-bf1c-c41066af14c2</entry>
Oct 26 03:34:42 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:34:42 user nova-compute[74630]:     </system>
Oct 26 03:34:42 user nova-compute[74630]:   </sysinfo>
Oct 26 03:34:42 user nova-compute[74630]:   <os>
Oct 26 03:34:42 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:34:42 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:34:42 user nova-compute[74630]:   </os>
Oct 26 03:34:42 user nova-compute[74630]:   <features>
Oct 26 03:34:42 user nova-compute[74630]:     <acpi/>
Oct 26 03:34:42 user nova-compute[74630]:     <apic/>
Oct 26 03:34:42 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:34:42 user nova-compute[74630]:   </features>
Oct 26 03:34:42 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:34:42 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:34:42 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:34:42 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:34:42 user nova-compute[74630]:   </clock>
Oct 26 03:34:42 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:34:42 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:34:42 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:34:42 user nova-compute[74630]:   </cpu>
Oct 26 03:34:42 user nova-compute[74630]:   <devices>
Oct 26 03:34:42 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:34:42 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:34:42 user nova-compute[74630]:       <source dev="/dev/sde"/>
Oct 26 03:34:42 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:34:42 user nova-compute[74630]:       <serial>02cc9efa-096f-4682-b557-ab809630abe4</serial>
Oct 26 03:34:42 user nova-compute[74630]:     </disk>
Oct 26 03:34:42 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:34:42 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:34:42 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/0be74854-6a07-4468-bf1c-c41066af14c2/disk.rescue"/>
Oct 26 03:34:42 user nova-compute[74630]:       <target dev="vdb" bus="virtio"/>
Oct 26 03:34:42 user nova-compute[74630]:       <boot order="1"/>
Oct 26 03:34:42 user nova-compute[74630]:     </disk>
Oct 26 03:34:42 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:34:42 user nova-compute[74630]:       <mac address="fa:16:3e:21:e1:c5"/>
Oct 26 03:34:42 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:34:42 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:34:42 user nova-compute[74630]:       <target dev="tap81e27221-96"/>
Oct 26 03:34:42 user nova-compute[74630]:     </interface>
Oct 26 03:34:42 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:34:42 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/0be74854-6a07-4468-bf1c-c41066af14c2/console.log" append="off"/>
Oct 26 03:34:42 user nova-compute[74630]:     </serial>
Oct 26 03:34:42 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:34:42 user nova-compute[74630]:     <video>
Oct 26 03:34:42 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:34:42 user nova-compute[74630]:     </video>
Oct 26 03:34:42 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:34:42 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:34:42 user nova-compute[74630]:     </rng>
Oct 26 03:34:42 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:34:42 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:34:42 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:34:42 user nova-compute[74630]:     </memballoon>
Oct 26 03:34:42 user nova-compute[74630]:   </devices>
Oct 26 03:34:42 user nova-compute[74630]: </domain>
Oct 26 03:34:42 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:34:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Instance destroyed successfully.
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:34:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] No VIF found with MAC fa:16:3e:21:e1:c5, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:34:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-b7e1fba2-6ae5-4855-adda-8252b34c9221 req-d3e94900-e1c5-4fe6-ba78-18994635ca78 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:34:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b7e1fba2-6ae5-4855-adda-8252b34c9221 req-d3e94900-e1c5-4fe6-ba78-18994635ca78 service nova] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b7e1fba2-6ae5-4855-adda-8252b34c9221 req-d3e94900-e1c5-4fe6-ba78-18994635ca78 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b7e1fba2-6ae5-4855-adda-8252b34c9221 req-d3e94900-e1c5-4fe6-ba78-18994635ca78 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:34:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-b7e1fba2-6ae5-4855-adda-8252b34c9221 req-d3e94900-e1c5-4fe6-ba78-18994635ca78 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] No waiting events found dispatching network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:34:44 user nova-compute[74630]: WARNING nova.compute.manager [req-b7e1fba2-6ae5-4855-adda-8252b34c9221 req-d3e94900-e1c5-4fe6-ba78-18994635ca78 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received unexpected event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 for instance with vm_state active and task_state rescuing.
Oct 26 03:34:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:46 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f28bbe8a-1981-4399-b88e-5a1d97e94dda tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:34:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-f958f2cd-a774-4c8b-86c7-de1cf47ca9ce req-48ff0edb-d398-4dbc-9e87-4a9c5e596697 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:34:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f958f2cd-a774-4c8b-86c7-de1cf47ca9ce req-48ff0edb-d398-4dbc-9e87-4a9c5e596697 service nova] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:34:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f958f2cd-a774-4c8b-86c7-de1cf47ca9ce req-48ff0edb-d398-4dbc-9e87-4a9c5e596697 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:34:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f958f2cd-a774-4c8b-86c7-de1cf47ca9ce req-48ff0edb-d398-4dbc-9e87-4a9c5e596697 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:34:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-f958f2cd-a774-4c8b-86c7-de1cf47ca9ce req-48ff0edb-d398-4dbc-9e87-4a9c5e596697 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] No waiting events found dispatching network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:34:46 user nova-compute[74630]: WARNING nova.compute.manager [req-f958f2cd-a774-4c8b-86c7-de1cf47ca9ce req-48ff0edb-d398-4dbc-9e87-4a9c5e596697 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received unexpected event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 for instance with vm_state active and task_state rescuing.
Oct 26 03:34:48 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance dedde109-8cf7-487d-be41-3b8951180c26 is timed out.
Oct 26 03:34:48 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Successfully detached device vdc from instance dedde109-8cf7-487d-be41-3b8951180c26 from the live domain config.
Oct 26 03:34:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vsEQpceN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:34:48 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14e23c9-9b43-414f-a57f-2a829b6345e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:34:48 user nova-compute[74630]: No targets found.
Oct 26 03:34:48 user nova-compute[74630]: iSNS:
Oct 26 03:34:48 user nova-compute[74630]: No targets found.
Oct 26 03:34:48 user nova-compute[74630]: STATIC:
Oct 26 03:34:48 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:34:48 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:34:48 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:34:48 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b
Oct 26 03:34:48 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:34:48 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:34:48 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4
Oct 26 03:34:48 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:34:48 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:34:48 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31
Oct 26 03:34:48 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:34:48 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:34:48 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0
Oct 26 03:34:48 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:34:48 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:34:48 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c
Oct 26 03:34:48 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:34:48 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:34:48 user nova-compute[74630]: FIRMWARE:
Oct 26 03:34:48 user nova-compute[74630]: No targets found.
Oct 26 03:34:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:34:48 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:34:48 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[de843331-58af-4b48-aa35-1ffc0da8dafc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd49e6b-8c54-4570-99ca-9c2d873e8961]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:34:48 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:34:48 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:34:48 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:34:48 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:34:48 user nova-compute[74630]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 (non-flash)
Oct 26 03:34:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:34:48 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:34:48 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:34:48 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:34:48 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:34:48 user nova-compute[74630]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 (non-flash)
Oct 26 03:34:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f318429b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31'): ({'sdg'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Removing single pathed devices sdg {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbb0934-a1f5-43fa-9612-87a00fb48513]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50d5390-2039-4736-9817-a895fca0781f]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Flushing IO for device /dev/sdg {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d26c0e-bf98-4885-b51c-dddcf32a340a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6389889b-15d6-43c0-9ead-6f0c784ca1dc]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] SCSI volumes sdg have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbe8f22-c126-435f-b26d-13b29fccfeaa]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcf3a56-b8a1-424b-9700-96b991333b72]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31, portal: 172.16.0.220,3260]
Oct 26 03:34:48 user nova-compute[74630]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31, portal: 172.16.0.220,3260] successful.
Oct 26 03:34:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5bb213-c9eb-4be4-8097-0db89ef69d31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ad568a-8372-469d-b9db-80421ac8fd10]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] <== disconnect_volume: return (390ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:34:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-f5263e31-569d-453d-8c37-90428cb37fc6 req-b1f3931d-ae42-477e-9f42-4d136c4f55c6 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received event network-changed-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:34:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-f5263e31-569d-453d-8c37-90428cb37fc6 req-b1f3931d-ae42-477e-9f42-4d136c4f55c6 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Refreshing instance network info cache due to event network-changed-f5f32762-6dc9-47fb-a90d-463f3be1283a. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:34:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f5263e31-569d-453d-8c37-90428cb37fc6 req-b1f3931d-ae42-477e-9f42-4d136c4f55c6 service nova] Acquiring lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:34:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f5263e31-569d-453d-8c37-90428cb37fc6 req-b1f3931d-ae42-477e-9f42-4d136c4f55c6 service nova] Acquired lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:34:51 user nova-compute[74630]: DEBUG nova.network.neutron [req-f5263e31-569d-453d-8c37-90428cb37fc6 req-b1f3931d-ae42-477e-9f42-4d136c4f55c6 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Refreshing network info cache for port f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:34:52 user nova-compute[74630]: DEBUG nova.network.neutron [req-f5263e31-569d-453d-8c37-90428cb37fc6 req-b1f3931d-ae42-477e-9f42-4d136c4f55c6 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Updated VIF entry in instance network info cache for port f5f32762-6dc9-47fb-a90d-463f3be1283a. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:34:52 user nova-compute[74630]: DEBUG nova.network.neutron [req-f5263e31-569d-453d-8c37-90428cb37fc6 req-b1f3931d-ae42-477e-9f42-4d136c4f55c6 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Updating instance_info_cache with network_info: [{"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:34:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f5263e31-569d-453d-8c37-90428cb37fc6 req-b1f3931d-ae42-477e-9f42-4d136c4f55c6 service nova] Releasing lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:34:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:34:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfSKNUvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:35:01 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:35:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:35:01 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:35:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:35:01 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0276fce6-eaef-4871-ac6f-6c284f442153]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:35:01 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c8c3fb-ee66-4885-8a79-66856b02dc9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc] added
Oct 26 03:35:01 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8356085-3056-43fe-8f10-73cf4fea804d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.102s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[32137f19-7a00-4d9b-8dc0-3da0b83e3b1c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfSKNUvj {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GfSKNUvj" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1d49b2-93b4-4a96-bb9e-4b813b0c12e3]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GfSKNUvj'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0998803-91e6-48e1-92ae-7c9b47b8a9fb]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f08e97-1ea0-43ad-b025-aa151ed25607]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TndOBfzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:35:02 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6f3d10-4e2b-4b5d-949d-ff599098d7fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc, portal: 172.16.0.220,3260]
Oct 26 03:35:02 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc, portal: 172.16.0.220,3260] successful.
Oct 26 03:35:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e021c158-db4c-41be-8387-8999a72f9b25]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e83756-3125-44c1-815c-5776346b4c79]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:02 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.432s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[278a4291-41a6-4aa9-8c94-6d7197a6fa82]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.compute.manager [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:35:02 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Creating image(s)
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Ensure instance console log exists: /opt/stack/data/nova/instances/11c75096-6769-4f10-8515-c96b592958a6/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Start _get_guest_xml network_info=[{"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncIyXWaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '11c75096-6769-4f10-8515-c96b592958a6', 'attached_at': '', 'detached_at': '', 'volume_id': '1b57f591-6788-40fb-b889-6c0117ae1794', 'serial': '1b57f591-6788-40fb-b889-6c0117ae1794'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '551850f5-4a96-4ef9-ba80-81fea0d83670', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:35:02 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:35:02 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncIyXWaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:35:02 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:35:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.objects.instance [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lazy-loading 'flavor' on Instance uuid dedde109-8cf7-487d-be41-3b8951180c26 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-dfd8f4db-9fd5-4b44-8fcb-479a2b7fe446 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 35.058s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "571ada6a-d632-4596-be98-9f72cab3b5f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:02 user nova-compute[74630]: INFO nova.compute.manager [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Detaching volume bec64578-1c20-4a78-89d3-062cc96f95a0
Oct 26 03:35:02 user nova-compute[74630]: INFO nova.virt.block_device [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Attempting to driver detach volume bec64578-1c20-4a78-89d3-062cc96f95a0 from mountpoint /dev/vdb
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Attempting to detach device vdb from instance 571ada6a-d632-4596-be98-9f72cab3b5f2 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:35:02 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:35:02 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:35:02 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:35:02 user nova-compute[74630]:   <serial>bec64578-1c20-4a78-89d3-062cc96f95a0</serial>
Oct 26 03:35:02 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:35:02 user nova-compute[74630]: </disk>
Oct 26 03:35:02 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:35:02 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Successfully detached device vdb from instance 571ada6a-d632-4596-be98-9f72cab3b5f2 from the persistent domain config.
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 571ada6a-d632-4596-be98-9f72cab3b5f2 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:35:02 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:35:02 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:35:02 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:35:02 user nova-compute[74630]:   <serial>bec64578-1c20-4a78-89d3-062cc96f95a0</serial>
Oct 26 03:35:02 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:35:02 user nova-compute[74630]: </disk>
Oct 26 03:35:02 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:35:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "571ada6a-d632-4596-be98-9f72cab3b5f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 571ada6a-d632-4596-be98-9f72cab3b5f2 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfSKNUvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '26364326264373336', 'path': '/dev/sdg'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364326264373336', 'path': '/dev/sdg'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.169s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:35:03 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:35:03 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG nova.objects.instance [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lazy-loading 'flavor' on Instance uuid e9b77844-67a8-4c26-90f2-afc1809b33d1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb358088-3bce-4be3-8bb1-6b196bb04cd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:35:03 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:35:03 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:35:03 user nova-compute[74630]:   <source dev="/dev/sdg"/>
Oct 26 03:35:03 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:35:03 user nova-compute[74630]:   <serial>94837b5c-b6c7-4955-92cf-b431e71ca8dc</serial>
Oct 26 03:35:03 user nova-compute[74630]: </disk>
Oct 26 03:35:03 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1d2f1c-9629-49aa-9861-0dacfbfaddae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8] added
Oct 26 03:35:03 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bebae2-0383-470a-ac84-581fa9741465]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5844f8-abe7-47c0-822e-03aa369a6684]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TndOBfzc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TndOBfzc" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5729955-b746-4429-9d43-344e1d88321e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TndOBfzc'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8991618-2f26-4b47-ae36-7d8fa75c058c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd696ae-ac77-4194-8c8d-af8677934d23]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:03 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:03 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7191768-df97-4f25-be1c-f0024c93fd92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8, portal: 172.16.0.220,3260]
Oct 26 03:35:03 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8, portal: 172.16.0.220,3260] successful.
Oct 26 03:35:03 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ede768c-e0c4-4631-96e1-8b3ac6dd6f07]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb40787-a95b-488d-9c44-980f09701ec5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:03 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:03 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:03 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] HCTL ('39', '-', '-', 0) found on session 33 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47d3f32-5dbb-4ca7-b86e-44e2e975857f]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Searching for a device in session 33 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TndOBfzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] No VIF found with MAC fa:16:3e:e1:1e:5c, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:35:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-58579d9c-5007-4205-a56c-f03c1eeed43c tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 60.107s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] <== connect_volume: return (2548ms) {'type': 'block', 'scsi_wwn': '23034363334353161', 'path': '/dev/sdh'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034363334353161', 'path': '/dev/sdh'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.287s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:35:04 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:35:04 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG nova.objects.instance [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'flavor' on Instance uuid 1e9d2b27-a936-4548-b74a-02a64f180234 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fb5572-66c7-4286-b357-8425cdb97554]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:35:04 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:35:04 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:35:04 user nova-compute[74630]:   <source dev="/dev/sdh"/>
Oct 26 03:35:04 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:35:04 user nova-compute[74630]:   <serial>ebf9bd14-fef2-469a-a7c4-57ba638131e8</serial>
Oct 26 03:35:04 user nova-compute[74630]: </disk>
Oct 26 03:35:04 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[513cc0a1-8cc2-416b-a5cb-187a4c24a401]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794] added
Oct 26 03:35:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a7fb02-6732-45cd-97fa-86c83eb66ff1]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[64074625-ecb2-4519-b667-40b03401875b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ncIyXWaK {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ncIyXWaK" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95d059d-22c4-4f34-9e59-4ba64faf764a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ncIyXWaK'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[030b7a3f-ad03-448c-af12-44712fd11ab2]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eaa099-28b0-43c7-9150-ce71da93e524]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7caded-35ae-4247-97bd-4ff6e2ce6be4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260]
Oct 26 03:35:04 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260] successful.
Oct 26 03:35:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89d4e1c-3398-4aab-b3f2-9429058c184c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc96ac8-5a7c-432a-bca1-988240339570]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:35:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:04 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:35:04 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] HCTL ('40', '-', '-', 0) found on session 34 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:04 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6068cefc-e6a4-49f4-8620-76b6eaeb4583]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:05 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching for a device in session 34 and hctl ['40', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:35:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:35:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:35:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No VIF found with MAC fa:16:3e:28:df:29, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:35:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56b2ac06-3060-4cac-9477-d2c2833cf09f tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "1e9d2b27-a936-4548-b74a-02a64f180234" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.062s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching for a device in session 34 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncIyXWaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] <== connect_volume: return (3658ms) {'type': 'block', 'scsi_wwn': '23832386633663836', 'path': '/dev/sdi'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832386633663836', 'path': '/dev/sdi'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:34:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1119894',display_name='tempest-ServerActionsTestOtherA-server-1119894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1119894',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwoLYfCM8lwvIIEciV36xGOUw+XalItY+5dZPbHAKn3DqpiwNygwALzSy5pOoP4seOCkowdcCG1fNBC8K731mmxBiQFtvBIY61aup2H6JCAGn52TG97PQD1ZIY1c0HtiA==',key_name='tempest-keypair-1565174322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51542ffdf7a84ac5a61f14e124eb2087',ramdisk_id='',reservation_id='r-o5vn07pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-41539930',owner_user_name='tempest-ServerActionsTestOtherA-41539930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:34:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a419737713f4797ab27db62d5aa746c',uuid=11c75096-6769-4f10-8515-c96b592958a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converting VIF {"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:fd:96,bridge_name='br-int',has_traffic_filtering=True,id=3c4b3126-d447-40d7-821e-2395434c6d58,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4b3126-d4') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG nova.objects.instance [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lazy-loading 'pci_devices' on Instance uuid 11c75096-6769-4f10-8515-c96b592958a6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:35:06 user nova-compute[74630]:   <uuid>11c75096-6769-4f10-8515-c96b592958a6</uuid>
Oct 26 03:35:06 user nova-compute[74630]:   <name>instance-00000020</name>
Oct 26 03:35:06 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:35:06 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:35:06 user nova-compute[74630]:   <metadata>
Oct 26 03:35:06 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:35:06 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:35:06 user nova-compute[74630]:       <nova:name>tempest-ServerActionsTestOtherA-server-1119894</nova:name>
Oct 26 03:35:06 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:35:02</nova:creationTime>
Oct 26 03:35:06 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:35:06 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:35:06 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:35:06 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:35:06 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:35:06 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:35:06 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:35:06 user nova-compute[74630]:       <nova:owner>
Oct 26 03:35:06 user nova-compute[74630]:         <nova:user uuid="7a419737713f4797ab27db62d5aa746c">tempest-ServerActionsTestOtherA-41539930-project-member</nova:user>
Oct 26 03:35:06 user nova-compute[74630]:         <nova:project uuid="51542ffdf7a84ac5a61f14e124eb2087">tempest-ServerActionsTestOtherA-41539930</nova:project>
Oct 26 03:35:06 user nova-compute[74630]:       </nova:owner>
Oct 26 03:35:06 user nova-compute[74630]:       <nova:ports>
Oct 26 03:35:06 user nova-compute[74630]:         <nova:port uuid="3c4b3126-d447-40d7-821e-2395434c6d58">
Oct 26 03:35:06 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 03:35:06 user nova-compute[74630]:         </nova:port>
Oct 26 03:35:06 user nova-compute[74630]:       </nova:ports>
Oct 26 03:35:06 user nova-compute[74630]:     </nova:instance>
Oct 26 03:35:06 user nova-compute[74630]:   </metadata>
Oct 26 03:35:06 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:35:06 user nova-compute[74630]:     <system>
Oct 26 03:35:06 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:35:06 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:35:06 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:35:06 user nova-compute[74630]:       <entry name="serial">11c75096-6769-4f10-8515-c96b592958a6</entry>
Oct 26 03:35:06 user nova-compute[74630]:       <entry name="uuid">11c75096-6769-4f10-8515-c96b592958a6</entry>
Oct 26 03:35:06 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:35:06 user nova-compute[74630]:     </system>
Oct 26 03:35:06 user nova-compute[74630]:   </sysinfo>
Oct 26 03:35:06 user nova-compute[74630]:   <os>
Oct 26 03:35:06 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:35:06 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:35:06 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:35:06 user nova-compute[74630]:   </os>
Oct 26 03:35:06 user nova-compute[74630]:   <features>
Oct 26 03:35:06 user nova-compute[74630]:     <acpi/>
Oct 26 03:35:06 user nova-compute[74630]:     <apic/>
Oct 26 03:35:06 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:35:06 user nova-compute[74630]:   </features>
Oct 26 03:35:06 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:35:06 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:35:06 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:35:06 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:35:06 user nova-compute[74630]:   </clock>
Oct 26 03:35:06 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:35:06 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:35:06 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:35:06 user nova-compute[74630]:   </cpu>
Oct 26 03:35:06 user nova-compute[74630]:   <devices>
Oct 26 03:35:06 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:35:06 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:35:06 user nova-compute[74630]:       <source dev="/dev/sdi"/>
Oct 26 03:35:06 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:35:06 user nova-compute[74630]:       <serial>1b57f591-6788-40fb-b889-6c0117ae1794</serial>
Oct 26 03:35:06 user nova-compute[74630]:     </disk>
Oct 26 03:35:06 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:35:06 user nova-compute[74630]:       <mac address="fa:16:3e:32:fd:96"/>
Oct 26 03:35:06 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:35:06 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:35:06 user nova-compute[74630]:       <target dev="tap3c4b3126-d4"/>
Oct 26 03:35:06 user nova-compute[74630]:     </interface>
Oct 26 03:35:06 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:35:06 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/11c75096-6769-4f10-8515-c96b592958a6/console.log" append="off"/>
Oct 26 03:35:06 user nova-compute[74630]:     </serial>
Oct 26 03:35:06 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:35:06 user nova-compute[74630]:     <video>
Oct 26 03:35:06 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:35:06 user nova-compute[74630]:     </video>
Oct 26 03:35:06 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:35:06 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:35:06 user nova-compute[74630]:     </rng>
Oct 26 03:35:06 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:35:06 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:35:06 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:35:06 user nova-compute[74630]:     </memballoon>
Oct 26 03:35:06 user nova-compute[74630]:   </devices>
Oct 26 03:35:06 user nova-compute[74630]: </domain>
Oct 26 03:35:06 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:34:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1119894',display_name='tempest-ServerActionsTestOtherA-server-1119894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1119894',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwoLYfCM8lwvIIEciV36xGOUw+XalItY+5dZPbHAKn3DqpiwNygwALzSy5pOoP4seOCkowdcCG1fNBC8K731mmxBiQFtvBIY61aup2H6JCAGn52TG97PQD1ZIY1c0HtiA==',key_name='tempest-keypair-1565174322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51542ffdf7a84ac5a61f14e124eb2087',ramdisk_id='',reservation_id='r-o5vn07pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-41539930',owner_user_name='tempest-ServerActionsTestOtherA-41539930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:34:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a419737713f4797ab27db62d5aa746c',uuid=11c75096-6769-4f10-8515-c96b592958a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converting VIF {"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:fd:96,bridge_name='br-int',has_traffic_filtering=True,id=3c4b3126-d447-40d7-821e-2395434c6d58,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4b3126-d4') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG os_vif [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:fd:96,bridge_name='br-int',has_traffic_filtering=True,id=3c4b3126-d447-40d7-821e-2395434c6d58,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4b3126-d4') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3241d9c-cc30-59a9-96df-1870e4e1e308', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c4b3126-d4, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c4b3126-d4, col_values=(('qos', UUID('ed4e9313-bcab-495b-a81a-2673340d0654')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c4b3126-d4, col_values=(('external_ids', {'iface-id': '3c4b3126-d447-40d7-821e-2395434c6d58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:fd:96', 'vm-uuid': '11c75096-6769-4f10-8515-c96b592958a6'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:06 user nova-compute[74630]: INFO os_vif [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:fd:96,bridge_name='br-int',has_traffic_filtering=True,id=3c4b3126-d447-40d7-821e-2395434c6d58,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4b3126-d4')
Oct 26 03:35:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] No VIF found with MAC fa:16:3e:32:fd:96, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:06 user nova-compute[74630]: INFO nova.compute.manager [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Detaching volume 94837b5c-b6c7-4955-92cf-b431e71ca8dc
Oct 26 03:35:06 user nova-compute[74630]: INFO nova.virt.block_device [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Attempting to driver detach volume 94837b5c-b6c7-4955-92cf-b431e71ca8dc from mountpoint /dev/vdb
Oct 26 03:35:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Attempting to detach device vdb from instance e9b77844-67a8-4c26-90f2-afc1809b33d1 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:35:06 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:35:06 user nova-compute[74630]:   <source dev="/dev/sdg"/>
Oct 26 03:35:06 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:35:06 user nova-compute[74630]:   <serial>94837b5c-b6c7-4955-92cf-b431e71ca8dc</serial>
Oct 26 03:35:06 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:35:06 user nova-compute[74630]: </disk>
Oct 26 03:35:06 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:35:06 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Successfully detached device vdb from instance e9b77844-67a8-4c26-90f2-afc1809b33d1 from the persistent domain config.
Oct 26 03:35:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e9b77844-67a8-4c26-90f2-afc1809b33d1 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:35:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:35:06 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:35:06 user nova-compute[74630]:   <source dev="/dev/sdg"/>
Oct 26 03:35:06 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:35:06 user nova-compute[74630]:   <serial>94837b5c-b6c7-4955-92cf-b431e71ca8dc</serial>
Oct 26 03:35:06 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:35:06 user nova-compute[74630]: </disk>
Oct 26 03:35:06 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:35:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e9b77844-67a8-4c26-90f2-afc1809b33d1 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:35:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-cfd83384-934c-43ed-853c-6f829280950e req-8a845708-feb7-4bb0-9128-132e2f63d042 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:35:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cfd83384-934c-43ed-853c-6f829280950e req-8a845708-feb7-4bb0-9128-132e2f63d042 service nova] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cfd83384-934c-43ed-853c-6f829280950e req-8a845708-feb7-4bb0-9128-132e2f63d042 service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cfd83384-934c-43ed-853c-6f829280950e req-8a845708-feb7-4bb0-9128-132e2f63d042 service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-cfd83384-934c-43ed-853c-6f829280950e req-8a845708-feb7-4bb0-9128-132e2f63d042 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] No waiting events found dispatching network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:35:07 user nova-compute[74630]: WARNING nova.compute.manager [req-cfd83384-934c-43ed-853c-6f829280950e req-8a845708-feb7-4bb0-9128-132e2f63d042 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received unexpected event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 for instance with vm_state building and task_state spawning.
Oct 26 03:35:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "4a753e20-7c6a-471d-97c1-23514aeff398" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "4a753e20-7c6a-471d-97c1-23514aeff398" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:35:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:08 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:35:08 user nova-compute[74630]: INFO nova.compute.claims [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Claim successful on node user
Oct 26 03:35:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.007s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:08 user nova-compute[74630]: INFO nova.compute.manager [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Shelving
Oct 26 03:35:08 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:35:08 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.668s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:35:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG nova.policy [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc35b87a18e44b3392d122e392a0b8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebfc20893da40c1b25be2444441f0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-9ca736c9-16b4-4d5f-8e52-465f9714f4bd req-e957ae20-1c2e-4469-bdd7-79ca33ce0259 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received event network-vif-unplugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9ca736c9-16b4-4d5f-8e52-465f9714f4bd req-e957ae20-1c2e-4469-bdd7-79ca33ce0259 service nova] Acquiring lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9ca736c9-16b4-4d5f-8e52-465f9714f4bd req-e957ae20-1c2e-4469-bdd7-79ca33ce0259 service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9ca736c9-16b4-4d5f-8e52-465f9714f4bd req-e957ae20-1c2e-4469-bdd7-79ca33ce0259 service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-9ca736c9-16b4-4d5f-8e52-465f9714f4bd req-e957ae20-1c2e-4469-bdd7-79ca33ce0259 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] No waiting events found dispatching network-vif-unplugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:35:09 user nova-compute[74630]: WARNING nova.compute.manager [req-9ca736c9-16b4-4d5f-8e52-465f9714f4bd req-e957ae20-1c2e-4469-bdd7-79ca33ce0259 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received unexpected event network-vif-unplugged-f5f32762-6dc9-47fb-a90d-463f3be1283a for instance with vm_state active and task_state shelving.
Oct 26 03:35:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:35:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Creating image(s)
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "/opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "/opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.177s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Instance destroyed successfully.
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk 1073741824" returned: 0 in 0.057s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Beginning cold snapshot process
Oct 26 03:35:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.222s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.compute.manager [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-33835ee0-fd48-469c-8975-bcbc5ed1d75c req-fe44d4cf-44d5-4c22-96d9-61cd42e9508b service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-33835ee0-fd48-469c-8975-bcbc5ed1d75c req-fe44d4cf-44d5-4c22-96d9-61cd42e9508b service nova] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-33835ee0-fd48-469c-8975-bcbc5ed1d75c req-fe44d4cf-44d5-4c22-96d9-61cd42e9508b service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-33835ee0-fd48-469c-8975-bcbc5ed1d75c req-fe44d4cf-44d5-4c22-96d9-61cd42e9508b service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-33835ee0-fd48-469c-8975-bcbc5ed1d75c req-fe44d4cf-44d5-4c22-96d9-61cd42e9508b service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] No waiting events found dispatching network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:35:10 user nova-compute[74630]: WARNING nova.compute.manager [req-33835ee0-fd48-469c-8975-bcbc5ed1d75c req-fe44d4cf-44d5-4c22-96d9-61cd42e9508b service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received unexpected event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 for instance with vm_state building and task_state spawning.
Oct 26 03:35:10 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Instance spawned successfully.
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk /opt/stack/data/nova/instances/snapshots/tmpff1bcfwv/19aa2f70dcc6414592ee3f7d57d32499 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Cannot resize image /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Ensure instance console log exists: /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:10 user nova-compute[74630]: INFO nova.compute.manager [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Took 8.11 seconds to spawn the instance on the hypervisor.
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.compute.manager [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:35:10 user nova-compute[74630]: INFO nova.compute.manager [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Took 68.27 seconds to build instance.
Oct 26 03:35:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cbdf7083-a20e-45bd-802c-9156f0a96d90 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "11c75096-6769-4f10-8515-c96b592958a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 68.399s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Successfully created port: a8c64f37-8597-4654-bf2e-3fede1dbfc44 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:35:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk /opt/stack/data/nova/instances/snapshots/tmpff1bcfwv/19aa2f70dcc6414592ee3f7d57d32499" returned: 0 in 0.883s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:10 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Snapshot extracted, beginning image upload
Oct 26 03:35:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-a57f5226-8d6b-4294-a463-876565dbd2a4 req-ea2566ca-1324-4c5b-9745-27da137643b5 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received event network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a57f5226-8d6b-4294-a463-876565dbd2a4 req-ea2566ca-1324-4c5b-9745-27da137643b5 service nova] Acquiring lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a57f5226-8d6b-4294-a463-876565dbd2a4 req-ea2566ca-1324-4c5b-9745-27da137643b5 service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a57f5226-8d6b-4294-a463-876565dbd2a4 req-ea2566ca-1324-4c5b-9745-27da137643b5 service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-a57f5226-8d6b-4294-a463-876565dbd2a4 req-ea2566ca-1324-4c5b-9745-27da137643b5 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] No waiting events found dispatching network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:35:11 user nova-compute[74630]: WARNING nova.compute.manager [req-a57f5226-8d6b-4294-a463-876565dbd2a4 req-ea2566ca-1324-4c5b-9745-27da137643b5 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received unexpected event network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Successfully updated port: a8c64f37-8597-4654-bf2e-3fede1dbfc44 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "refresh_cache-4a753e20-7c6a-471d-97c1-23514aeff398" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquired lock "refresh_cache-4a753e20-7c6a-471d-97c1-23514aeff398" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Updating instance_info_cache with network_info: [{"id": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "address": "fa:16:3e:e6:ce:2f", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c64f37-85", "ovs_interfaceid": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Releasing lock "refresh_cache-4a753e20-7c6a-471d-97c1-23514aeff398" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Instance network_info: |[{"id": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "address": "fa:16:3e:e6:ce:2f", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c64f37-85", "ovs_interfaceid": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Start _get_guest_xml network_info=[{"id": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "address": "fa:16:3e:e6:ce:2f", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c64f37-85", "ovs_interfaceid": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:35:11 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:35:11 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1960228239',display_name='tempest-AttachVolumeNegativeTest-server-1960228239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1960228239',id=33,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrTCahHw0CYNEc6LEe3NgNr+LpwaqoEf5cRWy2WP6BbuZgO2L8M1htzA1e/xL+Jvprz9NrHghNsGHsNe93K/8/ijzc8HIcC7dB4o7O0VtllibdnezryupZ34Ycv0YGKaw==',key_name='tempest-keypair-520712024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ebfc20893da40c1b25be2444441f0c3',ramdisk_id='',reservation_id='r-z52djfiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2146381855',owner_user_name='tempest-AttachVolumeNegativeTest-2146381855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:35:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc35b87a18e44b3392d122e392a0b8fb',uuid=4a753e20-7c6a-471d-97c1-23514aeff398,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "address": "fa:16:3e:e6:ce:2f", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c64f37-85", "ovs_interfaceid": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converting VIF {"id": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "address": "fa:16:3e:e6:ce:2f", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c64f37-85", "ovs_interfaceid": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ce:2f,bridge_name='br-int',has_traffic_filtering=True,id=a8c64f37-8597-4654-bf2e-3fede1dbfc44,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c64f37-85') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.objects.instance [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a753e20-7c6a-471d-97c1-23514aeff398 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:35:11 user nova-compute[74630]:   <uuid>4a753e20-7c6a-471d-97c1-23514aeff398</uuid>
Oct 26 03:35:11 user nova-compute[74630]:   <name>instance-00000021</name>
Oct 26 03:35:11 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:35:11 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:35:11 user nova-compute[74630]:   <metadata>
Oct 26 03:35:11 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:35:11 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:35:11 user nova-compute[74630]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1960228239</nova:name>
Oct 26 03:35:11 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:35:11</nova:creationTime>
Oct 26 03:35:11 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:35:11 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:35:11 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:35:11 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:35:11 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:35:11 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:35:11 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:35:11 user nova-compute[74630]:       <nova:owner>
Oct 26 03:35:11 user nova-compute[74630]:         <nova:user uuid="bc35b87a18e44b3392d122e392a0b8fb">tempest-AttachVolumeNegativeTest-2146381855-project-member</nova:user>
Oct 26 03:35:11 user nova-compute[74630]:         <nova:project uuid="0ebfc20893da40c1b25be2444441f0c3">tempest-AttachVolumeNegativeTest-2146381855</nova:project>
Oct 26 03:35:11 user nova-compute[74630]:       </nova:owner>
Oct 26 03:35:11 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:35:11 user nova-compute[74630]:       <nova:ports>
Oct 26 03:35:11 user nova-compute[74630]:         <nova:port uuid="a8c64f37-8597-4654-bf2e-3fede1dbfc44">
Oct 26 03:35:11 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 03:35:11 user nova-compute[74630]:         </nova:port>
Oct 26 03:35:11 user nova-compute[74630]:       </nova:ports>
Oct 26 03:35:11 user nova-compute[74630]:     </nova:instance>
Oct 26 03:35:11 user nova-compute[74630]:   </metadata>
Oct 26 03:35:11 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:35:11 user nova-compute[74630]:     <system>
Oct 26 03:35:11 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:35:11 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:35:11 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:35:11 user nova-compute[74630]:       <entry name="serial">4a753e20-7c6a-471d-97c1-23514aeff398</entry>
Oct 26 03:35:11 user nova-compute[74630]:       <entry name="uuid">4a753e20-7c6a-471d-97c1-23514aeff398</entry>
Oct 26 03:35:11 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:35:11 user nova-compute[74630]:     </system>
Oct 26 03:35:11 user nova-compute[74630]:   </sysinfo>
Oct 26 03:35:11 user nova-compute[74630]:   <os>
Oct 26 03:35:11 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:35:11 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:35:11 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:35:11 user nova-compute[74630]:   </os>
Oct 26 03:35:11 user nova-compute[74630]:   <features>
Oct 26 03:35:11 user nova-compute[74630]:     <acpi/>
Oct 26 03:35:11 user nova-compute[74630]:     <apic/>
Oct 26 03:35:11 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:35:11 user nova-compute[74630]:   </features>
Oct 26 03:35:11 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:35:11 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:35:11 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:35:11 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:35:11 user nova-compute[74630]:   </clock>
Oct 26 03:35:11 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:35:11 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:35:11 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:35:11 user nova-compute[74630]:   </cpu>
Oct 26 03:35:11 user nova-compute[74630]:   <devices>
Oct 26 03:35:11 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:35:11 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:35:11 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk"/>
Oct 26 03:35:11 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:35:11 user nova-compute[74630]:     </disk>
Oct 26 03:35:11 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:35:11 user nova-compute[74630]:       <mac address="fa:16:3e:e6:ce:2f"/>
Oct 26 03:35:11 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:35:11 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:35:11 user nova-compute[74630]:       <target dev="tapa8c64f37-85"/>
Oct 26 03:35:11 user nova-compute[74630]:     </interface>
Oct 26 03:35:11 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:35:11 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/console.log" append="off"/>
Oct 26 03:35:11 user nova-compute[74630]:     </serial>
Oct 26 03:35:11 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:35:11 user nova-compute[74630]:     <video>
Oct 26 03:35:11 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:35:11 user nova-compute[74630]:     </video>
Oct 26 03:35:11 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:35:11 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:35:11 user nova-compute[74630]:     </rng>
Oct 26 03:35:11 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:35:11 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:35:11 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:35:11 user nova-compute[74630]:     </memballoon>
Oct 26 03:35:11 user nova-compute[74630]:   </devices>
Oct 26 03:35:11 user nova-compute[74630]: </domain>
Oct 26 03:35:11 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1960228239',display_name='tempest-AttachVolumeNegativeTest-server-1960228239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1960228239',id=33,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrTCahHw0CYNEc6LEe3NgNr+LpwaqoEf5cRWy2WP6BbuZgO2L8M1htzA1e/xL+Jvprz9NrHghNsGHsNe93K/8/ijzc8HIcC7dB4o7O0VtllibdnezryupZ34Ycv0YGKaw==',key_name='tempest-keypair-520712024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ebfc20893da40c1b25be2444441f0c3',ramdisk_id='',reservation_id='r-z52djfiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2146381855',owner_user_name='tempest-AttachVolumeNegativeTest-2146381855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:35:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc35b87a18e44b3392d122e392a0b8fb',uuid=4a753e20-7c6a-471d-97c1-23514aeff398,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "address": "fa:16:3e:e6:ce:2f", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c64f37-85", "ovs_interfaceid": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converting VIF {"id": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "address": "fa:16:3e:e6:ce:2f", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c64f37-85", "ovs_interfaceid": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ce:2f,bridge_name='br-int',has_traffic_filtering=True,id=a8c64f37-8597-4654-bf2e-3fede1dbfc44,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c64f37-85') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG os_vif [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ce:2f,bridge_name='br-int',has_traffic_filtering=True,id=a8c64f37-8597-4654-bf2e-3fede1dbfc44,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c64f37-85') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbdc40c8-391c-57b2-a43d-896b779c7c4e', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8c64f37-85, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8c64f37-85, col_values=(('qos', UUID('f948d241-5930-4c35-8d9e-36968b608895')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8c64f37-85, col_values=(('external_ids', {'iface-id': 'a8c64f37-8597-4654-bf2e-3fede1dbfc44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:ce:2f', 'vm-uuid': '4a753e20-7c6a-471d-97c1-23514aeff398'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:35:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:11 user nova-compute[74630]: INFO os_vif [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ce:2f,bridge_name='br-int',has_traffic_filtering=True,id=a8c64f37-8597-4654-bf2e-3fede1dbfc44,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c64f37-85')
Oct 26 03:35:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:35:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No VIF found with MAC fa:16:3e:e6:ce:2f, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-a90c0da8-d374-4d98-8c08-f2178db90d12 req-b4569305-2be3-40d0-a43b-c501e32f1e9a service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Received event network-changed-a8c64f37-8597-4654-bf2e-3fede1dbfc44 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-a90c0da8-d374-4d98-8c08-f2178db90d12 req-b4569305-2be3-40d0-a43b-c501e32f1e9a service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Refreshing instance network info cache due to event network-changed-a8c64f37-8597-4654-bf2e-3fede1dbfc44. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a90c0da8-d374-4d98-8c08-f2178db90d12 req-b4569305-2be3-40d0-a43b-c501e32f1e9a service nova] Acquiring lock "refresh_cache-4a753e20-7c6a-471d-97c1-23514aeff398" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a90c0da8-d374-4d98-8c08-f2178db90d12 req-b4569305-2be3-40d0-a43b-c501e32f1e9a service nova] Acquired lock "refresh_cache-4a753e20-7c6a-471d-97c1-23514aeff398" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG nova.network.neutron [req-a90c0da8-d374-4d98-8c08-f2178db90d12 req-b4569305-2be3-40d0-a43b-c501e32f1e9a service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Refreshing network info cache for port a8c64f37-8597-4654-bf2e-3fede1dbfc44 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-49a75fc8-65f6-47b3-82aa-3b71091f9539 req-8be6f764-1c71-40bf-9636-348217399238 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Received event network-vif-plugged-a8c64f37-8597-4654-bf2e-3fede1dbfc44 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-49a75fc8-65f6-47b3-82aa-3b71091f9539 req-8be6f764-1c71-40bf-9636-348217399238 service nova] Acquiring lock "4a753e20-7c6a-471d-97c1-23514aeff398-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-49a75fc8-65f6-47b3-82aa-3b71091f9539 req-8be6f764-1c71-40bf-9636-348217399238 service nova] Lock "4a753e20-7c6a-471d-97c1-23514aeff398-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-49a75fc8-65f6-47b3-82aa-3b71091f9539 req-8be6f764-1c71-40bf-9636-348217399238 service nova] Lock "4a753e20-7c6a-471d-97c1-23514aeff398-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-49a75fc8-65f6-47b3-82aa-3b71091f9539 req-8be6f764-1c71-40bf-9636-348217399238 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] No waiting events found dispatching network-vif-plugged-a8c64f37-8597-4654-bf2e-3fede1dbfc44 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:35:13 user nova-compute[74630]: WARNING nova.compute.manager [req-49a75fc8-65f6-47b3-82aa-3b71091f9539 req-8be6f764-1c71-40bf-9636-348217399238 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Received unexpected event network-vif-plugged-a8c64f37-8597-4654-bf2e-3fede1dbfc44 for instance with vm_state building and task_state spawning.
Oct 26 03:35:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:13 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Snapshot image upload complete
Oct 26 03:35:13 user nova-compute[74630]: DEBUG nova.compute.manager [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:35:13 user nova-compute[74630]: INFO nova.compute.manager [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Shelve offloading
Oct 26 03:35:13 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Instance destroyed successfully.
Oct 26 03:35:13 user nova-compute[74630]: DEBUG nova.compute.manager [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquired lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:35:13 user nova-compute[74630]: DEBUG nova.network.neutron [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:35:14 user nova-compute[74630]: DEBUG nova.network.neutron [req-a90c0da8-d374-4d98-8c08-f2178db90d12 req-b4569305-2be3-40d0-a43b-c501e32f1e9a service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Updated VIF entry in instance network info cache for port a8c64f37-8597-4654-bf2e-3fede1dbfc44. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:35:14 user nova-compute[74630]: DEBUG nova.network.neutron [req-a90c0da8-d374-4d98-8c08-f2178db90d12 req-b4569305-2be3-40d0-a43b-c501e32f1e9a service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Updating instance_info_cache with network_info: [{"id": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "address": "fa:16:3e:e6:ce:2f", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c64f37-85", "ovs_interfaceid": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:35:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a90c0da8-d374-4d98-8c08-f2178db90d12 req-b4569305-2be3-40d0-a43b-c501e32f1e9a service nova] Releasing lock "refresh_cache-4a753e20-7c6a-471d-97c1-23514aeff398" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:35:14 user nova-compute[74630]: DEBUG nova.network.neutron [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Updating instance_info_cache with network_info: [{"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:35:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Releasing lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:35:15 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Instance destroyed successfully.
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.objects.instance [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'resources' on Instance uuid 0fb37042-4106-4bcc-a0fa-5e6ae614627f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1496039535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1496039535',id=31,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG/wKNBcRL+FImLurheVUXxJaQCN+j/6tyyI7ZspxC0JW8pST9M/flxNHjGMm7/l0OfSdgOLNvLYUlsrZoNQ8hwCUP8SlJPzCSBJ8GUHvHot/N2bjmNrHWhLK/dNtdZsg==',key_name='tempest-keypair-1898419039',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f44335320f77434999514ed6824a2e23',ramdisk_id='',reservation_id='r-xzpbz7ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1268856411',owner_user_name='tempest-AttachVolumeShelveTestJSON-1268856411-project-member',shelved_at='2023-10-26T03:35:13.830209',shelved_host='user',shelved_image_id='88c3cc7d-f187-4ade-9f07-bfd3c9707106'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:35:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f51acc12a54e7bbd38e975f2d7632e',uuid=0fb37042-4106-4bcc-a0fa-5e6ae614627f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converting VIF {"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b2:b3,bridge_name='br-int',has_traffic_filtering=True,id=f5f32762-6dc9-47fb-a90d-463f3be1283a,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f32762-6d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG os_vif [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b2:b3,bridge_name='br-int',has_traffic_filtering=True,id=f5f32762-6dc9-47fb-a90d-463f3be1283a,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f32762-6d') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5f32762-6d, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3864713-ebc1-4355-b3d2-384476782843) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:35:15 user nova-compute[74630]: INFO os_vif [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b2:b3,bridge_name='br-int',has_traffic_filtering=True,id=f5f32762-6dc9-47fb-a90d-463f3be1283a,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f32762-6d')
Oct 26 03:35:15 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Deleting instance files /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f_del
Oct 26 03:35:15 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Deletion of /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f_del complete
Oct 26 03:35:15 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Deleted allocations for instance 0fb37042-4106-4bcc-a0fa-5e6ae614627f
Oct 26 03:35:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.objects.instance [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'numa_topology' on Instance uuid 0fb37042-4106-4bcc-a0fa-5e6ae614627f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.objects.base [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Object Instance<0fb37042-4106-4bcc-a0fa-5e6ae614627f> lazy-loaded attributes: resources,numa_topology {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.compute.manager [req-36af7c90-a28e-475e-8213-30b8bee5ead1 req-bd24821e-0fd9-43dc-b76a-d86e7e2329d0 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received event network-changed-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.compute.manager [req-36af7c90-a28e-475e-8213-30b8bee5ead1 req-bd24821e-0fd9-43dc-b76a-d86e7e2329d0 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Refreshing instance network info cache due to event network-changed-f5f32762-6dc9-47fb-a90d-463f3be1283a. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-36af7c90-a28e-475e-8213-30b8bee5ead1 req-bd24821e-0fd9-43dc-b76a-d86e7e2329d0 service nova] Acquiring lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-36af7c90-a28e-475e-8213-30b8bee5ead1 req-bd24821e-0fd9-43dc-b76a-d86e7e2329d0 service nova] Acquired lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.network.neutron [req-36af7c90-a28e-475e-8213-30b8bee5ead1 req-bd24821e-0fd9-43dc-b76a-d86e7e2329d0 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Refreshing network info cache for port f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.compute.manager [req-5d7b097b-f089-4e29-aafe-843087c8c7dd req-2fa88231-8387-408f-a7f8-85aa7b5756f4 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Received event network-vif-plugged-a8c64f37-8597-4654-bf2e-3fede1dbfc44 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5d7b097b-f089-4e29-aafe-843087c8c7dd req-2fa88231-8387-408f-a7f8-85aa7b5756f4 service nova] Acquiring lock "4a753e20-7c6a-471d-97c1-23514aeff398-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5d7b097b-f089-4e29-aafe-843087c8c7dd req-2fa88231-8387-408f-a7f8-85aa7b5756f4 service nova] Lock "4a753e20-7c6a-471d-97c1-23514aeff398-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5d7b097b-f089-4e29-aafe-843087c8c7dd req-2fa88231-8387-408f-a7f8-85aa7b5756f4 service nova] Lock "4a753e20-7c6a-471d-97c1-23514aeff398-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.compute.manager [req-5d7b097b-f089-4e29-aafe-843087c8c7dd req-2fa88231-8387-408f-a7f8-85aa7b5756f4 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] No waiting events found dispatching network-vif-plugged-a8c64f37-8597-4654-bf2e-3fede1dbfc44 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:35:15 user nova-compute[74630]: WARNING nova.compute.manager [req-5d7b097b-f089-4e29-aafe-843087c8c7dd req-2fa88231-8387-408f-a7f8-85aa7b5756f4 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Received unexpected event network-vif-plugged-a8c64f37-8597-4654-bf2e-3fede1dbfc44 for instance with vm_state building and task_state spawning.
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.537s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:35:15 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Instance spawned successfully.
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.network.neutron [req-36af7c90-a28e-475e-8213-30b8bee5ead1 req-bd24821e-0fd9-43dc-b76a-d86e7e2329d0 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Updated VIF entry in instance network info cache for port f5f32762-6dc9-47fb-a90d-463f3be1283a. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:35:15 user nova-compute[74630]: DEBUG nova.network.neutron [req-36af7c90-a28e-475e-8213-30b8bee5ead1 req-bd24821e-0fd9-43dc-b76a-d86e7e2329d0 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Updating instance_info_cache with network_info: [{"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf5f32762-6d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:35:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-36af7c90-a28e-475e-8213-30b8bee5ead1 req-bd24821e-0fd9-43dc-b76a-d86e7e2329d0 service nova] Releasing lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:35:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-49939fc4-ffec-4714-adb1-aa1275d9891f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.081s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:16 user nova-compute[74630]: INFO nova.compute.manager [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Took 6.67 seconds to spawn the instance on the hypervisor.
Oct 26 03:35:16 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:35:16 user nova-compute[74630]: INFO nova.compute.manager [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Took 7.80 seconds to build instance.
Oct 26 03:35:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e1743551-8969-45ed-839c-cd977eed6025 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "4a753e20-7c6a-471d-97c1-23514aeff398" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.899s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "dedde109-8cf7-487d-be41-3b8951180c26" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:18 user nova-compute[74630]: INFO nova.compute.manager [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Detaching volume 87523dc8-b43f-44b1-8692-4eb1a84c498c
Oct 26 03:35:18 user nova-compute[74630]: INFO nova.virt.block_device [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Attempting to driver detach volume 87523dc8-b43f-44b1-8692-4eb1a84c498c from mountpoint /dev/vdb
Oct 26 03:35:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Attempting to detach device vdb from instance dedde109-8cf7-487d-be41-3b8951180c26 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:35:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:35:18 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:35:18 user nova-compute[74630]:   <source dev="/dev/sdf"/>
Oct 26 03:35:18 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:35:18 user nova-compute[74630]:   <serial>87523dc8-b43f-44b1-8692-4eb1a84c498c</serial>
Oct 26 03:35:18 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:35:18 user nova-compute[74630]: </disk>
Oct 26 03:35:18 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:35:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Successfully detached device vdb from instance dedde109-8cf7-487d-be41-3b8951180c26 from the persistent domain config.
Oct 26 03:35:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dedde109-8cf7-487d-be41-3b8951180c26 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:35:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:35:18 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:35:18 user nova-compute[74630]:   <source dev="/dev/sdf"/>
Oct 26 03:35:18 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:35:18 user nova-compute[74630]:   <serial>87523dc8-b43f-44b1-8692-4eb1a84c498c</serial>
Oct 26 03:35:18 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:35:18 user nova-compute[74630]: </disk>
Oct 26 03:35:18 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:35:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dedde109-8cf7-487d-be41-3b8951180c26 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:35:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-a62b390a-b772-43fa-901f-681256c4fada req-eb90b5cb-64d2-429b-9934-6542046fa7c6 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-changed-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:35:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-a62b390a-b772-43fa-901f-681256c4fada req-eb90b5cb-64d2-429b-9934-6542046fa7c6 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Refreshing instance network info cache due to event network-changed-b75891ea-8201-4c0f-a203-ef383b64938b. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:35:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a62b390a-b772-43fa-901f-681256c4fada req-eb90b5cb-64d2-429b-9934-6542046fa7c6 service nova] Acquiring lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:35:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a62b390a-b772-43fa-901f-681256c4fada req-eb90b5cb-64d2-429b-9934-6542046fa7c6 service nova] Acquired lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:35:20 user nova-compute[74630]: DEBUG nova.network.neutron [req-a62b390a-b772-43fa-901f-681256c4fada req-eb90b5cb-64d2-429b-9934-6542046fa7c6 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Refreshing network info cache for port b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:35:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e748e6b1-72d5-4832-a992-32070d237064" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:20 user nova-compute[74630]: INFO nova.compute.manager [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Detaching volume 7af0c89b-5b12-4227-bee7-6be65def035b
Oct 26 03:35:20 user nova-compute[74630]: DEBUG nova.network.neutron [req-a62b390a-b772-43fa-901f-681256c4fada req-eb90b5cb-64d2-429b-9934-6542046fa7c6 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Updated VIF entry in instance network info cache for port b75891ea-8201-4c0f-a203-ef383b64938b. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:35:20 user nova-compute[74630]: DEBUG nova.network.neutron [req-a62b390a-b772-43fa-901f-681256c4fada req-eb90b5cb-64d2-429b-9934-6542046fa7c6 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Updating instance_info_cache with network_info: [{"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:35:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a62b390a-b772-43fa-901f-681256c4fada req-eb90b5cb-64d2-429b-9934-6542046fa7c6 service nova] Releasing lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:35:20 user nova-compute[74630]: INFO nova.virt.block_device [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Attempting to driver detach volume 7af0c89b-5b12-4227-bee7-6be65def035b from mountpoint /dev/vdb
Oct 26 03:35:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Attempting to detach device vdb from instance e748e6b1-72d5-4832-a992-32070d237064 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:35:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:35:20 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:35:20 user nova-compute[74630]:   <source dev="/dev/sdd"/>
Oct 26 03:35:20 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:35:20 user nova-compute[74630]:   <serial>7af0c89b-5b12-4227-bee7-6be65def035b</serial>
Oct 26 03:35:20 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:35:20 user nova-compute[74630]: </disk>
Oct 26 03:35:20 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:35:20 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Successfully detached device vdb from instance e748e6b1-72d5-4832-a992-32070d237064 from the persistent domain config.
Oct 26 03:35:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e748e6b1-72d5-4832-a992-32070d237064 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:35:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:35:20 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:35:20 user nova-compute[74630]:   <source dev="/dev/sdd"/>
Oct 26 03:35:20 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:35:20 user nova-compute[74630]:   <serial>7af0c89b-5b12-4227-bee7-6be65def035b</serial>
Oct 26 03:35:20 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:35:20 user nova-compute[74630]: </disk>
Oct 26 03:35:20 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:35:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e748e6b1-72d5-4832-a992-32070d237064 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:35:22 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:35:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-e322906f-dfff-4af9-a9c5-d3c2f3711363 req-7769ab78-44de-4605-a12a-06203fd981ec service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-changed-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:35:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-e322906f-dfff-4af9-a9c5-d3c2f3711363 req-7769ab78-44de-4605-a12a-06203fd981ec service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Refreshing instance network info cache due to event network-changed-b75891ea-8201-4c0f-a203-ef383b64938b. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:35:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e322906f-dfff-4af9-a9c5-d3c2f3711363 req-7769ab78-44de-4605-a12a-06203fd981ec service nova] Acquiring lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:35:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e322906f-dfff-4af9-a9c5-d3c2f3711363 req-7769ab78-44de-4605-a12a-06203fd981ec service nova] Acquired lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:35:22 user nova-compute[74630]: DEBUG nova.network.neutron [req-e322906f-dfff-4af9-a9c5-d3c2f3711363 req-7769ab78-44de-4605-a12a-06203fd981ec service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Refreshing network info cache for port b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:35:22 user nova-compute[74630]: DEBUG nova.network.neutron [req-e322906f-dfff-4af9-a9c5-d3c2f3711363 req-7769ab78-44de-4605-a12a-06203fd981ec service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Updated VIF entry in instance network info cache for port b75891ea-8201-4c0f-a203-ef383b64938b. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:35:22 user nova-compute[74630]: DEBUG nova.network.neutron [req-e322906f-dfff-4af9-a9c5-d3c2f3711363 req-7769ab78-44de-4605-a12a-06203fd981ec service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Updating instance_info_cache with network_info: [{"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:35:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e322906f-dfff-4af9-a9c5-d3c2f3711363 req-7769ab78-44de-4605-a12a-06203fd981ec service nova] Releasing lock "refresh_cache-e748e6b1-72d5-4832-a992-32070d237064" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:35:23 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 571ada6a-d632-4596-be98-9f72cab3b5f2 is timed out.
Oct 26 03:35:23 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Successfully detached device vdb from instance 571ada6a-d632-4596-be98-9f72cab3b5f2 from the live domain config.
Oct 26 03:35:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbwnAisH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:35:23 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0821356-4d06-4a52-a8c7-b23f3cddfeaf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:35:23 user nova-compute[74630]: No targets found.
Oct 26 03:35:23 user nova-compute[74630]: iSNS:
Oct 26 03:35:23 user nova-compute[74630]: No targets found.
Oct 26 03:35:23 user nova-compute[74630]: STATIC:
Oct 26 03:35:23 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:35:23 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:23 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:23 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc
Oct 26 03:35:23 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:23 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:23 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794
Oct 26 03:35:23 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:23 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:23 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b
Oct 26 03:35:23 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:23 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:23 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4
Oct 26 03:35:23 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:23 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:23 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0
Oct 26 03:35:23 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:23 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:23 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8
Oct 26 03:35:23 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:23 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:23 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c
Oct 26 03:35:23 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:23 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:23 user nova-compute[74630]: FIRMWARE:
Oct 26 03:35:23 user nova-compute[74630]: No targets found.
Oct 26 03:35:23 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:35:23 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:35:23 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[155f0185-0290-471d-b6d5-dddde06b0ca1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4230084-f1d9-4b64-90fe-dd4e17412aa5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:23 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:23 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:23 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:35:23 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:23 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:23 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:23 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:35:23 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:23 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:23 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:23 user nova-compute[74630]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 (non-flash)
Oct 26 03:35:23 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:23 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:23 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:23 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:35:23 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f315c712c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0'): ({'sdc'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Removing single pathed devices sdc {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70ceca6-5de3-4a08-8ce1-87ba8e07ceaa]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[21806b75-28be-4a47-b956-ab93a30ba2ac]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Flushing IO for device /dev/sdc {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1e4a7b-f7e2-40e8-aa4f-4a8a2f56ee89]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0284d79-16b7-4012-8f3a-6451dcca882a]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc8b28d-d28b-46c7-b712-c0bbb8a78d1e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b05260-a179-480f-843a-9ad5f39d6835]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0, portal: 172.16.0.220,3260]
Oct 26 03:35:23 user nova-compute[74630]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0, portal: 172.16.0.220,3260] successful.
Oct 26 03:35:23 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7c3577-0bc3-4eab-b1e0-67c1d7ddd47e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] <== disconnect_volume: return (408ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:35:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:35:24 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:35:25 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:35:25 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:35:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:25 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:35:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG nova.objects.instance [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lazy-loading 'flavor' on Instance uuid 571ada6a-d632-4596-be98-9f72cab3b5f2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-371a3c0d-d627-4a06-8b1d-2197f2d30470 tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.569s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 23.432s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "571ada6a-d632-4596-be98-9f72cab3b5f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:26 user nova-compute[74630]: INFO nova.compute.manager [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Terminating instance
Oct 26 03:35:26 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG nova.compute.manager [req-e79ce027-2e20-4630-bf39-3ab48a084a72 req-e66c5bca-22e5-4b1b-91dc-4a11ac62f6cc service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Received event network-vif-unplugged-86372de7-53c3-423b-85b4-185aa7bfce4a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e79ce027-2e20-4630-bf39-3ab48a084a72 req-e66c5bca-22e5-4b1b-91dc-4a11ac62f6cc service nova] Acquiring lock "571ada6a-d632-4596-be98-9f72cab3b5f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e79ce027-2e20-4630-bf39-3ab48a084a72 req-e66c5bca-22e5-4b1b-91dc-4a11ac62f6cc service nova] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e79ce027-2e20-4630-bf39-3ab48a084a72 req-e66c5bca-22e5-4b1b-91dc-4a11ac62f6cc service nova] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG nova.compute.manager [req-e79ce027-2e20-4630-bf39-3ab48a084a72 req-e66c5bca-22e5-4b1b-91dc-4a11ac62f6cc service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] No waiting events found dispatching network-vif-unplugged-86372de7-53c3-423b-85b4-185aa7bfce4a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG nova.compute.manager [req-e79ce027-2e20-4630-bf39-3ab48a084a72 req-e66c5bca-22e5-4b1b-91dc-4a11ac62f6cc service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Received event network-vif-unplugged-86372de7-53c3-423b-85b4-185aa7bfce4a for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:26 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Instance destroyed successfully.
Oct 26 03:35:26 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lazy-loading 'resources' on Instance uuid 571ada6a-d632-4596-be98-9f72cab3b5f2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2120837458',display_name='tempest-VolumesSnapshotTestJSON-instance-2120837458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2120837458',id=26,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPRQ6Hln4uUE74Qq8QVTVCrbS3ZUAigR+PbAeRxKPq+5NeyBisvyebkAe7sAzY+2hpbuae4q/ZjcJ4PapmhqN4ANM9uT2WFz5xYM+O/pdYbI2sXAg7Zp0RARoemzrrl3w==',key_name='tempest-keypair-1585261013',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:31:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15963835048c4d1a9186d63fe8ef8688',ramdisk_id='',reservation_id='r-i2qde3mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1574923981',owner_user_name='tempest-VolumesSnapshotTestJSON-1574923981-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:31:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e5e3a45981c47488bc2f8718280ebe4',uuid=571ada6a-d632-4596-be98-9f72cab3b5f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86372de7-53c3-423b-85b4-185aa7bfce4a", "address": "fa:16:3e:98:90:02", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86372de7-53", "ovs_interfaceid": "86372de7-53c3-423b-85b4-185aa7bfce4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Converting VIF {"id": "86372de7-53c3-423b-85b4-185aa7bfce4a", "address": "fa:16:3e:98:90:02", "network": {"id": "9c576755-a619-4934-af03-3b69276b112b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1902698572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15963835048c4d1a9186d63fe8ef8688", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86372de7-53", "ovs_interfaceid": "86372de7-53c3-423b-85b4-185aa7bfce4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:90:02,bridge_name='br-int',has_traffic_filtering=True,id=86372de7-53c3-423b-85b4-185aa7bfce4a,network=Network(9c576755-a619-4934-af03-3b69276b112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86372de7-53') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG os_vif [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:90:02,bridge_name='br-int',has_traffic_filtering=True,id=86372de7-53c3-423b-85b4-185aa7bfce4a,network=Network(9c576755-a619-4934-af03-3b69276b112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86372de7-53') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86372de7-53, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0720e063-05cd-47dc-8480-7ec563ff85fd) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:26 user nova-compute[74630]: INFO os_vif [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:90:02,bridge_name='br-int',has_traffic_filtering=True,id=86372de7-53c3-423b-85b4-185aa7bfce4a,network=Network(9c576755-a619-4934-af03-3b69276b112b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86372de7-53')
Oct 26 03:35:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zbwnAisH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:35:26 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:35:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:35:26 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[10766877-4179-4cce-80e9-c1d39d4d1ba4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:35:27 user nova-compute[74630]: No targets found.
Oct 26 03:35:27 user nova-compute[74630]: iSNS:
Oct 26 03:35:27 user nova-compute[74630]: No targets found.
Oct 26 03:35:27 user nova-compute[74630]: STATIC:
Oct 26 03:35:27 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:35:27 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:27 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:27 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc
Oct 26 03:35:27 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:27 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:27 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794
Oct 26 03:35:27 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:27 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:27 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b
Oct 26 03:35:27 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:27 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:27 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4
Oct 26 03:35:27 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:27 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:27 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8
Oct 26 03:35:27 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:27 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:27 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c
Oct 26 03:35:27 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:27 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:27 user nova-compute[74630]: FIRMWARE:
Oct 26 03:35:27 user nova-compute[74630]: No targets found.
Oct 26 03:35:27 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:35:27 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:35:27 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bec64578-1c20-4a78-89d3-062cc96f95a0', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e9b77844-67a8-4c26-90f2-afc1809b33d1 is timed out.
Oct 26 03:35:27 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Successfully detached device vdb from instance e9b77844-67a8-4c26-90f2-afc1809b33d1 from the live domain config.
Oct 26 03:35:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GfSKNUvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:35:27 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0710d5-bdfa-4396-8e10-8a680f7b82ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb1cb73-157e-4e38-bb25-efdf7310bcd4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:35:27 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:35:27 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f315c713760>, {}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Disconnecting from: [] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.146s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] <== disconnect_volume: return (147ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:35:27 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Deleting instance files /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2_del
Oct 26 03:35:27 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Deletion of /opt/stack/data/nova/instances/571ada6a-d632-4596-be98-9f72cab3b5f2_del complete
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.060s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[92239d26-004f-4e92-9574-71f3c3b995cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:35:27 user nova-compute[74630]: No targets found.
Oct 26 03:35:27 user nova-compute[74630]: iSNS:
Oct 26 03:35:27 user nova-compute[74630]: No targets found.
Oct 26 03:35:27 user nova-compute[74630]: STATIC:
Oct 26 03:35:27 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:35:27 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:27 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:27 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc
Oct 26 03:35:27 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:27 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:27 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794
Oct 26 03:35:27 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:27 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:27 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b
Oct 26 03:35:27 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:27 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:27 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4
Oct 26 03:35:27 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:27 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:27 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8
Oct 26 03:35:27 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:27 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:27 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c
Oct 26 03:35:27 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:27 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:27 user nova-compute[74630]: FIRMWARE:
Oct 26 03:35:27 user nova-compute[74630]: No targets found.
Oct 26 03:35:27 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:35:27 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:35:27 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bf8daf-895b-409d-b0bb-231c23ec37ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: INFO nova.compute.manager [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Took 1.10 seconds to destroy the instance on the hypervisor.
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e42e0d1-6e9c-41d2-98f1-968f109ddb3e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:35:27 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:27 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:35:27 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f318457d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc'): ({'sdg'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Removing single pathed devices sdg {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76a334f-5241-4a7a-97ea-0f5485864617]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c366900-a5ca-4f25-a5be-7998c4f7ba94]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Flushing IO for device /dev/sdg {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f381a8e7-3351-406e-82ce-9c957d942575]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0148aa17-55b4-4f14-857d-9395cad54cd7]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] SCSI volumes sdg have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa481a3-22a5-460d-bde5-748d2178f46f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3094895b-0f36-478b-a5fe-7cccdac71c5e]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc, portal: 172.16.0.220,3260]
Oct 26 03:35:27 user nova-compute[74630]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc, portal: 172.16.0.220,3260] successful.
Oct 26 03:35:27 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94837b5c-b6c7-4955-92cf-b431e71ca8dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb3b3f1-4ae6-4a6a-bafb-964badbef425]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] <== disconnect_volume: return (483ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:35:28 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Took 1.00 seconds to deallocate network for instance.
Oct 26 03:35:28 user nova-compute[74630]: WARNING nova.volume.cinder [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Attachment ec61a0a4-b4f3-42d7-a925-6787c1c0e170 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ec61a0a4-b4f3-42d7-a925-6787c1c0e170. (HTTP 404) (Request-ID: req-2fc866fc-b1ae-4f7b-9623-416cc719a576)
Oct 26 03:35:28 user nova-compute[74630]: INFO nova.compute.manager [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Took 0.04 seconds to detach 1 volumes for instance.
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG nova.objects.instance [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lazy-loading 'flavor' on Instance uuid e9b77844-67a8-4c26-90f2-afc1809b33d1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-ee884b8a-05ec-4d1a-a747-800c301666ba req-9465f202-efae-4f79-92ef-5c7f2ed2758d service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Received event network-vif-plugged-86372de7-53c3-423b-85b4-185aa7bfce4a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ee884b8a-05ec-4d1a-a747-800c301666ba req-9465f202-efae-4f79-92ef-5c7f2ed2758d service nova] Acquiring lock "571ada6a-d632-4596-be98-9f72cab3b5f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ee884b8a-05ec-4d1a-a747-800c301666ba req-9465f202-efae-4f79-92ef-5c7f2ed2758d service nova] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ee884b8a-05ec-4d1a-a747-800c301666ba req-9465f202-efae-4f79-92ef-5c7f2ed2758d service nova] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-ee884b8a-05ec-4d1a-a747-800c301666ba req-9465f202-efae-4f79-92ef-5c7f2ed2758d service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] No waiting events found dispatching network-vif-plugged-86372de7-53c3-423b-85b4-185aa7bfce4a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:35:28 user nova-compute[74630]: WARNING nova.compute.manager [req-ee884b8a-05ec-4d1a-a747-800c301666ba req-9465f202-efae-4f79-92ef-5c7f2ed2758d service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Received unexpected event network-vif-plugged-86372de7-53c3-423b-85b4-185aa7bfce4a for instance with vm_state deleted and task_state None.
Oct 26 03:35:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-ee884b8a-05ec-4d1a-a747-800c301666ba req-9465f202-efae-4f79-92ef-5c7f2ed2758d service nova] [instance: 571ada6a-d632-4596-be98-9f72cab3b5f2] Received event network-vif-deleted-86372de7-53c3-423b-85b4-185aa7bfce4a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-26bb3bc6-0d12-4d09-98bb-a22fdedb9d8f tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.295s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:29 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:35:29 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:35:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.722s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:29 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Deleted allocations for instance 571ada6a-d632-4596-be98-9f72cab3b5f2
Oct 26 03:35:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5b930f8a-fab6-4d83-9f02-8a0edd6da69a tempest-VolumesSnapshotTestJSON-1574923981 tempest-VolumesSnapshotTestJSON-1574923981-project-member] Lock "571ada6a-d632-4596-be98-9f72cab3b5f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.094s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:29 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Error from libvirt while getting description of instance-0000001a: [Error Code 42] Domain not found: no domain with matching uuid '571ada6a-d632-4596-be98-9f72cab3b5f2' (instance-0000001a): libvirt.libvirtError: Domain not found: no domain with matching uuid '571ada6a-d632-4596-be98-9f72cab3b5f2' (instance-0000001a)
Oct 26 03:35:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:35:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0be74854-6a07-4468-bf1c-c41066af14c2/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0be74854-6a07-4468-bf1c-c41066af14c2/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0be74854-6a07-4468-bf1c-c41066af14c2/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0be74854-6a07-4468-bf1c-c41066af14c2/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:35:31 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:35:31 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=7019MB free_disk=24.833759307861328GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 73ac3b23-4f52-4107-989a-bcb38b9e0a00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e748e6b1-72d5-4832-a992-32070d237064 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance dedde109-8cf7-487d-be41-3b8951180c26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 0be74854-6a07-4468-bf1c-c41066af14c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e9b77844-67a8-4c26-90f2-afc1809b33d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 1e9d2b27-a936-4548-b74a-02a64f180234 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 11c75096-6769-4f10-8515-c96b592958a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 4a753e20-7c6a-471d-97c1-23514aeff398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:35:32 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:35:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-73ac3b23-4f52-4107-989a-bcb38b9e0a00" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:35:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-73ac3b23-4f52-4107-989a-bcb38b9e0a00" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:35:32 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:35:33 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Updating instance_info_cache with network_info: [{"id": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "address": "fa:16:3e:e6:d9:ea", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ab20c-98", "ovs_interfaceid": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:35:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-73ac3b23-4f52-4107-989a-bcb38b9e0a00" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:35:33 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:35:33 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:35:33 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:35:33 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:35:33 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:35:33 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:35:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:38 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dedde109-8cf7-487d-be41-3b8951180c26 is timed out.
Oct 26 03:35:38 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Successfully detached device vdb from instance dedde109-8cf7-487d-be41-3b8951180c26 from the live domain config.
Oct 26 03:35:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jdPVRBJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:35:38 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b31e86-f00d-4a5b-a643-99521cde3cd3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:35:38 user nova-compute[74630]: No targets found.
Oct 26 03:35:38 user nova-compute[74630]: iSNS:
Oct 26 03:35:38 user nova-compute[74630]: No targets found.
Oct 26 03:35:38 user nova-compute[74630]: STATIC:
Oct 26 03:35:38 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:35:38 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:38 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:38 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794
Oct 26 03:35:38 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:38 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:38 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b
Oct 26 03:35:38 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:38 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:38 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4
Oct 26 03:35:38 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:38 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:38 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8
Oct 26 03:35:38 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:38 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:38 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c
Oct 26 03:35:38 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:38 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:38 user nova-compute[74630]: FIRMWARE:
Oct 26 03:35:38 user nova-compute[74630]: No targets found.
Oct 26 03:35:38 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:35:38 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:35:38 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66f98e2-b6b8-4e6e-a0df-88b7d0c36c58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d559790b-0f52-4cbe-ae9b-a8d2ece078f5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:38 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:38 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:38 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:38 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:38 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:35:38 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:38 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:38 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:38 user nova-compute[74630]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c (non-flash)
Oct 26 03:35:38 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:38 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:35:38 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f318457cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c'): ({'sdf'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Removing single pathed devices sdf {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b45280a-7826-44da-84c9-9596e503bb34]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ce40fd-82ed-4ad9-9786-ed253c872a85]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Flushing IO for device /dev/sdf {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[35028d9f-6020-4a56-9def-d640f23a3a62]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[941e4c75-749a-422d-9149-225f76ac8d90]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] SCSI volumes sdf have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86acf79-3a32-4fe5-b6ff-89c3cd6f9474]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36bd520-542e-4609-a2a2-44b47e1c971a]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c, portal: 172.16.0.220,3260]
Oct 26 03:35:39 user nova-compute[74630]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c, portal: 172.16.0.220,3260] successful.
Oct 26 03:35:39 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87523dc8-b43f-44b1-8692-4eb1a84c498c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e03c04-4ff0-4c9f-856f-18273e08bb70]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:35:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] <== disconnect_volume: return (306ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:35:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:35:40 user nova-compute[74630]: DEBUG nova.objects.instance [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lazy-loading 'flavor' on Instance uuid dedde109-8cf7-487d-be41-3b8951180c26 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:35:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31aec2bc-66d2-4661-afe8-75406904d41f tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.068s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:41 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e748e6b1-72d5-4832-a992-32070d237064 is timed out.
Oct 26 03:35:41 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Successfully detached device vdb from instance e748e6b1-72d5-4832-a992-32070d237064 from the live domain config.
Oct 26 03:35:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Lcgwjntf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:35:41 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24a45fc-2eb5-4ebf-8ce7-d027d4e89921]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:35:41 user nova-compute[74630]: No targets found.
Oct 26 03:35:41 user nova-compute[74630]: iSNS:
Oct 26 03:35:41 user nova-compute[74630]: No targets found.
Oct 26 03:35:41 user nova-compute[74630]: STATIC:
Oct 26 03:35:41 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:35:41 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:41 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:41 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794
Oct 26 03:35:41 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:41 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:41 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b
Oct 26 03:35:41 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:41 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:41 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4
Oct 26 03:35:41 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:41 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:41 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8
Oct 26 03:35:41 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:35:41 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:35:41 user nova-compute[74630]: FIRMWARE:
Oct 26 03:35:41 user nova-compute[74630]: No targets found.
Oct 26 03:35:41 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:35:41 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:35:41 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05ca200-0a06-4699-9d9d-de7373cb12c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f25c337-3ce1-4b30-ada4-d1e04f43f1cf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:41 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:41 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:41 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:41 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:35:41 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:35:41 user nova-compute[74630]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b (non-flash)
Oct 26 03:35:41 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:35:41 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:35:41 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:35:41 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f318457d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b'): ({'sdd'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Removing single pathed devices sdd {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[301f6be7-4469-4099-bc26-59784cb8819b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d01541-afa6-47bd-a2f3-895a6448c992]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Flushing IO for device /dev/sdd {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc896ba-a45a-43bc-9219-b6ac13b663bb]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf22cee-3012-48ac-af78-2931efa21eb7]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a365b2-f9c2-4fb0-b80b-efb903947356]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8ff7dc-cd63-4945-8360-217687644d26]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b, portal: 172.16.0.220,3260]
Oct 26 03:35:41 user nova-compute[74630]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b, portal: 172.16.0.220,3260] successful.
Oct 26 03:35:41 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7af0c89b-5b12-4227-bee7-6be65def035b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fec178-8b81-4232-956f-f1a0997f004b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] <== disconnect_volume: return (320ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:35:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:42 user nova-compute[74630]: DEBUG nova.objects.instance [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'flavor' on Instance uuid e748e6b1-72d5-4832-a992-32070d237064 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:35:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-22aec01d-1b74-4921-bd31-0875dff19c72 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e748e6b1-72d5-4832-a992-32070d237064" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.784s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG nova.objects.instance [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lazy-loading 'flavor' on Instance uuid 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:35:44 user nova-compute[74630]: INFO nova.compute.manager [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Attaching volume 02eaae64-f1ec-42c8-9300-991e555cada0 to /dev/vdb
Oct 26 03:35:44 user nova-compute[74630]: DEBUG os_brick.utils [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f22b30-b033-4d3e-9d3a-69b6734a46a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d8c8ad-75b1-4dc5-baa6-e5287905c10e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c760f39e-571b-4f33-853e-3c8971f9da28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6aed5e9-2c87-43c1-9e28-a70525fc594b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:35:44 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:35:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[767941a1-1573-4450-8dc2-b0275c9260e7]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG os_brick.utils [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:35:44 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Updating existing volume attachment record: 03c32098-33fe-4150-852b-9662a0baff8c {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:35:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:35:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:36:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "dedde109-8cf7-487d-be41-3b8951180c26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "dedde109-8cf7-487d-be41-3b8951180c26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:08 user nova-compute[74630]: INFO nova.compute.manager [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Terminating instance
Oct 26 03:36:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:36:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-c1322379-7b04-4346-9cfa-6ccf6a4cb8b9 req-bfaf889c-5165-499d-88cd-21c9d5ae2c7d service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Received event network-vif-unplugged-a61bcc65-236e-4545-a8f3-bb45e1cc018d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c1322379-7b04-4346-9cfa-6ccf6a4cb8b9 req-bfaf889c-5165-499d-88cd-21c9d5ae2c7d service nova] Acquiring lock "dedde109-8cf7-487d-be41-3b8951180c26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c1322379-7b04-4346-9cfa-6ccf6a4cb8b9 req-bfaf889c-5165-499d-88cd-21c9d5ae2c7d service nova] Lock "dedde109-8cf7-487d-be41-3b8951180c26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c1322379-7b04-4346-9cfa-6ccf6a4cb8b9 req-bfaf889c-5165-499d-88cd-21c9d5ae2c7d service nova] Lock "dedde109-8cf7-487d-be41-3b8951180c26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-c1322379-7b04-4346-9cfa-6ccf6a4cb8b9 req-bfaf889c-5165-499d-88cd-21c9d5ae2c7d service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] No waiting events found dispatching network-vif-unplugged-a61bcc65-236e-4545-a8f3-bb45e1cc018d {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-c1322379-7b04-4346-9cfa-6ccf6a4cb8b9 req-bfaf889c-5165-499d-88cd-21c9d5ae2c7d service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Received event network-vif-unplugged-a61bcc65-236e-4545-a8f3-bb45e1cc018d for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:36:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Instance destroyed successfully.
Oct 26 03:36:09 user nova-compute[74630]: DEBUG nova.objects.instance [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lazy-loading 'resources' on Instance uuid dedde109-8cf7-487d-be41-3b8951180c26 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:31:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1426477300',display_name='tempest-TestServerVolumeAttachmentScenario-server-1426477300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1426477300',id=25,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKK41ivvTKu4uM+pYPpwEtvLmSVT9Uqu57O/omNb+XIMnNGEZl7cebbcMy4xCcSYYOtQp4aL0ZERaacvwH1jOqxK9p8JUmacMo8eUATBIKpV20TNWfkQdBOPrTmfpKKjCA==',key_name='tempest-keypair-1416157645',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:31:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8e3bd76b50a465f8a7819fb9666be41',ramdisk_id='',reservation_id='r-dt7m1g0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-640796290',owner_user_name='tempest-TestServerVolumeAttachmentScenario-640796290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:31:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adc29c93473b43ac891c0b5a73ee9c2b',uuid=dedde109-8cf7-487d-be41-3b8951180c26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "address": "fa:16:3e:30:29:c4", "network": {"id": "9d5f9542-9f34-4008-bfe5-5472cc3ac9e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1826216881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3bd76b50a465f8a7819fb9666be41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61bcc65-23", "ovs_interfaceid": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Converting VIF {"id": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "address": "fa:16:3e:30:29:c4", "network": {"id": "9d5f9542-9f34-4008-bfe5-5472cc3ac9e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1826216881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8e3bd76b50a465f8a7819fb9666be41", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa61bcc65-23", "ovs_interfaceid": "a61bcc65-236e-4545-a8f3-bb45e1cc018d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:29:c4,bridge_name='br-int',has_traffic_filtering=True,id=a61bcc65-236e-4545-a8f3-bb45e1cc018d,network=Network(9d5f9542-9f34-4008-bfe5-5472cc3ac9e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa61bcc65-23') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG os_vif [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:29:c4,bridge_name='br-int',has_traffic_filtering=True,id=a61bcc65-236e-4545-a8f3-bb45e1cc018d,network=Network(9d5f9542-9f34-4008-bfe5-5472cc3ac9e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa61bcc65-23') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa61bcc65-23, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db00a162-3355-4cbd-bf11-7678de216084) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:09 user nova-compute[74630]: INFO os_vif [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:29:c4,bridge_name='br-int',has_traffic_filtering=True,id=a61bcc65-236e-4545-a8f3-bb45e1cc018d,network=Network(9d5f9542-9f34-4008-bfe5-5472cc3ac9e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa61bcc65-23')
Oct 26 03:36:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Deleting instance files /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26_del
Oct 26 03:36:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Deletion of /opt/stack/data/nova/instances/dedde109-8cf7-487d-be41-3b8951180c26_del complete
Oct 26 03:36:09 user nova-compute[74630]: INFO nova.compute.manager [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 26 03:36:09 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:36:09 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: dedde109-8cf7-487d-be41-3b8951180c26] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:36:10 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:36:10 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Took 1.05 seconds to deallocate network for instance.
Oct 26 03:36:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-0b29b06a-5c2d-4b84-88e2-ea3f2c19087f req-18011190-a120-471b-9aa2-fdc0ba1ec2ee service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Received event network-vif-deleted-a61bcc65-236e-4545-a8f3-bb45e1cc018d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-4ff0682b-14d2-4147-8929-002d3d3b4498 req-62c8d107-8c21-4ac2-86b8-9d16f6e3e052 service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Received event network-vif-plugged-a61bcc65-236e-4545-a8f3-bb45e1cc018d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4ff0682b-14d2-4147-8929-002d3d3b4498 req-62c8d107-8c21-4ac2-86b8-9d16f6e3e052 service nova] Acquiring lock "dedde109-8cf7-487d-be41-3b8951180c26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4ff0682b-14d2-4147-8929-002d3d3b4498 req-62c8d107-8c21-4ac2-86b8-9d16f6e3e052 service nova] Lock "dedde109-8cf7-487d-be41-3b8951180c26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4ff0682b-14d2-4147-8929-002d3d3b4498 req-62c8d107-8c21-4ac2-86b8-9d16f6e3e052 service nova] Lock "dedde109-8cf7-487d-be41-3b8951180c26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-4ff0682b-14d2-4147-8929-002d3d3b4498 req-62c8d107-8c21-4ac2-86b8-9d16f6e3e052 service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] No waiting events found dispatching network-vif-plugged-a61bcc65-236e-4545-a8f3-bb45e1cc018d {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:11 user nova-compute[74630]: WARNING nova.compute.manager [req-4ff0682b-14d2-4147-8929-002d3d3b4498 req-62c8d107-8c21-4ac2-86b8-9d16f6e3e052 service nova] [instance: dedde109-8cf7-487d-be41-3b8951180c26] Received unexpected event network-vif-plugged-a61bcc65-236e-4545-a8f3-bb45e1cc018d for instance with vm_state deleted and task_state None.
Oct 26 03:36:11 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:11 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Deleted allocations for instance dedde109-8cf7-487d-be41-3b8951180c26
Oct 26 03:36:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e748e6b1-72d5-4832-a992-32070d237064" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:11 user nova-compute[74630]: INFO nova.compute.manager [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Terminating instance
Oct 26 03:36:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6573dc2d-e07b-49e8-a5a2-c8ebefe35bb8 tempest-TestServerVolumeAttachmentScenario-640796290 tempest-TestServerVolumeAttachmentScenario-640796290-project-member] Lock "dedde109-8cf7-487d-be41-3b8951180c26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.715s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:12 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: e748e6b1-72d5-4832-a992-32070d237064] Instance destroyed successfully.
Oct 26 03:36:12 user nova-compute[74630]: DEBUG nova.objects.instance [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'resources' on Instance uuid e748e6b1-72d5-4832-a992-32070d237064 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:28:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-669113886',display_name='tempest-ServerRescueNegativeTestJSON-server-669113886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-669113886',id=23,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQ7A+Oi05puuZCxjb1Gla62sCt0xlDzLUfOfZl8W878tAr590CUZ83zWNmE3vYrqMx0mj979VdjN3SFmuveJm926K5vLb2t3sO8Srwh2TvxN2SxREaL3Mizqc4rUoferw==',key_name='tempest-keypair-894050888',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:31:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b652c6f02780451b89d51d74178bf6c7',ramdisk_id='',reservation_id='r-dp6pivuc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2117587238',owner_user_name='tempest-ServerRescueNegativeTestJSON-2117587238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:33:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62370747d10a420b81009d23e3ba324b',uuid=e748e6b1-72d5-4832-a992-32070d237064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converting VIF {"id": "b75891ea-8201-4c0f-a203-ef383b64938b", "address": "fa:16:3e:80:af:55", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75891ea-82", "ovs_interfaceid": "b75891ea-8201-4c0f-a203-ef383b64938b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:af:55,bridge_name='br-int',has_traffic_filtering=True,id=b75891ea-8201-4c0f-a203-ef383b64938b,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb75891ea-82') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG os_vif [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:af:55,bridge_name='br-int',has_traffic_filtering=True,id=b75891ea-8201-4c0f-a203-ef383b64938b,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb75891ea-82') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb75891ea-82, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5b7013c-b6ba-4cb0-8f13-b733189ef2f3) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:36:12 user nova-compute[74630]: INFO os_vif [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:af:55,bridge_name='br-int',has_traffic_filtering=True,id=b75891ea-8201-4c0f-a203-ef383b64938b,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb75891ea-82')
Oct 26 03:36:12 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Deleting instance files /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064_del
Oct 26 03:36:12 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Deletion of /opt/stack/data/nova/instances/e748e6b1-72d5-4832-a992-32070d237064_del complete
Oct 26 03:36:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:12 user nova-compute[74630]: INFO nova.compute.manager [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: e748e6b1-72d5-4832-a992-32070d237064] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 26 03:36:12 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: e748e6b1-72d5-4832-a992-32070d237064] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: e748e6b1-72d5-4832-a992-32070d237064] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: e748e6b1-72d5-4832-a992-32070d237064] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:36:13 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: e748e6b1-72d5-4832-a992-32070d237064] Took 0.80 seconds to deallocate network for instance.
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-1c655c39-7f23-48bd-8469-eb8f32cd9995 req-203992a7-1e33-4086-b093-1c32638e8122 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-deleted-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-unplugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-unplugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:13 user nova-compute[74630]: WARNING nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-unplugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state deleted and task_state None.
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:13 user nova-compute[74630]: WARNING nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state deleted and task_state None.
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:13 user nova-compute[74630]: WARNING nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state deleted and task_state None.
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:13 user nova-compute[74630]: WARNING nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state deleted and task_state None.
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-unplugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-unplugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:13 user nova-compute[74630]: WARNING nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-unplugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state deleted and task_state None.
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Acquiring lock "e748e6b1-72d5-4832-a992-32070d237064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] Lock "e748e6b1-72d5-4832-a992-32070d237064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] No waiting events found dispatching network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:13 user nova-compute[74630]: WARNING nova.compute.manager [req-443cc0ac-9ba2-4cf0-8c79-d7fd8c0917c1 req-005f8982-abce-4e3a-9485-f44847a7b382 service nova] [instance: e748e6b1-72d5-4832-a992-32070d237064] Received unexpected event network-vif-plugged-b75891ea-8201-4c0f-a203-ef383b64938b for instance with vm_state deleted and task_state None.
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.550s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:13 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Deleted allocations for instance e748e6b1-72d5-4832-a992-32070d237064
Oct 26 03:36:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-454798f1-dbc4-4eea-9af1-61af3e73820b tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "e748e6b1-72d5-4832-a992-32070d237064" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.491s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaxlvLhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:36:14 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:36:14 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:36:14 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6d1d3a-5d7e-498e-892e-9dffe6b677da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:36:14 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[659f3c77-5642-4a0b-86aa-e4599f4a9ed5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0] added
Oct 26 03:36:14 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40311ff-cefa-4174-acc7-b3ceadbf6d81]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e8373b-7db2-43aa-957b-fb9bafcd9576]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QaxlvLhb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QaxlvLhb" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef2e1b2-d288-4caf-b3cb-7d1afd9faef9]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QaxlvLhb'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be6f653-9621-4bcb-9b20-6760809c2d09]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba40a4c3-32bb-4901-a700-80f4e7be7bd0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:36:14 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:36:14 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:36:14 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:36:14 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:36:14 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:36:14 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:36:14 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:36:14 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e580bf41-9df9-4ce0-9856-a1522578cca9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0, portal: 172.16.0.220,3260]
Oct 26 03:36:14 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0, portal: 172.16.0.220,3260] successful.
Oct 26 03:36:14 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7db23a-ccba-4199-98c7-4d415c2dc741]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db61454-66e4-49b0-a306-2422687d099b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:36:14 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:36:14 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:36:14 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:36:14 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:36:14 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:36:14 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:36:14 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:36:14 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:36:14 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:36:14 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c307f424-23c3-4c6c-a467-e171deaf5cef]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:36:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaxlvLhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:36:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:36:15 user nova-compute[74630]: INFO nova.compute.manager [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] instance snapshotting
Oct 26 03:36:15 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Beginning live snapshot process
Oct 26 03:36:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:36:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23765663632616437', 'path': '/dev/sdc'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:36:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765663632616437', 'path': '/dev/sdc'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:36:15 user nova-compute[74630]: DEBUG nova.objects.instance [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lazy-loading 'flavor' on Instance uuid 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:36:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:36:15 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:36:15 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:36:15 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:36:15 user nova-compute[74630]:   <serial>02eaae64-f1ec-42c8-9300-991e555cada0</serial>
Oct 26 03:36:15 user nova-compute[74630]: </disk>
Oct 26 03:36:15 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:36:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json -f qcow2 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json -f qcow2 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:36:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:36:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] No VIF found with MAC fa:16:3e:22:15:28, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:36:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf_iveomj/c0dc596c1c28408aab4f71fe117b8908.delta 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4888b726-cf09-4cc6-9476-9ef3faafdcf0 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.638s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf_iveomj/c0dc596c1c28408aab4f71fe117b8908.delta 1073741824" returned: 0 in 0.049s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:16 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 03:36:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:36:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:36:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 03:36:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] There are 0 instances to clean {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 03:36:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74630) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 03:36:17 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 03:36:17 user nova-compute[74630]: INFO nova.compute.manager [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Rescuing
Oct 26 03:36:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:36:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquired lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:36:17 user nova-compute[74630]: DEBUG nova.network.neutron [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:36:17 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:36:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf_iveomj/c0dc596c1c28408aab4f71fe117b8908.delta /opt/stack/data/nova/instances/snapshots/tmpf_iveomj/c0dc596c1c28408aab4f71fe117b8908 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf_iveomj/c0dc596c1c28408aab4f71fe117b8908.delta /opt/stack/data/nova/instances/snapshots/tmpf_iveomj/c0dc596c1c28408aab4f71fe117b8908" returned: 0 in 0.313s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:17 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Snapshot extracted, beginning image upload
Oct 26 03:36:18 user nova-compute[74630]: DEBUG nova.network.neutron [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Updating instance_info_cache with network_info: [{"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:36:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Releasing lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:36:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-b0caa79a-b207-40ae-b22f-529c79e66819 req-5437118d-0c5b-466f-a9d4-2f3783d16dd7 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-vif-unplugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b0caa79a-b207-40ae-b22f-529c79e66819 req-5437118d-0c5b-466f-a9d4-2f3783d16dd7 service nova] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b0caa79a-b207-40ae-b22f-529c79e66819 req-5437118d-0c5b-466f-a9d4-2f3783d16dd7 service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b0caa79a-b207-40ae-b22f-529c79e66819 req-5437118d-0c5b-466f-a9d4-2f3783d16dd7 service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-b0caa79a-b207-40ae-b22f-529c79e66819 req-5437118d-0c5b-466f-a9d4-2f3783d16dd7 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] No waiting events found dispatching network-vif-unplugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:18 user nova-compute[74630]: WARNING nova.compute.manager [req-b0caa79a-b207-40ae-b22f-529c79e66819 req-5437118d-0c5b-466f-a9d4-2f3783d16dd7 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received unexpected event network-vif-unplugged-02a0e249-0a94-475c-9754-2834697559c2 for instance with vm_state active and task_state rescuing.
Oct 26 03:36:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Instance destroyed successfully.
Oct 26 03:36:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Attempting a stable device rescue
Oct 26 03:36:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74630) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 03:36:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Instance directory exists: not creating {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 03:36:19 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Creating image(s)
Oct 26 03:36:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "/opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "/opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:19 user nova-compute[74630]: DEBUG nova.objects.instance [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:36:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "3ea2c45979032952a410ab812aa96e23e0361a51" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "3ea2c45979032952a410ab812aa96e23e0361a51" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea2c45979032952a410ab812aa96e23e0361a51.part --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:20 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:36:20 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74630) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 03:36:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea2c45979032952a410ab812aa96e23e0361a51.part --force-share --output=json" returned: 0 in 0.213s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:20 user nova-compute[74630]: DEBUG nova.virt.images [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] 4f5f4a7b-8c26-461a-89c6-0dc8776f718e was qcow2, converting to raw {{(pid=74630) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 03:36:20 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:36:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3ea2c45979032952a410ab812aa96e23e0361a51.part /opt/stack/data/nova/instances/_base/3ea2c45979032952a410ab812aa96e23e0361a51.converted {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:20 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Snapshot image upload complete
Oct 26 03:36:20 user nova-compute[74630]: INFO nova.compute.manager [None req-af3c9a81-ec4d-4f73-b1a4-0e1a8b9b42a6 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Took 5.13 seconds to snapshot the instance on the hypervisor.
Oct 26 03:36:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-17b3fc37-3729-477c-bcb0-a39f7b299385 req-ed076527-e358-4129-bab2-7e46f90e6aaf service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-17b3fc37-3729-477c-bcb0-a39f7b299385 req-ed076527-e358-4129-bab2-7e46f90e6aaf service nova] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-17b3fc37-3729-477c-bcb0-a39f7b299385 req-ed076527-e358-4129-bab2-7e46f90e6aaf service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-17b3fc37-3729-477c-bcb0-a39f7b299385 req-ed076527-e358-4129-bab2-7e46f90e6aaf service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-17b3fc37-3729-477c-bcb0-a39f7b299385 req-ed076527-e358-4129-bab2-7e46f90e6aaf service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] No waiting events found dispatching network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:20 user nova-compute[74630]: WARNING nova.compute.manager [req-17b3fc37-3729-477c-bcb0-a39f7b299385 req-ed076527-e358-4129-bab2-7e46f90e6aaf service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received unexpected event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 for instance with vm_state active and task_state rescuing.
Oct 26 03:36:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3ea2c45979032952a410ab812aa96e23e0361a51.part /opt/stack/data/nova/instances/_base/3ea2c45979032952a410ab812aa96e23e0361a51.converted" returned: 0 in 0.439s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea2c45979032952a410ab812aa96e23e0361a51.converted --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea2c45979032952a410ab812aa96e23e0361a51.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "3ea2c45979032952a410ab812aa96e23e0361a51" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.034s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "3ea2c45979032952a410ab812aa96e23e0361a51" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "3ea2c45979032952a410ab812aa96e23e0361a51" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea2c45979032952a410ab812aa96e23e0361a51 --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea2c45979032952a410ab812aa96e23e0361a51 --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3ea2c45979032952a410ab812aa96e23e0361a51,backing_fmt=raw /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.rescue {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3ea2c45979032952a410ab812aa96e23e0361a51,backing_fmt=raw /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.rescue" returned: 0 in 0.054s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "3ea2c45979032952a410ab812aa96e23e0361a51" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.objects.instance [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lazy-loading 'migration_context' on Instance uuid 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.objects.base [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Object Instance<6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Start _get_guest_xml network_info=[{"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "vif_mac": "fa:16:3e:22:15:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4f5f4a7b-8c26-461a-89c6-0dc8776f718e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaxlvLhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9', 'attached_at': '', 'detached_at': '', 'volume_id': '02eaae64-f1ec-42c8-9300-991e555cada0', 'serial': '02eaae64-f1ec-42c8-9300-991e555cada0'}, 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '03c32098-33fe-4150-852b-9662a0baff8c', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.objects.instance [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lazy-loading 'resources' on Instance uuid 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.objects.base [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Object Instance<6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.objects.instance [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lazy-loading 'numa_topology' on Instance uuid 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.objects.base [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Object Instance<6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:36:21 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:36:21 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.objects.instance [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.objects.base [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Object Instance<6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaxlvLhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:36:21 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:36:21 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:36:21 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6cf9b2-d304-4aa8-8e45-f07d2d7d3f1e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QaxlvLhb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 03:36:21 user nova-compute[74630]: node.name = iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0
Oct 26 03:36:21 user nova-compute[74630]: node.tpgt = -1
Oct 26 03:36:21 user nova-compute[74630]: node.startup = automatic
Oct 26 03:36:21 user nova-compute[74630]: node.leading_login = No
Oct 26 03:36:21 user nova-compute[74630]: iface.iscsi_ifacename = default
Oct 26 03:36:21 user nova-compute[74630]: iface.net_ifacename = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.ipaddress = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.prefix_len = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.hwaddress = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.transport_name = tcp
Oct 26 03:36:21 user nova-compute[74630]: iface.initiatorname = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.state = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.vlan_id = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.vlan_priority = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.vlan_state = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.iface_num = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.mtu = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.port = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.bootproto = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.subnet_mask = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.gateway = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.dhcp_alt_client_id = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.dhcp_dns = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.dhcp_learn_iqn = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.dhcp_vendor_id_state = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.dhcp_vendor_id = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.dhcp_slp_da = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.fragmentation = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.gratuitous_arp = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.incoming_forwarding = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.tos_state = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.tos = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.ttl = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.delayed_ack = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.tcp_nagle = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.tcp_wsf_state = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.tcp_wsf = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.tcp_timer_scale = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.tcp_timestamp = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.redirect = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.def_task_mgmt_timeout = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.header_digest = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.data_digest = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.immediate_data = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.initial_r2t = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.data_seq_inorder = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.data_pdu_inorder = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.erl = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.max_receive_data_len = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.first_burst_len = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.max_outstanding_r2t = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.max_burst_len = 0
Oct 26 03:36:21 user nova-compute[74630]: iface.chap_auth = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.bidi_chap = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.strict_login_compliance = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.discovery_auth = <empty>
Oct 26 03:36:21 user nova-compute[74630]: iface.discovery_logout = <empty>
Oct 26 03:36:21 user nova-compute[74630]: node.discovery_address = <empty>
Oct 26 03:36:21 user nova-compute[74630]: node.discovery_port = 0
Oct 26 03:36:21 user nova-compute[74630]: node.discovery_type = static
Oct 26 03:36:21 user nova-compute[74630]: node.session.initial_cmdsn = 0
Oct 26 03:36:21 user nova-compute[74630]: node.session.initial_login_retry_max = 8
Oct 26 03:36:21 user nova-compute[74630]: node.session.xmit_thread_priority = -20
Oct 26 03:36:21 user nova-compute[74630]: node.session.cmds_max = 128
Oct 26 03:36:21 user nova-compute[74630]: node.session.queue_depth = 32
Oct 26 03:36:21 user nova-compute[74630]: node.session.nr_sessions = 1
Oct 26 03:36:21 user nova-compute[74630]: node.session.auth.authmethod = CHAP
Oct 26 03:36:21 user nova-compute[74630]: node.session.auth.username = QaxlvLhb
Oct 26 03:36:21 user nova-compute[74630]: node.session.auth.password = ***
Oct 26 03:36:21 user nova-compute[74630]: node.session.auth.username_in = <empty>
Oct 26 03:36:21 user nova-compute[74630]: node.session.auth.password_in = <empty>
Oct 26 03:36:21 user nova-compute[74630]: node.session.auth.chap_algs = MD5
Oct 26 03:36:21 user nova-compute[74630]: node.session.timeo.replacement_timeout = 120
Oct 26 03:36:21 user nova-compute[74630]: node.session.err_timeo.abort_timeout = 15
Oct 26 03:36:21 user nova-compute[74630]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 03:36:21 user nova-compute[74630]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 03:36:21 user nova-compute[74630]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 03:36:21 user nova-compute[74630]: node.session.iscsi.FastAbort = Yes
Oct 26 03:36:21 user nova-compute[74630]: node.session.iscsi.InitialR2T = No
Oct 26 03:36:21 user nova-compute[74630]: node.session.iscsi.ImmediateData = Yes
Oct 26 03:36:21 user nova-compute[74630]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 03:36:21 user nova-compute[74630]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 03:36:21 user nova-compute[74630]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 03:36:21 user nova-compute[74630]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 03:36:21 user nova-compute[74630]: node.session.iscsi.MaxConnections = 1
Oct 26 03:36:21 user nova-compute[74630]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 03:36:21 user nova-compute[74630]: node.session.iscsi.ERL = 0
Oct 26 03:36:21 user nova-compute[74630]: node.session.scan = manual
Oct 26 03:36:21 user nova-compute[74630]: node.session.reopen_max = 0
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].address = 172.16.0.220
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].port = 3260
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].startup = manual
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].tcp.window_size = 524288
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].tcp.type_of_service = 0
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].timeo.logout_timeout = 15
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].timeo.login_timeout = 15
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].timeo.auth_timeout = 45
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].iscsi.DataDigest = None
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].iscsi.IFMarker = No
Oct 26 03:36:21 user nova-compute[74630]: node.conn[0].iscsi.OFMarker = No
Oct 26 03:36:21 user nova-compute[74630]: # END RECORD
Oct 26 03:36:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c28352-cbb4-4613-95e7-e86537b198de]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[93af8122-3da6-4b99-b5a3-f59d4e01a737]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QaxlvLhb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QaxlvLhb" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d8741f-e8f8-438e-b335-da9eb95bcdaa]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QaxlvLhb'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebfce90-7854-4a25-b0cd-5c560dbd9278]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[97366271-2136-48a6-8d8c-421617269193]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:36:21 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:36:21 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:36:21 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:36:21 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:36:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:36:21 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:36:21 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:36:21 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:36:21 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:36:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.163s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] HCTL ('34', '0', '0', 0) found on session 35 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c671f93c-8b68-4d8b-953d-bc768c1685d7]: (4, ('0 0 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Searching for a device in session 35 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaxlvLhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.191s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] <== connect_volume: return (192ms) {'type': 'block', 'scsi_wwn': '23765663632616437', 'path': '/dev/sdc'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765663632616437', 'path': '/dev/sdc'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1868004368',display_name='tempest-ServerStableDeviceRescueTest-server-1868004368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1868004368',id=28,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFC6NXMSPyyw1g6+xSeE/vl9+H/GvU/He8VS7Yjec0ZqF+S6tvl0L4Bk1vv8WgmPnj146MkMUEtWtP4csR+EGR8rXD4vtkUnhByB4CIzoqcFtEPCAqMZloduZRLpZTLz+A==',key_name='tempest-keypair-533323538',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:32:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='400857740007472cb751dac6b40d881e',ramdisk_id='',reservation_id='r-4nompxck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1839582341',owner_user_name='tempest-ServerStableDeviceRescueTest-1839582341-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:33:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ac12db50b4d49068be8b20c4ea28651',uuid=6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "vif_mac": "fa:16:3e:22:15:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Converting VIF {"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "vif_mac": "fa:16:3e:22:15:28"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:15:28,bridge_name='br-int',has_traffic_filtering=True,id=02a0e249-0a94-475c-9754-2834697559c2,network=Network(14b85bdb-a349-4db4-8fd4-dada8a2eb901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a0e249-0a') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.objects.instance [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.objects.base [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Object Instance<6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:36:21 user nova-compute[74630]:   <uuid>6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9</uuid>
Oct 26 03:36:21 user nova-compute[74630]:   <name>instance-0000001c</name>
Oct 26 03:36:21 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:36:21 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:36:21 user nova-compute[74630]:   <metadata>
Oct 26 03:36:21 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:36:21 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:36:21 user nova-compute[74630]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1868004368</nova:name>
Oct 26 03:36:21 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:36:21</nova:creationTime>
Oct 26 03:36:21 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:36:21 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:36:21 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:36:21 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:36:21 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:36:21 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:36:21 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:36:21 user nova-compute[74630]:       <nova:owner>
Oct 26 03:36:21 user nova-compute[74630]:         <nova:user uuid="6ac12db50b4d49068be8b20c4ea28651">tempest-ServerStableDeviceRescueTest-1839582341-project-member</nova:user>
Oct 26 03:36:21 user nova-compute[74630]:         <nova:project uuid="400857740007472cb751dac6b40d881e">tempest-ServerStableDeviceRescueTest-1839582341</nova:project>
Oct 26 03:36:21 user nova-compute[74630]:       </nova:owner>
Oct 26 03:36:21 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:36:21 user nova-compute[74630]:       <nova:ports>
Oct 26 03:36:21 user nova-compute[74630]:         <nova:port uuid="02a0e249-0a94-475c-9754-2834697559c2">
Oct 26 03:36:21 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 03:36:21 user nova-compute[74630]:         </nova:port>
Oct 26 03:36:21 user nova-compute[74630]:       </nova:ports>
Oct 26 03:36:21 user nova-compute[74630]:     </nova:instance>
Oct 26 03:36:21 user nova-compute[74630]:   </metadata>
Oct 26 03:36:21 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:36:21 user nova-compute[74630]:     <system>
Oct 26 03:36:21 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:36:21 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:36:21 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:36:21 user nova-compute[74630]:       <entry name="serial">6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9</entry>
Oct 26 03:36:21 user nova-compute[74630]:       <entry name="uuid">6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9</entry>
Oct 26 03:36:21 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:36:21 user nova-compute[74630]:     </system>
Oct 26 03:36:21 user nova-compute[74630]:   </sysinfo>
Oct 26 03:36:21 user nova-compute[74630]:   <os>
Oct 26 03:36:21 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:36:21 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:36:21 user nova-compute[74630]:   </os>
Oct 26 03:36:21 user nova-compute[74630]:   <features>
Oct 26 03:36:21 user nova-compute[74630]:     <acpi/>
Oct 26 03:36:21 user nova-compute[74630]:     <apic/>
Oct 26 03:36:21 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:36:21 user nova-compute[74630]:   </features>
Oct 26 03:36:21 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:36:21 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:36:21 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:36:21 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:36:21 user nova-compute[74630]:   </clock>
Oct 26 03:36:21 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:36:21 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:36:21 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:36:21 user nova-compute[74630]:   </cpu>
Oct 26 03:36:21 user nova-compute[74630]:   <devices>
Oct 26 03:36:21 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:36:21 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:36:21 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk"/>
Oct 26 03:36:21 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:36:21 user nova-compute[74630]:     </disk>
Oct 26 03:36:21 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:36:21 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:36:21 user nova-compute[74630]:       <source dev="/dev/sdc"/>
Oct 26 03:36:21 user nova-compute[74630]:       <target dev="vdb" bus="virtio"/>
Oct 26 03:36:21 user nova-compute[74630]:       <serial>02eaae64-f1ec-42c8-9300-991e555cada0</serial>
Oct 26 03:36:21 user nova-compute[74630]:     </disk>
Oct 26 03:36:21 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:36:21 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:36:21 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.rescue"/>
Oct 26 03:36:21 user nova-compute[74630]:       <target dev="vdc" bus="virtio"/>
Oct 26 03:36:21 user nova-compute[74630]:       <boot order="1"/>
Oct 26 03:36:21 user nova-compute[74630]:     </disk>
Oct 26 03:36:21 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:36:21 user nova-compute[74630]:       <mac address="fa:16:3e:22:15:28"/>
Oct 26 03:36:21 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:36:21 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:36:21 user nova-compute[74630]:       <target dev="tap02a0e249-0a"/>
Oct 26 03:36:21 user nova-compute[74630]:     </interface>
Oct 26 03:36:21 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:36:21 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/console.log" append="off"/>
Oct 26 03:36:21 user nova-compute[74630]:     </serial>
Oct 26 03:36:21 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:36:21 user nova-compute[74630]:     <video>
Oct 26 03:36:21 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:36:21 user nova-compute[74630]:     </video>
Oct 26 03:36:21 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:36:21 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:36:21 user nova-compute[74630]:     </rng>
Oct 26 03:36:21 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:36:21 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:36:21 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:36:21 user nova-compute[74630]:     </memballoon>
Oct 26 03:36:21 user nova-compute[74630]:   </devices>
Oct 26 03:36:21 user nova-compute[74630]: </domain>
Oct 26 03:36:21 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:36:21 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Instance destroyed successfully.
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:36:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] No VIF found with MAC fa:16:3e:22:15:28, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:36:22 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:36:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:36:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:22 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:36:22 user nova-compute[74630]: INFO nova.compute.claims [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Claim successful on node user
Oct 26 03:36:23 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG nova.network.neutron [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:36:23 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:36:23 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG nova.policy [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ecfe593558b4abc88818fd1cf7bbdb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3feb502c9d64505b7fc186fbd271f98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:36:23 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Creating image(s)
Oct 26 03:36:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "/opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "/opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "/opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "b351e48480b831190ec7a40c5c4ced9f632f7b8a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "b351e48480b831190ec7a40c5c4ced9f632f7b8a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a.part --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:24 user nova-compute[74630]: DEBUG nova.network.neutron [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Successfully created port: 8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:36:24 user nova-compute[74630]: DEBUG nova.compute.manager [req-814d866b-d1b8-444f-a503-1f5de6e37fd2 req-31802af8-5666-44ea-a9a6-d13248da636a service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-814d866b-d1b8-444f-a503-1f5de6e37fd2 req-31802af8-5666-44ea-a9a6-d13248da636a service nova] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-814d866b-d1b8-444f-a503-1f5de6e37fd2 req-31802af8-5666-44ea-a9a6-d13248da636a service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-814d866b-d1b8-444f-a503-1f5de6e37fd2 req-31802af8-5666-44ea-a9a6-d13248da636a service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:24 user nova-compute[74630]: DEBUG nova.compute.manager [req-814d866b-d1b8-444f-a503-1f5de6e37fd2 req-31802af8-5666-44ea-a9a6-d13248da636a service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] No waiting events found dispatching network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:24 user nova-compute[74630]: WARNING nova.compute.manager [req-814d866b-d1b8-444f-a503-1f5de6e37fd2 req-31802af8-5666-44ea-a9a6-d13248da636a service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received unexpected event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 for instance with vm_state active and task_state rescuing.
Oct 26 03:36:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a.part --force-share --output=json" returned: 0 in 0.197s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:24 user nova-compute[74630]: DEBUG nova.virt.images [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] a81a41a5-1289-4883-9e84-3375b36283f5 was qcow2, converting to raw {{(pid=74630) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 03:36:24 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:36:24 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a.part /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a.converted {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a.part /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a.converted" returned: 0 in 0.225s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a.converted --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "b351e48480b831190ec7a40c5c4ced9f632f7b8a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.778s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.network.neutron [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Successfully updated port: 8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "refresh_cache-f183da7f-ac50-4b6c-8a7b-62b14939bd5e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquired lock "refresh_cache-f183da7f-ac50-4b6c-8a7b-62b14939bd5e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.network.neutron [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.network.neutron [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a --force-share --output=json" returned: 0 in 0.201s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "b351e48480b831190ec7a40c5c4ced9f632f7b8a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "b351e48480b831190ec7a40c5c4ced9f632f7b8a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a --force-share --output=json" returned: 0 in 0.172s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a,backing_fmt=raw /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a,backing_fmt=raw /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk 1073741824" returned: 0 in 0.056s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "b351e48480b831190ec7a40c5c4ced9f632f7b8a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.network.neutron [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Updating instance_info_cache with network_info: [{"id": "8524a132-6deb-46af-9f8d-910a6e7340b0", "address": "fa:16:3e:3c:00:72", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8524a132-6d", "ovs_interfaceid": "8524a132-6deb-46af-9f8d-910a6e7340b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.compute.manager [req-68ea1b5a-2c2c-47a2-90a8-1ab6d15ff8de req-03b84307-3fbb-49c4-b8d4-01de5c78b86f service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-68ea1b5a-2c2c-47a2-90a8-1ab6d15ff8de req-03b84307-3fbb-49c4-b8d4-01de5c78b86f service nova] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-68ea1b5a-2c2c-47a2-90a8-1ab6d15ff8de req-03b84307-3fbb-49c4-b8d4-01de5c78b86f service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-68ea1b5a-2c2c-47a2-90a8-1ab6d15ff8de req-03b84307-3fbb-49c4-b8d4-01de5c78b86f service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.compute.manager [req-68ea1b5a-2c2c-47a2-90a8-1ab6d15ff8de req-03b84307-3fbb-49c4-b8d4-01de5c78b86f service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] No waiting events found dispatching network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:25 user nova-compute[74630]: WARNING nova.compute.manager [req-68ea1b5a-2c2c-47a2-90a8-1ab6d15ff8de req-03b84307-3fbb-49c4-b8d4-01de5c78b86f service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received unexpected event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 for instance with vm_state active and task_state rescuing.
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.compute.manager [req-68ea1b5a-2c2c-47a2-90a8-1ab6d15ff8de req-03b84307-3fbb-49c4-b8d4-01de5c78b86f service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Received event network-changed-8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.compute.manager [req-68ea1b5a-2c2c-47a2-90a8-1ab6d15ff8de req-03b84307-3fbb-49c4-b8d4-01de5c78b86f service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Refreshing instance network info cache due to event network-changed-8524a132-6deb-46af-9f8d-910a6e7340b0. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-68ea1b5a-2c2c-47a2-90a8-1ab6d15ff8de req-03b84307-3fbb-49c4-b8d4-01de5c78b86f service nova] Acquiring lock "refresh_cache-f183da7f-ac50-4b6c-8a7b-62b14939bd5e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Releasing lock "refresh_cache-f183da7f-ac50-4b6c-8a7b-62b14939bd5e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Instance network_info: |[{"id": "8524a132-6deb-46af-9f8d-910a6e7340b0", "address": "fa:16:3e:3c:00:72", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8524a132-6d", "ovs_interfaceid": "8524a132-6deb-46af-9f8d-910a6e7340b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-68ea1b5a-2c2c-47a2-90a8-1ab6d15ff8de req-03b84307-3fbb-49c4-b8d4-01de5c78b86f service nova] Acquired lock "refresh_cache-f183da7f-ac50-4b6c-8a7b-62b14939bd5e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.network.neutron [req-68ea1b5a-2c2c-47a2-90a8-1ab6d15ff8de req-03b84307-3fbb-49c4-b8d4-01de5c78b86f service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Refreshing network info cache for port 8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a --force-share --output=json" returned: 0 in 0.194s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Ensure instance console log exists: /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Start _get_guest_xml network_info=[{"id": "8524a132-6deb-46af-9f8d-910a6e7340b0", "address": "fa:16:3e:3c:00:72", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8524a132-6d", "ovs_interfaceid": "8524a132-6deb-46af-9f8d-910a6e7340b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='915c9c0bcca71222caea5d640470c952',container_format='bare',created_at=2023-10-26T03:36:15Z,direct_url=<?>,disk_format='qcow2',id=a81a41a5-1289-4883-9e84-3375b36283f5,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-193816686',owner='b3feb502c9d64505b7fc186fbd271f98',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T03:36:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': 'a81a41a5-1289-4883-9e84-3375b36283f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:36:25 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:36:25 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='915c9c0bcca71222caea5d640470c952',container_format='bare',created_at=2023-10-26T03:36:15Z,direct_url=<?>,disk_format='qcow2',id=a81a41a5-1289-4883-9e84-3375b36283f5,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-193816686',owner='b3feb502c9d64505b7fc186fbd271f98',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T03:36:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:36:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-215099074',display_name='tempest-TestStampPattern-server-215099074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-215099074',id=34,image_ref='a81a41a5-1289-4883-9e84-3375b36283f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsUi1JFav2rUQ4amatuW91o6BTV1PUkbeAhUKUE9hmgaI99WgwyETHpA4Y+2RpaoFdsnsCe7I0YgyLj8QbS8GQub3NG5km5MaVTjvf64ODji9wzJUh+5eSPSYEe519qTQ==',key_name='tempest-TestStampPattern-1907926505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3feb502c9d64505b7fc186fbd271f98',ramdisk_id='',reservation_id='r-rghcmkmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e9b77844-67a8-4c26-90f2-afc1809b33d1',image_min_disk='1',image_min_ram='0',image_owner_id='b3feb502c9d64505b7fc186fbd271f98',image_owner_project_name='tempest-TestStampPattern-1086414073',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1086414073-project-member',image_user_id='2ecfe593558b4abc88818fd1cf7bbdb8',network_allocated='True',owner_project_name='tempest-TestStampPattern-1086414073',owner_user_name='tempest-TestStampPattern-1086414073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:36:23Z,user_data=None,user_id='2ecfe593558b4abc88818fd1cf7bbdb8',uuid=f183da7f-ac50-4b6c-8a7b-62b14939bd5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8524a132-6deb-46af-9f8d-910a6e7340b0", "address": "fa:16:3e:3c:00:72", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8524a132-6d", "ovs_interfaceid": "8524a132-6deb-46af-9f8d-910a6e7340b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Converting VIF {"id": "8524a132-6deb-46af-9f8d-910a6e7340b0", "address": "fa:16:3e:3c:00:72", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8524a132-6d", "ovs_interfaceid": "8524a132-6deb-46af-9f8d-910a6e7340b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:00:72,bridge_name='br-int',has_traffic_filtering=True,id=8524a132-6deb-46af-9f8d-910a6e7340b0,network=Network(2b989db0-17d0-4283-a2c4-84f29f5cf56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8524a132-6d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:36:25 user nova-compute[74630]: DEBUG nova.objects.instance [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lazy-loading 'pci_devices' on Instance uuid f183da7f-ac50-4b6c-8a7b-62b14939bd5e {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:36:26 user nova-compute[74630]:   <uuid>f183da7f-ac50-4b6c-8a7b-62b14939bd5e</uuid>
Oct 26 03:36:26 user nova-compute[74630]:   <name>instance-00000022</name>
Oct 26 03:36:26 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:36:26 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:36:26 user nova-compute[74630]:   <metadata>
Oct 26 03:36:26 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:36:26 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:36:26 user nova-compute[74630]:       <nova:name>tempest-TestStampPattern-server-215099074</nova:name>
Oct 26 03:36:26 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:36:25</nova:creationTime>
Oct 26 03:36:26 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:36:26 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:36:26 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:36:26 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:36:26 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:36:26 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:36:26 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:36:26 user nova-compute[74630]:       <nova:owner>
Oct 26 03:36:26 user nova-compute[74630]:         <nova:user uuid="2ecfe593558b4abc88818fd1cf7bbdb8">tempest-TestStampPattern-1086414073-project-member</nova:user>
Oct 26 03:36:26 user nova-compute[74630]:         <nova:project uuid="b3feb502c9d64505b7fc186fbd271f98">tempest-TestStampPattern-1086414073</nova:project>
Oct 26 03:36:26 user nova-compute[74630]:       </nova:owner>
Oct 26 03:36:26 user nova-compute[74630]:       <nova:root type="image" uuid="a81a41a5-1289-4883-9e84-3375b36283f5"/>
Oct 26 03:36:26 user nova-compute[74630]:       <nova:ports>
Oct 26 03:36:26 user nova-compute[74630]:         <nova:port uuid="8524a132-6deb-46af-9f8d-910a6e7340b0">
Oct 26 03:36:26 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 03:36:26 user nova-compute[74630]:         </nova:port>
Oct 26 03:36:26 user nova-compute[74630]:       </nova:ports>
Oct 26 03:36:26 user nova-compute[74630]:     </nova:instance>
Oct 26 03:36:26 user nova-compute[74630]:   </metadata>
Oct 26 03:36:26 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:36:26 user nova-compute[74630]:     <system>
Oct 26 03:36:26 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:36:26 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:36:26 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:36:26 user nova-compute[74630]:       <entry name="serial">f183da7f-ac50-4b6c-8a7b-62b14939bd5e</entry>
Oct 26 03:36:26 user nova-compute[74630]:       <entry name="uuid">f183da7f-ac50-4b6c-8a7b-62b14939bd5e</entry>
Oct 26 03:36:26 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:36:26 user nova-compute[74630]:     </system>
Oct 26 03:36:26 user nova-compute[74630]:   </sysinfo>
Oct 26 03:36:26 user nova-compute[74630]:   <os>
Oct 26 03:36:26 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:36:26 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:36:26 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:36:26 user nova-compute[74630]:   </os>
Oct 26 03:36:26 user nova-compute[74630]:   <features>
Oct 26 03:36:26 user nova-compute[74630]:     <acpi/>
Oct 26 03:36:26 user nova-compute[74630]:     <apic/>
Oct 26 03:36:26 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:36:26 user nova-compute[74630]:   </features>
Oct 26 03:36:26 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:36:26 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:36:26 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:36:26 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:36:26 user nova-compute[74630]:   </clock>
Oct 26 03:36:26 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:36:26 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:36:26 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:36:26 user nova-compute[74630]:   </cpu>
Oct 26 03:36:26 user nova-compute[74630]:   <devices>
Oct 26 03:36:26 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:36:26 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:36:26 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk"/>
Oct 26 03:36:26 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:36:26 user nova-compute[74630]:     </disk>
Oct 26 03:36:26 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:36:26 user nova-compute[74630]:       <mac address="fa:16:3e:3c:00:72"/>
Oct 26 03:36:26 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:36:26 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:36:26 user nova-compute[74630]:       <target dev="tap8524a132-6d"/>
Oct 26 03:36:26 user nova-compute[74630]:     </interface>
Oct 26 03:36:26 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:36:26 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/console.log" append="off"/>
Oct 26 03:36:26 user nova-compute[74630]:     </serial>
Oct 26 03:36:26 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:36:26 user nova-compute[74630]:     <video>
Oct 26 03:36:26 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:36:26 user nova-compute[74630]:     </video>
Oct 26 03:36:26 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:36:26 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:36:26 user nova-compute[74630]:     </rng>
Oct 26 03:36:26 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:36:26 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:36:26 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:36:26 user nova-compute[74630]:     </memballoon>
Oct 26 03:36:26 user nova-compute[74630]:   </devices>
Oct 26 03:36:26 user nova-compute[74630]: </domain>
Oct 26 03:36:26 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:36:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-215099074',display_name='tempest-TestStampPattern-server-215099074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-215099074',id=34,image_ref='a81a41a5-1289-4883-9e84-3375b36283f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsUi1JFav2rUQ4amatuW91o6BTV1PUkbeAhUKUE9hmgaI99WgwyETHpA4Y+2RpaoFdsnsCe7I0YgyLj8QbS8GQub3NG5km5MaVTjvf64ODji9wzJUh+5eSPSYEe519qTQ==',key_name='tempest-TestStampPattern-1907926505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3feb502c9d64505b7fc186fbd271f98',ramdisk_id='',reservation_id='r-rghcmkmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e9b77844-67a8-4c26-90f2-afc1809b33d1',image_min_disk='1',image_min_ram='0',image_owner_id='b3feb502c9d64505b7fc186fbd271f98',image_owner_project_name='tempest-TestStampPattern-1086414073',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1086414073-project-member',image_user_id='2ecfe593558b4abc88818fd1cf7bbdb8',network_allocated='True',owner_project_name='tempest-TestStampPattern-1086414073',owner_user_name='tempest-TestStampPattern-1086414073-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:36:23Z,user_data=None,user_id='2ecfe593558b4abc88818fd1cf7bbdb8',uuid=f183da7f-ac50-4b6c-8a7b-62b14939bd5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8524a132-6deb-46af-9f8d-910a6e7340b0", "address": "fa:16:3e:3c:00:72", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8524a132-6d", "ovs_interfaceid": "8524a132-6deb-46af-9f8d-910a6e7340b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Converting VIF {"id": "8524a132-6deb-46af-9f8d-910a6e7340b0", "address": "fa:16:3e:3c:00:72", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8524a132-6d", "ovs_interfaceid": "8524a132-6deb-46af-9f8d-910a6e7340b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:00:72,bridge_name='br-int',has_traffic_filtering=True,id=8524a132-6deb-46af-9f8d-910a6e7340b0,network=Network(2b989db0-17d0-4283-a2c4-84f29f5cf56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8524a132-6d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG os_vif [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:00:72,bridge_name='br-int',has_traffic_filtering=True,id=8524a132-6deb-46af-9f8d-910a6e7340b0,network=Network(2b989db0-17d0-4283-a2c4-84f29f5cf56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8524a132-6d') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2aeb8480-cce6-53dc-9f43-5ee5e5914934', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8524a132-6d, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8524a132-6d, col_values=(('qos', UUID('0423e21a-c7db-4168-8b37-8eb38337479d')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8524a132-6d, col_values=(('external_ids', {'iface-id': '8524a132-6deb-46af-9f8d-910a6e7340b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:00:72', 'vm-uuid': 'f183da7f-ac50-4b6c-8a7b-62b14939bd5e'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:26 user nova-compute[74630]: INFO os_vif [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:00:72,bridge_name='br-int',has_traffic_filtering=True,id=8524a132-6deb-46af-9f8d-910a6e7340b0,network=Network(2b989db0-17d0-4283-a2c4-84f29f5cf56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8524a132-6d')
Oct 26 03:36:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG nova.compute.manager [None req-932705aa-68c7-4db5-892c-29243b82ead1 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] No VIF found with MAC fa:16:3e:3c:00:72, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG nova.network.neutron [req-68ea1b5a-2c2c-47a2-90a8-1ab6d15ff8de req-03b84307-3fbb-49c4-b8d4-01de5c78b86f service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Updated VIF entry in instance network info cache for port 8524a132-6deb-46af-9f8d-910a6e7340b0. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG nova.network.neutron [req-68ea1b5a-2c2c-47a2-90a8-1ab6d15ff8de req-03b84307-3fbb-49c4-b8d4-01de5c78b86f service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Updating instance_info_cache with network_info: [{"id": "8524a132-6deb-46af-9f8d-910a6e7340b0", "address": "fa:16:3e:3c:00:72", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8524a132-6d", "ovs_interfaceid": "8524a132-6deb-46af-9f8d-910a6e7340b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:36:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-68ea1b5a-2c2c-47a2-90a8-1ab6d15ff8de req-03b84307-3fbb-49c4-b8d4-01de5c78b86f service nova] Releasing lock "refresh_cache-f183da7f-ac50-4b6c-8a7b-62b14939bd5e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:36:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-4fa7e92f-61f4-4927-86aa-54b6f884b7c8 req-77c504df-b0a2-4a45-a7c9-5d85c63862ae service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Received event network-vif-plugged-8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4fa7e92f-61f4-4927-86aa-54b6f884b7c8 req-77c504df-b0a2-4a45-a7c9-5d85c63862ae service nova] Acquiring lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4fa7e92f-61f4-4927-86aa-54b6f884b7c8 req-77c504df-b0a2-4a45-a7c9-5d85c63862ae service nova] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4fa7e92f-61f4-4927-86aa-54b6f884b7c8 req-77c504df-b0a2-4a45-a7c9-5d85c63862ae service nova] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-4fa7e92f-61f4-4927-86aa-54b6f884b7c8 req-77c504df-b0a2-4a45-a7c9-5d85c63862ae service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] No waiting events found dispatching network-vif-plugged-8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:27 user nova-compute[74630]: WARNING nova.compute.manager [req-4fa7e92f-61f4-4927-86aa-54b6f884b7c8 req-77c504df-b0a2-4a45-a7c9-5d85c63862ae service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Received unexpected event network-vif-plugged-8524a132-6deb-46af-9f8d-910a6e7340b0 for instance with vm_state building and task_state spawning.
Oct 26 03:36:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:36:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:28 user nova-compute[74630]: INFO nova.compute.manager [None req-eedbd4e4-5d58-46fc-8d7b-cc5273a2c9ad tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Unrescuing
Oct 26 03:36:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eedbd4e4-5d58-46fc-8d7b-cc5273a2c9ad tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "refresh_cache-0be74854-6a07-4468-bf1c-c41066af14c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:36:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eedbd4e4-5d58-46fc-8d7b-cc5273a2c9ad tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquired lock "refresh_cache-0be74854-6a07-4468-bf1c-c41066af14c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:36:28 user nova-compute[74630]: DEBUG nova.network.neutron [None req-eedbd4e4-5d58-46fc-8d7b-cc5273a2c9ad tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG nova.network.neutron [None req-eedbd4e4-5d58-46fc-8d7b-cc5273a2c9ad tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Updating instance_info_cache with network_info: [{"id": "81e27221-96a7-4492-b72b-a0ed4f496f09", "address": "fa:16:3e:21:e1:c5", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e27221-96", "ovs_interfaceid": "81e27221-96a7-4492-b72b-a0ed4f496f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eedbd4e4-5d58-46fc-8d7b-cc5273a2c9ad tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Releasing lock "refresh_cache-0be74854-6a07-4468-bf1c-c41066af14c2" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG nova.objects.instance [None req-eedbd4e4-5d58-46fc-8d7b-cc5273a2c9ad tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'flavor' on Instance uuid 0be74854-6a07-4468-bf1c-c41066af14c2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-46d2c512-9b52-4e10-8645-e0705ceb4086 req-bb1aa032-bc3a-4484-a9fb-132b83541449 service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Received event network-vif-plugged-8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-46d2c512-9b52-4e10-8645-e0705ceb4086 req-bb1aa032-bc3a-4484-a9fb-132b83541449 service nova] Acquiring lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-46d2c512-9b52-4e10-8645-e0705ceb4086 req-bb1aa032-bc3a-4484-a9fb-132b83541449 service nova] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-46d2c512-9b52-4e10-8645-e0705ceb4086 req-bb1aa032-bc3a-4484-a9fb-132b83541449 service nova] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-46d2c512-9b52-4e10-8645-e0705ceb4086 req-bb1aa032-bc3a-4484-a9fb-132b83541449 service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] No waiting events found dispatching network-vif-plugged-8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:30 user nova-compute[74630]: WARNING nova.compute.manager [req-46d2c512-9b52-4e10-8645-e0705ceb4086 req-bb1aa032-bc3a-4484-a9fb-132b83541449 service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Received unexpected event network-vif-plugged-8524a132-6deb-46af-9f8d-910a6e7340b0 for instance with vm_state building and task_state spawning.
Oct 26 03:36:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-29e4b6ec-88a0-4791-9f0c-b3ad28657c28 req-0f076f65-367d-49b5-8020-a1e891fd90bd service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received event network-vif-unplugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-29e4b6ec-88a0-4791-9f0c-b3ad28657c28 req-0f076f65-367d-49b5-8020-a1e891fd90bd service nova] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-29e4b6ec-88a0-4791-9f0c-b3ad28657c28 req-0f076f65-367d-49b5-8020-a1e891fd90bd service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-29e4b6ec-88a0-4791-9f0c-b3ad28657c28 req-0f076f65-367d-49b5-8020-a1e891fd90bd service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-29e4b6ec-88a0-4791-9f0c-b3ad28657c28 req-0f076f65-367d-49b5-8020-a1e891fd90bd service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] No waiting events found dispatching network-vif-unplugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:30 user nova-compute[74630]: WARNING nova.compute.manager [req-29e4b6ec-88a0-4791-9f0c-b3ad28657c28 req-0f076f65-367d-49b5-8020-a1e891fd90bd service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received unexpected event network-vif-unplugged-81e27221-96a7-4492-b72b-a0ed4f496f09 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:36:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:36:30 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Instance spawned successfully.
Oct 26 03:36:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:36:30 user nova-compute[74630]: INFO nova.compute.manager [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Took 6.93 seconds to spawn the instance on the hypervisor.
Oct 26 03:36:30 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:30 user nova-compute[74630]: INFO nova.compute.manager [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Took 8.20 seconds to build instance.
Oct 26 03:36:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7ebe5a74-f17b-4ad0-bcad-eba47aa3d426 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.318s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:30 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Instance destroyed successfully.
Oct 26 03:36:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:36:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG nova.compute.manager [req-c6183abe-a95f-4aee-916e-2a3a7a0de8b0 req-88d9fc3b-aae2-453c-a7a0-61ba0df0dd7c service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c6183abe-a95f-4aee-916e-2a3a7a0de8b0 req-88d9fc3b-aae2-453c-a7a0-61ba0df0dd7c service nova] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c6183abe-a95f-4aee-916e-2a3a7a0de8b0 req-88d9fc3b-aae2-453c-a7a0-61ba0df0dd7c service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c6183abe-a95f-4aee-916e-2a3a7a0de8b0 req-88d9fc3b-aae2-453c-a7a0-61ba0df0dd7c service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG nova.compute.manager [req-c6183abe-a95f-4aee-916e-2a3a7a0de8b0 req-88d9fc3b-aae2-453c-a7a0-61ba0df0dd7c service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] No waiting events found dispatching network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:32 user nova-compute[74630]: WARNING nova.compute.manager [req-c6183abe-a95f-4aee-916e-2a3a7a0de8b0 req-88d9fc3b-aae2-453c-a7a0-61ba0df0dd7c service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received unexpected event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:36:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:36:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:36:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:34 user nova-compute[74630]: DEBUG nova.compute.manager [None req-eedbd4e4-5d58-46fc-8d7b-cc5273a2c9ad tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:36:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-8e255364-bb2d-4b87-8549-d2484dd8de13 req-490c1bce-e2a7-46c7-b8c0-bad4e06c97b2 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8e255364-bb2d-4b87-8549-d2484dd8de13 req-490c1bce-e2a7-46c7-b8c0-bad4e06c97b2 service nova] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8e255364-bb2d-4b87-8549-d2484dd8de13 req-490c1bce-e2a7-46c7-b8c0-bad4e06c97b2 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8e255364-bb2d-4b87-8549-d2484dd8de13 req-490c1bce-e2a7-46c7-b8c0-bad4e06c97b2 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-8e255364-bb2d-4b87-8549-d2484dd8de13 req-490c1bce-e2a7-46c7-b8c0-bad4e06c97b2 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] No waiting events found dispatching network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:34 user nova-compute[74630]: WARNING nova.compute.manager [req-8e255364-bb2d-4b87-8549-d2484dd8de13 req-490c1bce-e2a7-46c7-b8c0-bad4e06c97b2 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received unexpected event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:36:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-8e255364-bb2d-4b87-8549-d2484dd8de13 req-490c1bce-e2a7-46c7-b8c0-bad4e06c97b2 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8e255364-bb2d-4b87-8549-d2484dd8de13 req-490c1bce-e2a7-46c7-b8c0-bad4e06c97b2 service nova] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8e255364-bb2d-4b87-8549-d2484dd8de13 req-490c1bce-e2a7-46c7-b8c0-bad4e06c97b2 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8e255364-bb2d-4b87-8549-d2484dd8de13 req-490c1bce-e2a7-46c7-b8c0-bad4e06c97b2 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-8e255364-bb2d-4b87-8549-d2484dd8de13 req-490c1bce-e2a7-46c7-b8c0-bad4e06c97b2 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] No waiting events found dispatching network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:34 user nova-compute[74630]: WARNING nova.compute.manager [req-8e255364-bb2d-4b87-8549-d2484dd8de13 req-490c1bce-e2a7-46c7-b8c0-bad4e06c97b2 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received unexpected event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:36:34 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:36:34 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:36:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=7288MB free_disk=24.639484405517578GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:36:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 73ac3b23-4f52-4107-989a-bcb38b9e0a00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 0be74854-6a07-4468-bf1c-c41066af14c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e9b77844-67a8-4c26-90f2-afc1809b33d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 1e9d2b27-a936-4548-b74a-02a64f180234 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 11c75096-6769-4f10-8515-c96b592958a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 4a753e20-7c6a-471d-97c1-23514aeff398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f183da7f-ac50-4b6c-8a7b-62b14939bd5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing inventories for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating ProviderTree inventory for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating inventory in ProviderTree for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing aggregate associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, aggregates: None {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing trait associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, traits: HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.012s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:35 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:36:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:36:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:36:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:36:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 03:36:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:36:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:36:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:36:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:36:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-70d88a77-099a-4079-ac67-99dcfe1f1e6a req-b253150a-f848-4051-a700-645650b0b92c service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Received event network-changed-8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-70d88a77-099a-4079-ac67-99dcfe1f1e6a req-b253150a-f848-4051-a700-645650b0b92c service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Refreshing instance network info cache due to event network-changed-8f91f921-5357-4156-b113-a4a3b0ef6e2e. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:36:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-70d88a77-099a-4079-ac67-99dcfe1f1e6a req-b253150a-f848-4051-a700-645650b0b92c service nova] Acquiring lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:36:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-70d88a77-099a-4079-ac67-99dcfe1f1e6a req-b253150a-f848-4051-a700-645650b0b92c service nova] Acquired lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:36:43 user nova-compute[74630]: DEBUG nova.network.neutron [req-70d88a77-099a-4079-ac67-99dcfe1f1e6a req-b253150a-f848-4051-a700-645650b0b92c service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Refreshing network info cache for port 8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:36:44 user nova-compute[74630]: DEBUG nova.network.neutron [req-70d88a77-099a-4079-ac67-99dcfe1f1e6a req-b253150a-f848-4051-a700-645650b0b92c service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Updated VIF entry in instance network info cache for port 8f91f921-5357-4156-b113-a4a3b0ef6e2e. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:36:44 user nova-compute[74630]: DEBUG nova.network.neutron [req-70d88a77-099a-4079-ac67-99dcfe1f1e6a req-b253150a-f848-4051-a700-645650b0b92c service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Updating instance_info_cache with network_info: [{"id": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "address": "fa:16:3e:1c:d5:8f", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f91f921-53", "ovs_interfaceid": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:36:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-70d88a77-099a-4079-ac67-99dcfe1f1e6a req-b253150a-f848-4051-a700-645650b0b92c service nova] Releasing lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:36:45 user nova-compute[74630]: DEBUG nova.compute.manager [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Stashing vm_state: active {{(pid=74630) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 26 03:36:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:45 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:36:45 user nova-compute[74630]: INFO nova.compute.claims [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Claim successful on node user
Oct 26 03:36:45 user nova-compute[74630]: INFO nova.compute.resource_tracker [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Updating resource usage from migration 58b423b8-cd9c-4230-8052-bccb86735e68
Oct 26 03:36:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-476f5fa7-720d-4f53-9bce-53db5f348fe1 req-b552ff0b-a778-4b8e-a17e-c03d0c57db74 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-changed-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-476f5fa7-720d-4f53-9bce-53db5f348fe1 req-b552ff0b-a778-4b8e-a17e-c03d0c57db74 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Refreshing instance network info cache due to event network-changed-3c4b3126-d447-40d7-821e-2395434c6d58. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:36:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-476f5fa7-720d-4f53-9bce-53db5f348fe1 req-b552ff0b-a778-4b8e-a17e-c03d0c57db74 service nova] Acquiring lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:36:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-476f5fa7-720d-4f53-9bce-53db5f348fe1 req-b552ff0b-a778-4b8e-a17e-c03d0c57db74 service nova] Acquired lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:36:45 user nova-compute[74630]: DEBUG nova.network.neutron [req-476f5fa7-720d-4f53-9bce-53db5f348fe1 req-b552ff0b-a778-4b8e-a17e-c03d0c57db74 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Refreshing network info cache for port 3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:36:45 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.660s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:46 user nova-compute[74630]: INFO nova.compute.manager [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Migrating
Oct 26 03:36:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG nova.network.neutron [req-476f5fa7-720d-4f53-9bce-53db5f348fe1 req-b552ff0b-a778-4b8e-a17e-c03d0c57db74 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Updated VIF entry in instance network info cache for port 3c4b3126-d447-40d7-821e-2395434c6d58. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG nova.network.neutron [req-476f5fa7-720d-4f53-9bce-53db5f348fe1 req-b552ff0b-a778-4b8e-a17e-c03d0c57db74 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Updating instance_info_cache with network_info: [{"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-476f5fa7-720d-4f53-9bce-53db5f348fe1 req-b552ff0b-a778-4b8e-a17e-c03d0c57db74 service nova] Releasing lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquired lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG nova.network.neutron [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG nova.network.neutron [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Updating instance_info_cache with network_info: [{"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Releasing lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Starting migrate_disk_and_power_off {{(pid=74630) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-25a28928-75e9-47b7-b3bd-5882612e2b80 req-2a49c994-7043-40f9-bbe7-99b274b25164 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-vif-unplugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-25a28928-75e9-47b7-b3bd-5882612e2b80 req-2a49c994-7043-40f9-bbe7-99b274b25164 service nova] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-25a28928-75e9-47b7-b3bd-5882612e2b80 req-2a49c994-7043-40f9-bbe7-99b274b25164 service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-25a28928-75e9-47b7-b3bd-5882612e2b80 req-2a49c994-7043-40f9-bbe7-99b274b25164 service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-25a28928-75e9-47b7-b3bd-5882612e2b80 req-2a49c994-7043-40f9-bbe7-99b274b25164 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] No waiting events found dispatching network-vif-unplugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:46 user nova-compute[74630]: WARNING nova.compute.manager [req-25a28928-75e9-47b7-b3bd-5882612e2b80 req-2a49c994-7043-40f9-bbe7-99b274b25164 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received unexpected event network-vif-unplugged-3c4b3126-d447-40d7-821e-2395434c6d58 for instance with vm_state active and task_state resize_migrating.
Oct 26 03:36:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:47 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Instance destroyed successfully.
Oct 26 03:36:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:34:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1119894',display_name='tempest-ServerActionsTestOtherA-server-1119894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1119894',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwoLYfCM8lwvIIEciV36xGOUw+XalItY+5dZPbHAKn3DqpiwNygwALzSy5pOoP4seOCkowdcCG1fNBC8K731mmxBiQFtvBIY61aup2H6JCAGn52TG97PQD1ZIY1c0HtiA==',key_name='tempest-keypair-1565174322',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:35:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51542ffdf7a84ac5a61f14e124eb2087',ramdisk_id='',reservation_id='r-o5vn07pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-41539930',owner_user_name='tempest-ServerActionsTestOtherA-41539930-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:36:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a419737713f4797ab27db62d5aa746c',uuid=11c75096-6769-4f10-8515-c96b592958a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1431377105-network", "vif_mac": "fa:16:3e:32:fd:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converting VIF {"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1431377105-network", "vif_mac": "fa:16:3e:32:fd:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:fd:96,bridge_name='br-int',has_traffic_filtering=True,id=3c4b3126-d447-40d7-821e-2395434c6d58,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4b3126-d4') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_vif [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:fd:96,bridge_name='br-int',has_traffic_filtering=True,id=3c4b3126-d447-40d7-821e-2395434c6d58,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4b3126-d4') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c4b3126-d4, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed4e9313-bcab-495b-a81a-2673340d0654) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:47 user nova-compute[74630]: INFO os_vif [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:fd:96,bridge_name='br-int',has_traffic_filtering=True,id=3c4b3126-d447-40d7-821e-2395434c6d58,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4b3126-d4')
Oct 26 03:36:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncIyXWaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:36:47 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9d14b8-1268-4277-abf2-9610f2703371]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:36:47 user nova-compute[74630]: No targets found.
Oct 26 03:36:47 user nova-compute[74630]: iSNS:
Oct 26 03:36:47 user nova-compute[74630]: No targets found.
Oct 26 03:36:47 user nova-compute[74630]: STATIC:
Oct 26 03:36:47 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:36:47 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:36:47 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:36:47 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0
Oct 26 03:36:47 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:36:47 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:36:47 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794
Oct 26 03:36:47 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:36:47 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:36:47 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4
Oct 26 03:36:47 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:36:47 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:36:47 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8
Oct 26 03:36:47 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:36:47 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:36:47 user nova-compute[74630]: FIRMWARE:
Oct 26 03:36:47 user nova-compute[74630]: No targets found.
Oct 26 03:36:47 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:36:47 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:36:47 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ec32ff-4586-48c9-8132-5750a6277e17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e33f722-a1f4-4b5b-9bc0-be945a3e6a94]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:36:47 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:36:47 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:36:47 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:36:47 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:36:47 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:36:47 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:36:47 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:36:47 user nova-compute[74630]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:36:47 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:36:47 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c22ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794'): ({'sdi'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Removing single pathed devices sdi {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cf28b2-f7cf-4d2f-b71f-66f8cbff9b29]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2e6ad8-b854-4ad6-a8ab-6ca1abb84b94]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Flushing IO for device /dev/sdi {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef12726-b506-41b7-8a4e-fb0f943b8fa9]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[906a92e9-aa0b-428e-9482-98c1ba6f9227]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] SCSI volumes sdi have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dbc670-5ccb-4a89-a8d8-eb3a788e266e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1448a1-a44b-47cd-9f8d-986528531da7]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260]
Oct 26 03:36:47 user nova-compute[74630]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260] successful.
Oct 26 03:36:47 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3418d53-8f36-4274-b819-332af77e888b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] <== disconnect_volume: return (385ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:36:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:36:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-f50a5e0c-17ad-46e6-89f9-8d19bbde3565 req-9f63f52d-f97d-4835-94db-b0fd220961dc service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f50a5e0c-17ad-46e6-89f9-8d19bbde3565 req-9f63f52d-f97d-4835-94db-b0fd220961dc service nova] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f50a5e0c-17ad-46e6-89f9-8d19bbde3565 req-9f63f52d-f97d-4835-94db-b0fd220961dc service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f50a5e0c-17ad-46e6-89f9-8d19bbde3565 req-9f63f52d-f97d-4835-94db-b0fd220961dc service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-f50a5e0c-17ad-46e6-89f9-8d19bbde3565 req-9f63f52d-f97d-4835-94db-b0fd220961dc service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] No waiting events found dispatching network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:36:49 user nova-compute[74630]: WARNING nova.compute.manager [req-f50a5e0c-17ad-46e6-89f9-8d19bbde3565 req-9f63f52d-f97d-4835-94db-b0fd220961dc service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received unexpected event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 for instance with vm_state active and task_state resize_migrating.
Oct 26 03:36:49 user nova-compute[74630]: DEBUG nova.network.neutron [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Port 3c4b3126-d447-40d7-821e-2395434c6d58 binding to destination host user is already ACTIVE {{(pid=74630) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 03:36:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:36:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquired lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:36:49 user nova-compute[74630]: DEBUG nova.network.neutron [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG nova.network.neutron [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Updating instance_info_cache with network_info: [{"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Releasing lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG os_brick.utils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5a3d15-f81a-46b7-b47d-d56d01ad077b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[62eeec9a-1ad1-4481-b9a8-a0bd6b52fc80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc52684-6c95-41a9-a735-df3b7e600aa8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[628ecc48-7d5c-4a90-99f9-7ab887e47108]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:36:50 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:36:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5dd455-6899-487d-bde8-718bce8824ad]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:36:50 user nova-compute[74630]: DEBUG os_brick.utils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:36:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid fa1dd816-9dc1-4d48-b608-aa0218f22369 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 32264781-acf7-4afa-830a-5469b6a4c744 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid f9890dde-e678-41d4-8447-24bf626c2983 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 40316e54-eee2-4072-b436-4c5bb31724a9 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 73ac3b23-4f52-4107-989a-bcb38b9e0a00 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 0be74854-6a07-4468-bf1c-c41066af14c2 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid e9b77844-67a8-4c26-90f2-afc1809b33d1 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 1e9d2b27-a936-4548-b74a-02a64f180234 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 11c75096-6769-4f10-8515-c96b592958a6 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 4a753e20-7c6a-471d-97c1-23514aeff398 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid f183da7f-ac50-4b6c-8a7b-62b14939bd5e {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "fa1dd816-9dc1-4d48-b608-aa0218f22369" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "32264781-acf7-4afa-830a-5469b6a4c744" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "f9890dde-e678-41d4-8447-24bf626c2983" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "f9890dde-e678-41d4-8447-24bf626c2983" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "40316e54-eee2-4072-b436-4c5bb31724a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "0be74854-6a07-4468-bf1c-c41066af14c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "1e9d2b27-a936-4548-b74a-02a64f180234" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "1e9d2b27-a936-4548-b74a-02a64f180234" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "11c75096-6769-4f10-8515-c96b592958a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:56 user nova-compute[74630]: INFO nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 11c75096-6769-4f10-8515-c96b592958a6] During sync_power_state the instance has a pending task (resize_finish). Skip.
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "11c75096-6769-4f10-8515-c96b592958a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "4a753e20-7c6a-471d-97c1-23514aeff398" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "4a753e20-7c6a-471d-97c1-23514aeff398" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "32264781-acf7-4afa-830a-5469b6a4c744" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "f9890dde-e678-41d4-8447-24bf626c2983" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "40316e54-eee2-4072-b436-4c5bb31724a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "0be74854-6a07-4468-bf1c-c41066af14c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "1e9d2b27-a936-4548-b74a-02a64f180234" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "4a753e20-7c6a-471d-97c1-23514aeff398" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:36:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:36:59 user nova-compute[74630]: DEBUG nova.compute.manager [req-ba63770c-d40b-43cb-93b2-557b2bf1be9c req-ae2166a4-927d-4313-811e-acd3a82b5c25 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Received event network-changed-a8c64f37-8597-4654-bf2e-3fede1dbfc44 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:36:59 user nova-compute[74630]: DEBUG nova.compute.manager [req-ba63770c-d40b-43cb-93b2-557b2bf1be9c req-ae2166a4-927d-4313-811e-acd3a82b5c25 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Refreshing instance network info cache due to event network-changed-a8c64f37-8597-4654-bf2e-3fede1dbfc44. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:36:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ba63770c-d40b-43cb-93b2-557b2bf1be9c req-ae2166a4-927d-4313-811e-acd3a82b5c25 service nova] Acquiring lock "refresh_cache-4a753e20-7c6a-471d-97c1-23514aeff398" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:36:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ba63770c-d40b-43cb-93b2-557b2bf1be9c req-ae2166a4-927d-4313-811e-acd3a82b5c25 service nova] Acquired lock "refresh_cache-4a753e20-7c6a-471d-97c1-23514aeff398" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:36:59 user nova-compute[74630]: DEBUG nova.network.neutron [req-ba63770c-d40b-43cb-93b2-557b2bf1be9c req-ae2166a4-927d-4313-811e-acd3a82b5c25 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Refreshing network info cache for port a8c64f37-8597-4654-bf2e-3fede1dbfc44 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG nova.network.neutron [req-ba63770c-d40b-43cb-93b2-557b2bf1be9c req-ae2166a4-927d-4313-811e-acd3a82b5c25 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Updated VIF entry in instance network info cache for port a8c64f37-8597-4654-bf2e-3fede1dbfc44. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG nova.network.neutron [req-ba63770c-d40b-43cb-93b2-557b2bf1be9c req-ae2166a4-927d-4313-811e-acd3a82b5c25 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Updating instance_info_cache with network_info: [{"id": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "address": "fa:16:3e:e6:ce:2f", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c64f37-85", "ovs_interfaceid": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ba63770c-d40b-43cb-93b2-557b2bf1be9c req-ae2166a4-927d-4313-811e-acd3a82b5c25 service nova] Releasing lock "refresh_cache-4a753e20-7c6a-471d-97c1-23514aeff398" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "4a753e20-7c6a-471d-97c1-23514aeff398" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "4a753e20-7c6a-471d-97c1-23514aeff398" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "4a753e20-7c6a-471d-97c1-23514aeff398-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "4a753e20-7c6a-471d-97c1-23514aeff398-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "4a753e20-7c6a-471d-97c1-23514aeff398-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:00 user nova-compute[74630]: INFO nova.compute.manager [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Terminating instance
Oct 26 03:37:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b859547c-5995-4a3b-8070-ebe98d26a4c9 req-a275b97c-e9dc-4af2-8954-57ce94a65222 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Received event network-vif-unplugged-a8c64f37-8597-4654-bf2e-3fede1dbfc44 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b859547c-5995-4a3b-8070-ebe98d26a4c9 req-a275b97c-e9dc-4af2-8954-57ce94a65222 service nova] Acquiring lock "4a753e20-7c6a-471d-97c1-23514aeff398-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b859547c-5995-4a3b-8070-ebe98d26a4c9 req-a275b97c-e9dc-4af2-8954-57ce94a65222 service nova] Lock "4a753e20-7c6a-471d-97c1-23514aeff398-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b859547c-5995-4a3b-8070-ebe98d26a4c9 req-a275b97c-e9dc-4af2-8954-57ce94a65222 service nova] Lock "4a753e20-7c6a-471d-97c1-23514aeff398-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b859547c-5995-4a3b-8070-ebe98d26a4c9 req-a275b97c-e9dc-4af2-8954-57ce94a65222 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] No waiting events found dispatching network-vif-unplugged-a8c64f37-8597-4654-bf2e-3fede1dbfc44 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-b859547c-5995-4a3b-8070-ebe98d26a4c9 req-a275b97c-e9dc-4af2-8954-57ce94a65222 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Received event network-vif-unplugged-a8c64f37-8597-4654-bf2e-3fede1dbfc44 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:00 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Instance destroyed successfully.
Oct 26 03:37:00 user nova-compute[74630]: DEBUG nova.objects.instance [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'resources' on Instance uuid 4a753e20-7c6a-471d-97c1-23514aeff398 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1960228239',display_name='tempest-AttachVolumeNegativeTest-server-1960228239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1960228239',id=33,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrTCahHw0CYNEc6LEe3NgNr+LpwaqoEf5cRWy2WP6BbuZgO2L8M1htzA1e/xL+Jvprz9NrHghNsGHsNe93K/8/ijzc8HIcC7dB4o7O0VtllibdnezryupZ34Ycv0YGKaw==',key_name='tempest-keypair-520712024',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:35:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ebfc20893da40c1b25be2444441f0c3',ramdisk_id='',reservation_id='r-z52djfiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2146381855',owner_user_name='tempest-AttachVolumeNegativeTest-2146381855-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc35b87a18e44b3392d122e392a0b8fb',uuid=4a753e20-7c6a-471d-97c1-23514aeff398,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "address": "fa:16:3e:e6:ce:2f", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c64f37-85", "ovs_interfaceid": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converting VIF {"id": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "address": "fa:16:3e:e6:ce:2f", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8c64f37-85", "ovs_interfaceid": "a8c64f37-8597-4654-bf2e-3fede1dbfc44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ce:2f,bridge_name='br-int',has_traffic_filtering=True,id=a8c64f37-8597-4654-bf2e-3fede1dbfc44,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c64f37-85') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG os_vif [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ce:2f,bridge_name='br-int',has_traffic_filtering=True,id=a8c64f37-8597-4654-bf2e-3fede1dbfc44,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c64f37-85') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8c64f37-85, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f948d241-5930-4c35-8d9e-36968b608895) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:01 user nova-compute[74630]: INFO os_vif [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ce:2f,bridge_name='br-int',has_traffic_filtering=True,id=a8c64f37-8597-4654-bf2e-3fede1dbfc44,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8c64f37-85')
Oct 26 03:37:01 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Deleting instance files /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398_del
Oct 26 03:37:01 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Deletion of /opt/stack/data/nova/instances/4a753e20-7c6a-471d-97c1-23514aeff398_del complete
Oct 26 03:37:01 user nova-compute[74630]: INFO nova.compute.manager [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:01 user nova-compute[74630]: INFO nova.compute.manager [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Unshelving
Oct 26 03:37:01 user nova-compute[74630]: INFO nova.virt.block_device [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Booting with volume 4d69e5a1-fcc9-4100-85be-6f868ccb4941 at /dev/vdc
Oct 26 03:37:01 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-b27c993e-0101-47df-9b36-0ce7192e8ffe req-0cdacd17-3c7f-4be0-b273-f1ce93644012 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Received event network-vif-deleted-a8c64f37-8597-4654-bf2e-3fede1dbfc44 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:37:01 user nova-compute[74630]: INFO nova.compute.manager [req-b27c993e-0101-47df-9b36-0ce7192e8ffe req-0cdacd17-3c7f-4be0-b273-f1ce93644012 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Neutron deleted interface a8c64f37-8597-4654-bf2e-3fede1dbfc44; detaching it from the instance and deleting it from the info cache
Oct 26 03:37:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-b27c993e-0101-47df-9b36-0ce7192e8ffe req-0cdacd17-3c7f-4be0-b273-f1ce93644012 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:37:01 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Took 0.77 seconds to deallocate network for instance.
Oct 26 03:37:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-b27c993e-0101-47df-9b36-0ce7192e8ffe req-0cdacd17-3c7f-4be0-b273-f1ce93644012 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Detach interface failed, port_id=a8c64f37-8597-4654-bf2e-3fede1dbfc44, reason: Instance 4a753e20-7c6a-471d-97c1-23514aeff398 could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG os_brick.utils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70a6c6a-8384-459b-bd9d-beab890b14e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8d4a02-f406-4e88-9c85-efb97bddd64a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9e1705-dc0e-4632-9894-c2db75c39748]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a72ea8b-d8cf-43aa-83a6-074b2ace4e99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:37:02 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:37:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae86597a-4ec4-4968-9382-937407eb65de]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG os_brick.utils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Updating existing volume attachment record: 6957e7fb-3a11-42f6-892c-f8b2e3d0ba4e {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-3ba6bfb8-144a-4c27-8257-218242e0f7e8 req-21b7d3df-b362-44c7-a235-4002c384d3d6 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Received event network-vif-plugged-a8c64f37-8597-4654-bf2e-3fede1dbfc44 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3ba6bfb8-144a-4c27-8257-218242e0f7e8 req-21b7d3df-b362-44c7-a235-4002c384d3d6 service nova] Acquiring lock "4a753e20-7c6a-471d-97c1-23514aeff398-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3ba6bfb8-144a-4c27-8257-218242e0f7e8 req-21b7d3df-b362-44c7-a235-4002c384d3d6 service nova] Lock "4a753e20-7c6a-471d-97c1-23514aeff398-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3ba6bfb8-144a-4c27-8257-218242e0f7e8 req-21b7d3df-b362-44c7-a235-4002c384d3d6 service nova] Lock "4a753e20-7c6a-471d-97c1-23514aeff398-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-3ba6bfb8-144a-4c27-8257-218242e0f7e8 req-21b7d3df-b362-44c7-a235-4002c384d3d6 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] No waiting events found dispatching network-vif-plugged-a8c64f37-8597-4654-bf2e-3fede1dbfc44 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:37:02 user nova-compute[74630]: WARNING nova.compute.manager [req-3ba6bfb8-144a-4c27-8257-218242e0f7e8 req-21b7d3df-b362-44c7-a235-4002c384d3d6 service nova] [instance: 4a753e20-7c6a-471d-97c1-23514aeff398] Received unexpected event network-vif-plugged-a8c64f37-8597-4654-bf2e-3fede1dbfc44 for instance with vm_state deleted and task_state None.
Oct 26 03:37:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.614s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:02 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Deleted allocations for instance 4a753e20-7c6a-471d-97c1-23514aeff398
Oct 26 03:37:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06d94f0-b63a-4cb5-9bbe-a85768fb069d tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "4a753e20-7c6a-471d-97c1-23514aeff398" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.569s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Starting finish_migration {{(pid=74630) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Instance directory exists: not creating {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 03:37:12 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Creating image(s)
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Ensure instance console log exists: /opt/stack/data/nova/instances/11c75096-6769-4f10-8515-c96b592958a6/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Start _get_guest_xml network_info=[{"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1431377105-network", "vif_mac": "fa:16:3e:32:fd:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncIyXWaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '11c75096-6769-4f10-8515-c96b592958a6', 'attached_at': '2023-10-26T03:37:12.000000', 'detached_at': '', 'volume_id': '1b57f591-6788-40fb-b889-6c0117ae1794', 'serial': '1b57f591-6788-40fb-b889-6c0117ae1794'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '70c19c4e-0a8d-419c-9666-8e822c933fae', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:37:12 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:37:12 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncIyXWaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:37:12 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:37:12 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:37:12 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[561de2e7-27b8-4657-945c-47c558a130aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:37:12 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3ddf53-0d46-4560-8cf4-eb576a1fc94c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794] added
Oct 26 03:37:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d750bb-a59d-4547-b97d-fe6b6d9e800b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccfa761-379d-4313-a5f1-22e8577c44b3]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ncIyXWaK {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ncIyXWaK" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[164b7046-4655-47ec-815d-97feb5cdf011]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ncIyXWaK'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[973a2e4b-a4c6-4436-863d-72417d0aa45d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[99142c66-df8b-4c6a-a3ce-a1ed1db614e8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:37:12 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:37:12 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:37:12 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:37:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:37:12 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:37:12 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:37:12 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:37:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e664ed0f-b4f4-4b13-87c9-a7a06a5d0476]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260]
Oct 26 03:37:12 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260] successful.
Oct 26 03:37:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[55757545-43e5-4715-b235-2806beb39b81]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0274a5cc-b4db-4847-9679-c8a40a0fd313]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:37:12 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:37:12 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:37:12 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:37:12 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:37:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:37:12 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:37:12 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:37:12 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:37:12 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:37:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a810ea-cbb5-4cee-9afb-333320eb0101]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncIyXWaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23832386633663836', 'path': '/dev/sdd'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832386633663836', 'path': '/dev/sdd'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:34:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1119894',display_name='tempest-ServerActionsTestOtherA-server-1119894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1119894',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwoLYfCM8lwvIIEciV36xGOUw+XalItY+5dZPbHAKn3DqpiwNygwALzSy5pOoP4seOCkowdcCG1fNBC8K731mmxBiQFtvBIY61aup2H6JCAGn52TG97PQD1ZIY1c0HtiA==',key_name='tempest-keypair-1565174322',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:35:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51542ffdf7a84ac5a61f14e124eb2087',ramdisk_id='',reservation_id='r-o5vn07pm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-41539930',owner_user_name='tempest-ServerActionsTestOtherA-41539930-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:36:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a419737713f4797ab27db62d5aa746c',uuid=11c75096-6769-4f10-8515-c96b592958a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1431377105-network", "vif_mac": "fa:16:3e:32:fd:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converting VIF {"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1431377105-network", "vif_mac": "fa:16:3e:32:fd:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:fd:96,bridge_name='br-int',has_traffic_filtering=True,id=3c4b3126-d447-40d7-821e-2395434c6d58,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4b3126-d4') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:37:13 user nova-compute[74630]:   <uuid>11c75096-6769-4f10-8515-c96b592958a6</uuid>
Oct 26 03:37:13 user nova-compute[74630]:   <name>instance-00000020</name>
Oct 26 03:37:13 user nova-compute[74630]:   <memory>2097152</memory>
Oct 26 03:37:13 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:37:13 user nova-compute[74630]:   <metadata>
Oct 26 03:37:13 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:37:13 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:37:13 user nova-compute[74630]:       <nova:name>tempest-ServerActionsTestOtherA-server-1119894</nova:name>
Oct 26 03:37:13 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:37:12</nova:creationTime>
Oct 26 03:37:13 user nova-compute[74630]:       <nova:flavor name="m1.small">
Oct 26 03:37:13 user nova-compute[74630]:         <nova:memory>2048</nova:memory>
Oct 26 03:37:13 user nova-compute[74630]:         <nova:disk>20</nova:disk>
Oct 26 03:37:13 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:37:13 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:37:13 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:37:13 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:37:13 user nova-compute[74630]:       <nova:owner>
Oct 26 03:37:13 user nova-compute[74630]:         <nova:user uuid="7a419737713f4797ab27db62d5aa746c">tempest-ServerActionsTestOtherA-41539930-project-member</nova:user>
Oct 26 03:37:13 user nova-compute[74630]:         <nova:project uuid="51542ffdf7a84ac5a61f14e124eb2087">tempest-ServerActionsTestOtherA-41539930</nova:project>
Oct 26 03:37:13 user nova-compute[74630]:       </nova:owner>
Oct 26 03:37:13 user nova-compute[74630]:       <nova:ports>
Oct 26 03:37:13 user nova-compute[74630]:         <nova:port uuid="3c4b3126-d447-40d7-821e-2395434c6d58">
Oct 26 03:37:13 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 03:37:13 user nova-compute[74630]:         </nova:port>
Oct 26 03:37:13 user nova-compute[74630]:       </nova:ports>
Oct 26 03:37:13 user nova-compute[74630]:     </nova:instance>
Oct 26 03:37:13 user nova-compute[74630]:   </metadata>
Oct 26 03:37:13 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:37:13 user nova-compute[74630]:     <system>
Oct 26 03:37:13 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:37:13 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:37:13 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:37:13 user nova-compute[74630]:       <entry name="serial">11c75096-6769-4f10-8515-c96b592958a6</entry>
Oct 26 03:37:13 user nova-compute[74630]:       <entry name="uuid">11c75096-6769-4f10-8515-c96b592958a6</entry>
Oct 26 03:37:13 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:37:13 user nova-compute[74630]:     </system>
Oct 26 03:37:13 user nova-compute[74630]:   </sysinfo>
Oct 26 03:37:13 user nova-compute[74630]:   <os>
Oct 26 03:37:13 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:37:13 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:37:13 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:37:13 user nova-compute[74630]:   </os>
Oct 26 03:37:13 user nova-compute[74630]:   <features>
Oct 26 03:37:13 user nova-compute[74630]:     <acpi/>
Oct 26 03:37:13 user nova-compute[74630]:     <apic/>
Oct 26 03:37:13 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:37:13 user nova-compute[74630]:   </features>
Oct 26 03:37:13 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:37:13 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:37:13 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:37:13 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:37:13 user nova-compute[74630]:   </clock>
Oct 26 03:37:13 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:37:13 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:37:13 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:37:13 user nova-compute[74630]:   </cpu>
Oct 26 03:37:13 user nova-compute[74630]:   <devices>
Oct 26 03:37:13 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:37:13 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:37:13 user nova-compute[74630]:       <source dev="/dev/sdd"/>
Oct 26 03:37:13 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:37:13 user nova-compute[74630]:       <serial>1b57f591-6788-40fb-b889-6c0117ae1794</serial>
Oct 26 03:37:13 user nova-compute[74630]:     </disk>
Oct 26 03:37:13 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:37:13 user nova-compute[74630]:       <mac address="fa:16:3e:32:fd:96"/>
Oct 26 03:37:13 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:37:13 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:37:13 user nova-compute[74630]:       <target dev="tap3c4b3126-d4"/>
Oct 26 03:37:13 user nova-compute[74630]:     </interface>
Oct 26 03:37:13 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:37:13 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/11c75096-6769-4f10-8515-c96b592958a6/console.log" append="off"/>
Oct 26 03:37:13 user nova-compute[74630]:     </serial>
Oct 26 03:37:13 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:37:13 user nova-compute[74630]:     <video>
Oct 26 03:37:13 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:37:13 user nova-compute[74630]:     </video>
Oct 26 03:37:13 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:37:13 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:37:13 user nova-compute[74630]:     </rng>
Oct 26 03:37:13 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:37:13 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:37:13 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:37:13 user nova-compute[74630]:     </memballoon>
Oct 26 03:37:13 user nova-compute[74630]:   </devices>
Oct 26 03:37:13 user nova-compute[74630]: </domain>
Oct 26 03:37:13 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:34:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1119894',display_name='tempest-ServerActionsTestOtherA-server-1119894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1119894',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwoLYfCM8lwvIIEciV36xGOUw+XalItY+5dZPbHAKn3DqpiwNygwALzSy5pOoP4seOCkowdcCG1fNBC8K731mmxBiQFtvBIY61aup2H6JCAGn52TG97PQD1ZIY1c0HtiA==',key_name='tempest-keypair-1565174322',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:35:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='51542ffdf7a84ac5a61f14e124eb2087',ramdisk_id='',reservation_id='r-o5vn07pm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-41539930',owner_user_name='tempest-ServerActionsTestOtherA-41539930-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:36:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a419737713f4797ab27db62d5aa746c',uuid=11c75096-6769-4f10-8515-c96b592958a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1431377105-network", "vif_mac": "fa:16:3e:32:fd:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converting VIF {"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1431377105-network", "vif_mac": "fa:16:3e:32:fd:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:fd:96,bridge_name='br-int',has_traffic_filtering=True,id=3c4b3126-d447-40d7-821e-2395434c6d58,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4b3126-d4') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG os_vif [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:fd:96,bridge_name='br-int',has_traffic_filtering=True,id=3c4b3126-d447-40d7-821e-2395434c6d58,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4b3126-d4') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3241d9c-cc30-59a9-96df-1870e4e1e308', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c4b3126-d4, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c4b3126-d4, col_values=(('qos', UUID('5e12c847-d3b7-497f-a1a8-a01224087581')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c4b3126-d4, col_values=(('external_ids', {'iface-id': '3c4b3126-d447-40d7-821e-2395434c6d58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:fd:96', 'vm-uuid': '11c75096-6769-4f10-8515-c96b592958a6'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:13 user nova-compute[74630]: INFO os_vif [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:fd:96,bridge_name='br-int',has_traffic_filtering=True,id=3c4b3126-d447-40d7-821e-2395434c6d58,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4b3126-d4')
Oct 26 03:37:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:37:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] No VIF found with MAC fa:16:3e:32:fd:96, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:37:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:15 user nova-compute[74630]: DEBUG nova.compute.manager [req-80135c83-cf75-406c-93b6-fbbb4e9689d2 req-cf9b975b-7d5b-49c3-9436-6202de51098c service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:37:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-80135c83-cf75-406c-93b6-fbbb4e9689d2 req-cf9b975b-7d5b-49c3-9436-6202de51098c service nova] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-80135c83-cf75-406c-93b6-fbbb4e9689d2 req-cf9b975b-7d5b-49c3-9436-6202de51098c service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-80135c83-cf75-406c-93b6-fbbb4e9689d2 req-cf9b975b-7d5b-49c3-9436-6202de51098c service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:15 user nova-compute[74630]: DEBUG nova.compute.manager [req-80135c83-cf75-406c-93b6-fbbb4e9689d2 req-cf9b975b-7d5b-49c3-9436-6202de51098c service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] No waiting events found dispatching network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:37:15 user nova-compute[74630]: WARNING nova.compute.manager [req-80135c83-cf75-406c-93b6-fbbb4e9689d2 req-cf9b975b-7d5b-49c3-9436-6202de51098c service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received unexpected event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 for instance with vm_state active and task_state resize_finish.
Oct 26 03:37:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:37:17 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Instance running successfully.
Oct 26 03:37:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Failed to set time: agent not configured {{(pid=74630) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 26 03:37:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-eab66ba0-a733-40c6-92cb-8ba98c69bc6b tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] finish_migration finished successfully. {{(pid=74630) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 26 03:37:17 user nova-compute[74630]: DEBUG nova.compute.manager [req-726ab38f-b61b-45f8-b503-ad3699cb1d07 req-f033fc75-1cc8-4e5e-b201-b04965769b88 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:37:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-726ab38f-b61b-45f8-b503-ad3699cb1d07 req-f033fc75-1cc8-4e5e-b201-b04965769b88 service nova] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-726ab38f-b61b-45f8-b503-ad3699cb1d07 req-f033fc75-1cc8-4e5e-b201-b04965769b88 service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-726ab38f-b61b-45f8-b503-ad3699cb1d07 req-f033fc75-1cc8-4e5e-b201-b04965769b88 service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:17 user nova-compute[74630]: DEBUG nova.compute.manager [req-726ab38f-b61b-45f8-b503-ad3699cb1d07 req-f033fc75-1cc8-4e5e-b201-b04965769b88 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] No waiting events found dispatching network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:37:17 user nova-compute[74630]: WARNING nova.compute.manager [req-726ab38f-b61b-45f8-b503-ad3699cb1d07 req-f033fc75-1cc8-4e5e-b201-b04965769b88 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received unexpected event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 for instance with vm_state active and task_state resize_finish.
Oct 26 03:37:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:23 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:37:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:37:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:26 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:37:26 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:37:26 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:37:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:28 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:37:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:28 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:37:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:37:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:37:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:37:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk.rescue --force-share --output=json" returned: 0 in 0.254s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:37:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:37:33 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:37:33 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=7289MB free_disk=24.653045654296875GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Applying migration context for instance 11c75096-6769-4f10-8515-c96b592958a6 as it has an incoming, in-progress migration 58b423b8-cd9c-4230-8052-bccb86735e68. Migration status is finished {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 03:37:33 user nova-compute[74630]: INFO nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Updating resource usage from migration 58b423b8-cd9c-4230-8052-bccb86735e68
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 73ac3b23-4f52-4107-989a-bcb38b9e0a00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 0be74854-6a07-4468-bf1c-c41066af14c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e9b77844-67a8-4c26-90f2-afc1809b33d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 1e9d2b27-a936-4548-b74a-02a64f180234 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f183da7f-ac50-4b6c-8a7b-62b14939bd5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Migration 58b423b8-cd9c-4230-8052-bccb86735e68 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 11c75096-6769-4f10-8515-c96b592958a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 0fb37042-4106-4bcc-a0fa-5e6ae614627f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:33 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:37:34 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:37:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:37:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.577s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:34 user nova-compute[74630]: DEBUG nova.objects.instance [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'pci_requests' on Instance uuid 0fb37042-4106-4bcc-a0fa-5e6ae614627f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:37:34 user nova-compute[74630]: DEBUG nova.objects.instance [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'numa_topology' on Instance uuid 0fb37042-4106-4bcc-a0fa-5e6ae614627f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:37:34 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:37:34 user nova-compute[74630]: INFO nova.compute.claims [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Claim successful on node user
Oct 26 03:37:34 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:37:34 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:37:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:34 user nova-compute[74630]: INFO nova.network.neutron [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Updating port f5f32762-6dc9-47fb-a90d-463f3be1283a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-fa1dd816-9dc1-4d48-b608-aa0218f22369" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-fa1dd816-9dc1-4d48-b608-aa0218f22369" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid fa1dd816-9dc1-4d48-b608-aa0218f22369 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquired lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG nova.network.neutron [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG nova.compute.manager [req-b6e3d4c5-694a-4a06-975c-a0181659094a req-4a12368f-ecd2-4183-b038-cd10943e1338 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received event network-changed-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG nova.compute.manager [req-b6e3d4c5-694a-4a06-975c-a0181659094a req-4a12368f-ecd2-4183-b038-cd10943e1338 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Refreshing instance network info cache due to event network-changed-f5f32762-6dc9-47fb-a90d-463f3be1283a. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b6e3d4c5-694a-4a06-975c-a0181659094a req-4a12368f-ecd2-4183-b038-cd10943e1338 service nova] Acquiring lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Updating instance_info_cache with network_info: [{"id": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "address": "fa:16:3e:27:88:e1", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8d8a99-31", "ovs_interfaceid": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-fa1dd816-9dc1-4d48-b608-aa0218f22369" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:37:35 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:37:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Updating instance_info_cache with network_info: [{"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:37:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Releasing lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:37:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:37:36 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Creating image(s)
Oct 26 03:37:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "/opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "/opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:36 user nova-compute[74630]: DEBUG nova.objects.instance [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0fb37042-4106-4bcc-a0fa-5e6ae614627f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:37:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b6e3d4c5-694a-4a06-975c-a0181659094a req-4a12368f-ecd2-4183-b038-cd10943e1338 service nova] Acquired lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:37:36 user nova-compute[74630]: DEBUG nova.network.neutron [req-b6e3d4c5-694a-4a06-975c-a0181659094a req-4a12368f-ecd2-4183-b038-cd10943e1338 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Refreshing network info cache for port f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:37:36 user nova-compute[74630]: DEBUG nova.objects.base [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Object Instance<0fb37042-4106-4bcc-a0fa-5e6ae614627f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:37:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "82b235b038d79248ea65c9000eac12454434a370" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "82b235b038d79248ea65c9000eac12454434a370" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370.part --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370.part --force-share --output=json" returned: 0 in 0.218s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:37 user nova-compute[74630]: DEBUG nova.virt.images [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] 88c3cc7d-f187-4ade-9f07-bfd3c9707106 was qcow2, converting to raw {{(pid=74630) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 03:37:37 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:37:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370.part /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370.converted {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:37 user nova-compute[74630]: DEBUG nova.network.neutron [req-b6e3d4c5-694a-4a06-975c-a0181659094a req-4a12368f-ecd2-4183-b038-cd10943e1338 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Updated VIF entry in instance network info cache for port f5f32762-6dc9-47fb-a90d-463f3be1283a. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:37:37 user nova-compute[74630]: DEBUG nova.network.neutron [req-b6e3d4c5-694a-4a06-975c-a0181659094a req-4a12368f-ecd2-4183-b038-cd10943e1338 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Updating instance_info_cache with network_info: [{"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:37:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b6e3d4c5-694a-4a06-975c-a0181659094a req-4a12368f-ecd2-4183-b038-cd10943e1338 service nova] Releasing lock "refresh_cache-0fb37042-4106-4bcc-a0fa-5e6ae614627f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:37:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370.part /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370.converted" returned: 0 in 0.313s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370.converted --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "82b235b038d79248ea65c9000eac12454434a370" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.832s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370 --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370 --force-share --output=json" returned: 0 in 0.198s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "82b235b038d79248ea65c9000eac12454434a370" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "82b235b038d79248ea65c9000eac12454434a370" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370 --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370 --force-share --output=json" returned: 0 in 0.229s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370,backing_fmt=raw /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370,backing_fmt=raw /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk 1073741824" returned: 0 in 0.202s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "82b235b038d79248ea65c9000eac12454434a370" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.437s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370 --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370 --force-share --output=json" returned: 0 in 0.237s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG nova.objects.instance [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'migration_context' on Instance uuid 0fb37042-4106-4bcc-a0fa-5e6ae614627f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:37:38 user nova-compute[74630]: DEBUG nova.objects.base [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Object Instance<0fb37042-4106-4bcc-a0fa-5e6ae614627f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:37:38 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Rebasing disk image.
Oct 26 03:37:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.178s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b -F raw /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b -F raw /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk" returned: 0 in 2.700s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Ensure instance console log exists: /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Start _get_guest_xml network_info=[{"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='8e1f103746c4ea669a5ed5bd094534e8',container_format='bare',created_at=2023-10-26T03:35:09Z,direct_url=<?>,disk_format='qcow2',id=88c3cc7d-f187-4ade-9f07-bfd3c9707106,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1496039535-shelved',owner='f44335320f77434999514ed6824a2e23',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T03:35:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wINEBGXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '0fb37042-4106-4bcc-a0fa-5e6ae614627f', 'attached_at': '', 'detached_at': '', 'volume_id': '4d69e5a1-fcc9-4100-85be-6f868ccb4941', 'serial': '4d69e5a1-fcc9-4100-85be-6f868ccb4941'}, 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '6957e7fb-3a11-42f6-892c-f8b2e3d0ba4e', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:37:41 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:37:41 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8e1f103746c4ea669a5ed5bd094534e8',container_format='bare',created_at=2023-10-26T03:35:09Z,direct_url=<?>,disk_format='qcow2',id=88c3cc7d-f187-4ade-9f07-bfd3c9707106,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1496039535-shelved',owner='f44335320f77434999514ed6824a2e23',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T03:35:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.objects.instance [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0fb37042-4106-4bcc-a0fa-5e6ae614627f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:37:41 user nova-compute[74630]: DEBUG nova.objects.base [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Object Instance<0fb37042-4106-4bcc-a0fa-5e6ae614627f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wINEBGXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:37:42 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:37:42 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:37:42 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260" returned: 21 in 0.056s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82320c9-6f4e-476f-92be-15357e5ff036]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:37:42 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c1fe48-cd87-46a2-8148-79d3bf3f238a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941] added
Oct 26 03:37:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c71512-8095-4df1-a27b-b6db83b9d82e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c289ed5-9205-4ddf-bea9-6b9d6b97a03d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wINEBGXH {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wINEBGXH" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4804d8-e6e9-4814-a6ef-7ce9a273befd]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wINEBGXH'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[050f8395-e627-4b6a-bfd8-9970036896f9]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c361d7-0be9-402b-94e6-adc05ebe69ab]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[add306f7-1e32-41bb-a61c-79c7907d6a76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941, portal: 172.16.0.220,3260]
Oct 26 03:37:42 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941, portal: 172.16.0.220,3260] successful.
Oct 26 03:37:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c277a418-c74f-439f-b875-794d433250ed]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[164b72ba-a835-46fe-9b94-f902ea34fd4e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:37:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e767c9-2f5a-4941-8651-5dc5ae3d4cc2]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:37:42 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wINEBGXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23830356435353238', 'path': '/dev/sdf'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830356435353238', 'path': '/dev/sdf'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T03:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1496039535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1496039535',id=31,image_ref='88c3cc7d-f187-4ade-9f07-bfd3c9707106',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1898419039',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f44335320f77434999514ed6824a2e23',ramdisk_id='',reservation_id='r-xzpbz7ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1268856411',owner_user_name='tempest-AttachVolumeShelveTestJSON-1268856411-project-member',shelved_at='2023-10-26T03:35:13.830209',shelved_host='user',shelved_image_id='88c3cc7d-f187-4ade-9f07-bfd3c9707106'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f51acc12a54e7bbd38e975f2d7632e',uuid=0fb37042-4106-4bcc-a0fa-5e6ae614627f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converting VIF {"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b2:b3,bridge_name='br-int',has_traffic_filtering=True,id=f5f32762-6dc9-47fb-a90d-463f3be1283a,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f32762-6d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG nova.objects.instance [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fb37042-4106-4bcc-a0fa-5e6ae614627f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG nova.objects.base [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Object Instance<0fb37042-4106-4bcc-a0fa-5e6ae614627f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:37:43 user nova-compute[74630]:   <uuid>0fb37042-4106-4bcc-a0fa-5e6ae614627f</uuid>
Oct 26 03:37:43 user nova-compute[74630]:   <name>instance-0000001f</name>
Oct 26 03:37:43 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:37:43 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:37:43 user nova-compute[74630]:   <metadata>
Oct 26 03:37:43 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:37:43 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:37:43 user nova-compute[74630]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1496039535</nova:name>
Oct 26 03:37:43 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:37:41</nova:creationTime>
Oct 26 03:37:43 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:37:43 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:37:43 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:37:43 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:37:43 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:37:43 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:37:43 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:37:43 user nova-compute[74630]:       <nova:owner>
Oct 26 03:37:43 user nova-compute[74630]:         <nova:user uuid="89f51acc12a54e7bbd38e975f2d7632e">tempest-AttachVolumeShelveTestJSON-1268856411-project-member</nova:user>
Oct 26 03:37:43 user nova-compute[74630]:         <nova:project uuid="f44335320f77434999514ed6824a2e23">tempest-AttachVolumeShelveTestJSON-1268856411</nova:project>
Oct 26 03:37:43 user nova-compute[74630]:       </nova:owner>
Oct 26 03:37:43 user nova-compute[74630]:       <nova:root type="image" uuid="88c3cc7d-f187-4ade-9f07-bfd3c9707106"/>
Oct 26 03:37:43 user nova-compute[74630]:       <nova:ports>
Oct 26 03:37:43 user nova-compute[74630]:         <nova:port uuid="f5f32762-6dc9-47fb-a90d-463f3be1283a">
Oct 26 03:37:43 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 03:37:43 user nova-compute[74630]:         </nova:port>
Oct 26 03:37:43 user nova-compute[74630]:       </nova:ports>
Oct 26 03:37:43 user nova-compute[74630]:     </nova:instance>
Oct 26 03:37:43 user nova-compute[74630]:   </metadata>
Oct 26 03:37:43 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:37:43 user nova-compute[74630]:     <system>
Oct 26 03:37:43 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:37:43 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:37:43 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:37:43 user nova-compute[74630]:       <entry name="serial">0fb37042-4106-4bcc-a0fa-5e6ae614627f</entry>
Oct 26 03:37:43 user nova-compute[74630]:       <entry name="uuid">0fb37042-4106-4bcc-a0fa-5e6ae614627f</entry>
Oct 26 03:37:43 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:37:43 user nova-compute[74630]:     </system>
Oct 26 03:37:43 user nova-compute[74630]:   </sysinfo>
Oct 26 03:37:43 user nova-compute[74630]:   <os>
Oct 26 03:37:43 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:37:43 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:37:43 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:37:43 user nova-compute[74630]:   </os>
Oct 26 03:37:43 user nova-compute[74630]:   <features>
Oct 26 03:37:43 user nova-compute[74630]:     <acpi/>
Oct 26 03:37:43 user nova-compute[74630]:     <apic/>
Oct 26 03:37:43 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:37:43 user nova-compute[74630]:   </features>
Oct 26 03:37:43 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:37:43 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:37:43 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:37:43 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:37:43 user nova-compute[74630]:   </clock>
Oct 26 03:37:43 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:37:43 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:37:43 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:37:43 user nova-compute[74630]:   </cpu>
Oct 26 03:37:43 user nova-compute[74630]:   <devices>
Oct 26 03:37:43 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:37:43 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:37:43 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk"/>
Oct 26 03:37:43 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:37:43 user nova-compute[74630]:     </disk>
Oct 26 03:37:43 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:37:43 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:37:43 user nova-compute[74630]:       <source dev="/dev/sdf"/>
Oct 26 03:37:43 user nova-compute[74630]:       <target dev="vdc" bus="virtio"/>
Oct 26 03:37:43 user nova-compute[74630]:       <serial>4d69e5a1-fcc9-4100-85be-6f868ccb4941</serial>
Oct 26 03:37:43 user nova-compute[74630]:     </disk>
Oct 26 03:37:43 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:37:43 user nova-compute[74630]:       <mac address="fa:16:3e:5d:b2:b3"/>
Oct 26 03:37:43 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:37:43 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:37:43 user nova-compute[74630]:       <target dev="tapf5f32762-6d"/>
Oct 26 03:37:43 user nova-compute[74630]:     </interface>
Oct 26 03:37:43 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:37:43 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/console.log" append="off"/>
Oct 26 03:37:43 user nova-compute[74630]:     </serial>
Oct 26 03:37:43 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:37:43 user nova-compute[74630]:     <video>
Oct 26 03:37:43 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:37:43 user nova-compute[74630]:     </video>
Oct 26 03:37:43 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:37:43 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:37:43 user nova-compute[74630]:     </rng>
Oct 26 03:37:43 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:37:43 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:37:43 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:37:43 user nova-compute[74630]:     </memballoon>
Oct 26 03:37:43 user nova-compute[74630]:   </devices>
Oct 26 03:37:43 user nova-compute[74630]: </domain>
Oct 26 03:37:43 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T03:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1496039535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1496039535',id=31,image_ref='88c3cc7d-f187-4ade-9f07-bfd3c9707106',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1898419039',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f44335320f77434999514ed6824a2e23',ramdisk_id='',reservation_id='r-xzpbz7ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1268856411',owner_user_name='tempest-AttachVolumeShelveTestJSON-1268856411-project-member',shelved_at='2023-10-26T03:35:13.830209',shelved_host='user',shelved_image_id='88c3cc7d-f187-4ade-9f07-bfd3c9707106'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f51acc12a54e7bbd38e975f2d7632e',uuid=0fb37042-4106-4bcc-a0fa-5e6ae614627f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converting VIF {"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b2:b3,bridge_name='br-int',has_traffic_filtering=True,id=f5f32762-6dc9-47fb-a90d-463f3be1283a,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f32762-6d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG os_vif [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b2:b3,bridge_name='br-int',has_traffic_filtering=True,id=f5f32762-6dc9-47fb-a90d-463f3be1283a,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f32762-6d') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60c38312-4586-5d75-ac26-3fa8538b65eb', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5f32762-6d, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5f32762-6d, col_values=(('qos', UUID('6a2dd70b-75c7-4d95-bad3-c316b8e7b356')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5f32762-6d, col_values=(('external_ids', {'iface-id': 'f5f32762-6dc9-47fb-a90d-463f3be1283a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:b2:b3', 'vm-uuid': '0fb37042-4106-4bcc-a0fa-5e6ae614627f'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:43 user nova-compute[74630]: INFO os_vif [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b2:b3,bridge_name='br-int',has_traffic_filtering=True,id=f5f32762-6dc9-47fb-a90d-463f3be1283a,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f32762-6d')
Oct 26 03:37:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] No VIF found with MAC fa:16:3e:5d:b2:b3, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:37:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.006s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:45 user nova-compute[74630]: INFO nova.compute.manager [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Terminating instance
Oct 26 03:37:45 user nova-compute[74630]: DEBUG nova.compute.manager [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-6a0a4e0f-8c6c-43d5-9ad7-cd1acb41d0a9 req-24866c6e-1c76-443c-abee-f6db53412a1c service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received event network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6a0a4e0f-8c6c-43d5-9ad7-cd1acb41d0a9 req-24866c6e-1c76-443c-abee-f6db53412a1c service nova] Acquiring lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6a0a4e0f-8c6c-43d5-9ad7-cd1acb41d0a9 req-24866c6e-1c76-443c-abee-f6db53412a1c service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6a0a4e0f-8c6c-43d5-9ad7-cd1acb41d0a9 req-24866c6e-1c76-443c-abee-f6db53412a1c service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-6a0a4e0f-8c6c-43d5-9ad7-cd1acb41d0a9 req-24866c6e-1c76-443c-abee-f6db53412a1c service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] No waiting events found dispatching network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:37:45 user nova-compute[74630]: WARNING nova.compute.manager [req-6a0a4e0f-8c6c-43d5-9ad7-cd1acb41d0a9 req-24866c6e-1c76-443c-abee-f6db53412a1c service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received unexpected event network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 03:37:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-9d1b3e59-2f9a-4a29-a4de-c62b6cf52fc3 req-e3401a08-28e3-44f1-b74f-b7a53365391d service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received event network-vif-unplugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9d1b3e59-2f9a-4a29-a4de-c62b6cf52fc3 req-e3401a08-28e3-44f1-b74f-b7a53365391d service nova] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9d1b3e59-2f9a-4a29-a4de-c62b6cf52fc3 req-e3401a08-28e3-44f1-b74f-b7a53365391d service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9d1b3e59-2f9a-4a29-a4de-c62b6cf52fc3 req-e3401a08-28e3-44f1-b74f-b7a53365391d service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-9d1b3e59-2f9a-4a29-a4de-c62b6cf52fc3 req-e3401a08-28e3-44f1-b74f-b7a53365391d service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] No waiting events found dispatching network-vif-unplugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-9d1b3e59-2f9a-4a29-a4de-c62b6cf52fc3 req-e3401a08-28e3-44f1-b74f-b7a53365391d service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received event network-vif-unplugged-853efb6c-3553-4889-a1fb-b0ede74757b7 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:46 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Instance destroyed successfully.
Oct 26 03:37:46 user nova-compute[74630]: DEBUG nova.objects.instance [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'resources' on Instance uuid 7918e3bc-c44b-4be3-871d-e06eb3fd7d49 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2056490985',display_name='tempest-ServerRescueNegativeTestJSON-server-2056490985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2056490985',id=6,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b652c6f02780451b89d51d74178bf6c7',ramdisk_id='',reservation_id='r-sn0sgqx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2117587238',owner_user_name='tempest-ServerRescueNegativeTestJSON-2117587238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:22:18Z,user_data=None,user_id='62370747d10a420b81009d23e3ba324b',uuid=7918e3bc-c44b-4be3-871d-e06eb3fd7d49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converting VIF {"id": "853efb6c-3553-4889-a1fb-b0ede74757b7", "address": "fa:16:3e:77:0d:44", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853efb6c-35", "ovs_interfaceid": "853efb6c-3553-4889-a1fb-b0ede74757b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:0d:44,bridge_name='br-int',has_traffic_filtering=True,id=853efb6c-3553-4889-a1fb-b0ede74757b7,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853efb6c-35') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG os_vif [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:0d:44,bridge_name='br-int',has_traffic_filtering=True,id=853efb6c-3553-4889-a1fb-b0ede74757b7,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853efb6c-35') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap853efb6c-35, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72854234-4285-46db-9b0b-9319b22261a0) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:46 user nova-compute[74630]: INFO os_vif [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:0d:44,bridge_name='br-int',has_traffic_filtering=True,id=853efb6c-3553-4889-a1fb-b0ede74757b7,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853efb6c-35')
Oct 26 03:37:46 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Deleting instance files /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49_del
Oct 26 03:37:46 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Deletion of /opt/stack/data/nova/instances/7918e3bc-c44b-4be3-871d-e06eb3fd7d49_del complete
Oct 26 03:37:46 user nova-compute[74630]: INFO nova.compute.manager [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 26 03:37:46 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:46 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:37:46 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Took 0.68 seconds to deallocate network for instance.
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:47 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Deleted allocations for instance 7918e3bc-c44b-4be3-871d-e06eb3fd7d49
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-a0db2cbf-4125-4525-b8d4-eb986aad28eb req-43cbd3e9-af1b-4c75-8d2b-813bcdb74d7b service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received event network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a0db2cbf-4125-4525-b8d4-eb986aad28eb req-43cbd3e9-af1b-4c75-8d2b-813bcdb74d7b service nova] Acquiring lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a0db2cbf-4125-4525-b8d4-eb986aad28eb req-43cbd3e9-af1b-4c75-8d2b-813bcdb74d7b service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a0db2cbf-4125-4525-b8d4-eb986aad28eb req-43cbd3e9-af1b-4c75-8d2b-813bcdb74d7b service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-a0db2cbf-4125-4525-b8d4-eb986aad28eb req-43cbd3e9-af1b-4c75-8d2b-813bcdb74d7b service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] No waiting events found dispatching network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:37:47 user nova-compute[74630]: WARNING nova.compute.manager [req-a0db2cbf-4125-4525-b8d4-eb986aad28eb req-43cbd3e9-af1b-4c75-8d2b-813bcdb74d7b service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received unexpected event network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-a0db2cbf-4125-4525-b8d4-eb986aad28eb req-43cbd3e9-af1b-4c75-8d2b-813bcdb74d7b service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received event network-vif-deleted-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-956dd953-ef35-4e99-ac6a-5e58c8fa8e7e tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.451s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] No waiting events found dispatching network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:37:47 user nova-compute[74630]: WARNING nova.compute.manager [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received unexpected event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 for instance with vm_state deleted and task_state None.
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] No waiting events found dispatching network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:37:47 user nova-compute[74630]: WARNING nova.compute.manager [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received unexpected event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 for instance with vm_state deleted and task_state None.
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] No waiting events found dispatching network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:37:47 user nova-compute[74630]: WARNING nova.compute.manager [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received unexpected event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 for instance with vm_state deleted and task_state None.
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received event network-vif-unplugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] No waiting events found dispatching network-vif-unplugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:37:47 user nova-compute[74630]: WARNING nova.compute.manager [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received unexpected event network-vif-unplugged-853efb6c-3553-4889-a1fb-b0ede74757b7 for instance with vm_state deleted and task_state None.
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] Acquiring lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] Lock "7918e3bc-c44b-4be3-871d-e06eb3fd7d49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] No waiting events found dispatching network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:37:47 user nova-compute[74630]: WARNING nova.compute.manager [req-b8a1f361-4fa5-4c4e-beb1-c2842f18f450 req-b980a305-1f6f-4663-90fd-0f59146d7c14 service nova] [instance: 7918e3bc-c44b-4be3-871d-e06eb3fd7d49] Received unexpected event network-vif-plugged-853efb6c-3553-4889-a1fb-b0ede74757b7 for instance with vm_state deleted and task_state None.
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.compute.manager [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:37:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:37:47 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Instance spawned successfully.
Oct 26 03:37:48 user nova-compute[74630]: DEBUG nova.compute.manager [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:37:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-42098cc1-9332-42e3-99dc-3f36a9b12dd1 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 46.759s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:37:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:37:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "1e9d2b27-a936-4548-b74a-02a64f180234" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:37:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "1e9d2b27-a936-4548-b74a-02a64f180234" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:37:51 user nova-compute[74630]: INFO nova.compute.manager [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Detaching volume ebf9bd14-fef2-469a-a7c4-57ba638131e8
Oct 26 03:37:51 user nova-compute[74630]: INFO nova.virt.block_device [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Attempting to driver detach volume ebf9bd14-fef2-469a-a7c4-57ba638131e8 from mountpoint /dev/vdb
Oct 26 03:37:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Attempting to detach device vdb from instance 1e9d2b27-a936-4548-b74a-02a64f180234 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:37:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:37:51 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:37:51 user nova-compute[74630]:   <source dev="/dev/sdh"/>
Oct 26 03:37:51 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:37:51 user nova-compute[74630]:   <serial>ebf9bd14-fef2-469a-a7c4-57ba638131e8</serial>
Oct 26 03:37:51 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:37:51 user nova-compute[74630]: </disk>
Oct 26 03:37:51 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:37:51 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Successfully detached device vdb from instance 1e9d2b27-a936-4548-b74a-02a64f180234 from the persistent domain config.
Oct 26 03:37:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e9d2b27-a936-4548-b74a-02a64f180234 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:37:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:37:51 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:37:51 user nova-compute[74630]:   <source dev="/dev/sdh"/>
Oct 26 03:37:51 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:37:51 user nova-compute[74630]:   <serial>ebf9bd14-fef2-469a-a7c4-57ba638131e8</serial>
Oct 26 03:37:51 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:37:51 user nova-compute[74630]: </disk>
Oct 26 03:37:51 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:37:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e9d2b27-a936-4548-b74a-02a64f180234 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:37:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:37:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:37:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:37:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:37:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:37:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:38:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:08 user nova-compute[74630]: INFO nova.compute.manager [None req-1925fde2-e3b0-49ec-8823-9870f14d194e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Unrescuing
Oct 26 03:38:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1925fde2-e3b0-49ec-8823-9870f14d194e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:38:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1925fde2-e3b0-49ec-8823-9870f14d194e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquired lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:38:08 user nova-compute[74630]: DEBUG nova.network.neutron [None req-1925fde2-e3b0-49ec-8823-9870f14d194e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:38:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG nova.network.neutron [None req-1925fde2-e3b0-49ec-8823-9870f14d194e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Updating instance_info_cache with network_info: [{"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1925fde2-e3b0-49ec-8823-9870f14d194e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Releasing lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG nova.objects.instance [None req-1925fde2-e3b0-49ec-8823-9870f14d194e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lazy-loading 'flavor' on Instance uuid 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-148eb3ea-cbf9-460f-928c-8f9fdbf8f081 req-64b07532-a82b-47df-bbb3-3f55e71829ee service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-vif-unplugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-148eb3ea-cbf9-460f-928c-8f9fdbf8f081 req-64b07532-a82b-47df-bbb3-3f55e71829ee service nova] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-148eb3ea-cbf9-460f-928c-8f9fdbf8f081 req-64b07532-a82b-47df-bbb3-3f55e71829ee service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-148eb3ea-cbf9-460f-928c-8f9fdbf8f081 req-64b07532-a82b-47df-bbb3-3f55e71829ee service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-148eb3ea-cbf9-460f-928c-8f9fdbf8f081 req-64b07532-a82b-47df-bbb3-3f55e71829ee service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] No waiting events found dispatching network-vif-unplugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:38:09 user nova-compute[74630]: WARNING nova.compute.manager [req-148eb3ea-cbf9-460f-928c-8f9fdbf8f081 req-64b07532-a82b-47df-bbb3-3f55e71829ee service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received unexpected event network-vif-unplugged-02a0e249-0a94-475c-9754-2834697559c2 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:38:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-e187ca48-d90f-4a86-a5d9-fc42cabd4eb2 req-2e7b6ea2-5cf3-4732-9380-d7b561eecc1e service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-changed-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-e187ca48-d90f-4a86-a5d9-fc42cabd4eb2 req-2e7b6ea2-5cf3-4732-9380-d7b561eecc1e service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Refreshing instance network info cache due to event network-changed-02a0e249-0a94-475c-9754-2834697559c2. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e187ca48-d90f-4a86-a5d9-fc42cabd4eb2 req-2e7b6ea2-5cf3-4732-9380-d7b561eecc1e service nova] Acquiring lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e187ca48-d90f-4a86-a5d9-fc42cabd4eb2 req-2e7b6ea2-5cf3-4732-9380-d7b561eecc1e service nova] Acquired lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:38:09 user nova-compute[74630]: DEBUG nova.network.neutron [req-e187ca48-d90f-4a86-a5d9-fc42cabd4eb2 req-2e7b6ea2-5cf3-4732-9380-d7b561eecc1e service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Refreshing network info cache for port 02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:38:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Instance destroyed successfully.
Oct 26 03:38:10 user nova-compute[74630]: DEBUG nova.network.neutron [req-e187ca48-d90f-4a86-a5d9-fc42cabd4eb2 req-2e7b6ea2-5cf3-4732-9380-d7b561eecc1e service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Updated VIF entry in instance network info cache for port 02a0e249-0a94-475c-9754-2834697559c2. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:38:10 user nova-compute[74630]: DEBUG nova.network.neutron [req-e187ca48-d90f-4a86-a5d9-fc42cabd4eb2 req-2e7b6ea2-5cf3-4732-9380-d7b561eecc1e service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Updating instance_info_cache with network_info: [{"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:38:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e187ca48-d90f-4a86-a5d9-fc42cabd4eb2 req-2e7b6ea2-5cf3-4732-9380-d7b561eecc1e service nova] Releasing lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-baf53b52-b9a5-4fbb-aeba-1de406215c26 req-8ac9d5cd-481a-43e0-82b2-b158ff8f76aa service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-baf53b52-b9a5-4fbb-aeba-1de406215c26 req-8ac9d5cd-481a-43e0-82b2-b158ff8f76aa service nova] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-baf53b52-b9a5-4fbb-aeba-1de406215c26 req-8ac9d5cd-481a-43e0-82b2-b158ff8f76aa service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-baf53b52-b9a5-4fbb-aeba-1de406215c26 req-8ac9d5cd-481a-43e0-82b2-b158ff8f76aa service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-baf53b52-b9a5-4fbb-aeba-1de406215c26 req-8ac9d5cd-481a-43e0-82b2-b158ff8f76aa service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] No waiting events found dispatching network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:38:11 user nova-compute[74630]: WARNING nova.compute.manager [req-baf53b52-b9a5-4fbb-aeba-1de406215c26 req-8ac9d5cd-481a-43e0-82b2-b158ff8f76aa service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received unexpected event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:38:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-826cb7be-a540-4cf2-b7f1-926bb97b256d req-3f5a281b-08a8-44c1-bbb2-56d830ea29fe service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-changed-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-826cb7be-a540-4cf2-b7f1-926bb97b256d req-3f5a281b-08a8-44c1-bbb2-56d830ea29fe service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Refreshing instance network info cache due to event network-changed-02a0e249-0a94-475c-9754-2834697559c2. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-826cb7be-a540-4cf2-b7f1-926bb97b256d req-3f5a281b-08a8-44c1-bbb2-56d830ea29fe service nova] Acquiring lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-826cb7be-a540-4cf2-b7f1-926bb97b256d req-3f5a281b-08a8-44c1-bbb2-56d830ea29fe service nova] Acquired lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG nova.network.neutron [req-826cb7be-a540-4cf2-b7f1-926bb97b256d req-3f5a281b-08a8-44c1-bbb2-56d830ea29fe service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Refreshing network info cache for port 02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG nova.network.neutron [req-826cb7be-a540-4cf2-b7f1-926bb97b256d req-3f5a281b-08a8-44c1-bbb2-56d830ea29fe service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Updated VIF entry in instance network info cache for port 02a0e249-0a94-475c-9754-2834697559c2. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG nova.network.neutron [req-826cb7be-a540-4cf2-b7f1-926bb97b256d req-3f5a281b-08a8-44c1-bbb2-56d830ea29fe service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Updating instance_info_cache with network_info: [{"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-826cb7be-a540-4cf2-b7f1-926bb97b256d req-3f5a281b-08a8-44c1-bbb2-56d830ea29fe service nova] Releasing lock "refresh_cache-6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:38:12 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1e9d2b27-a936-4548-b74a-02a64f180234 is timed out.
Oct 26 03:38:12 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Successfully detached device vdb from instance 1e9d2b27-a936-4548-b74a-02a64f180234 from the live domain config.
Oct 26 03:38:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TndOBfzc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:38:12 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbb0d05-32d2-49a9-aeb8-cc8bea7aadd5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:38:12 user nova-compute[74630]: No targets found.
Oct 26 03:38:12 user nova-compute[74630]: iSNS:
Oct 26 03:38:12 user nova-compute[74630]: No targets found.
Oct 26 03:38:12 user nova-compute[74630]: STATIC:
Oct 26 03:38:12 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:38:12 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:38:12 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:38:12 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0
Oct 26 03:38:12 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:38:12 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:38:12 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941
Oct 26 03:38:12 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:38:12 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:38:12 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794
Oct 26 03:38:12 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:38:12 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:38:12 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4
Oct 26 03:38:12 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:38:12 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:38:12 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8
Oct 26 03:38:12 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:38:12 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:38:12 user nova-compute[74630]: FIRMWARE:
Oct 26 03:38:12 user nova-compute[74630]: No targets found.
Oct 26 03:38:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:38:12 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:38:12 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5ec0e5-bd5f-426c-9013-db412695861a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2995eb-08a4-4590-9b92-04eceb1eae43]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:38:12 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:38:12 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:38:12 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:38:12 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:38:12 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:38:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:38:12 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:38:12 user nova-compute[74630]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 (non-flash)
Oct 26 03:38:12 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:38:12 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:38:12 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:38:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c6651b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8'): ({'sdh'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Removing single pathed devices sdh {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96b0cc2-8119-4be2-8cbf-73f6be205e24]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2862d2-423b-4222-a442-f6016ab858b3]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Flushing IO for device /dev/sdh {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed534ed-9f9c-4caf-9c68-b39f9d14547e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1db74c-c0c9-4670-a209-78d4b660b5f4]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] SCSI volumes sdh have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ac64be-ed78-465e-9d8e-c227e14fae7b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[579e33d3-5375-4f60-ba5e-e6f7ffaf818d]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8, portal: 172.16.0.220,3260]
Oct 26 03:38:12 user nova-compute[74630]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8, portal: 172.16.0.220,3260] successful.
Oct 26 03:38:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf9bd14-fef2-469a-a7c4-57ba638131e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[778b8e4b-2b82-47d0-b9c2-32e9a419f8f8]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] <== disconnect_volume: return (366ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:38:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:38:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-38aaa570-f7b1-4640-8282-6bd1b08969d0 req-785b9698-ea78-4f34-8fe2-68ac79546630 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-38aaa570-f7b1-4640-8282-6bd1b08969d0 req-785b9698-ea78-4f34-8fe2-68ac79546630 service nova] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-38aaa570-f7b1-4640-8282-6bd1b08969d0 req-785b9698-ea78-4f34-8fe2-68ac79546630 service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-38aaa570-f7b1-4640-8282-6bd1b08969d0 req-785b9698-ea78-4f34-8fe2-68ac79546630 service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-38aaa570-f7b1-4640-8282-6bd1b08969d0 req-785b9698-ea78-4f34-8fe2-68ac79546630 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] No waiting events found dispatching network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:38:13 user nova-compute[74630]: WARNING nova.compute.manager [req-38aaa570-f7b1-4640-8282-6bd1b08969d0 req-785b9698-ea78-4f34-8fe2-68ac79546630 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received unexpected event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:38:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-38aaa570-f7b1-4640-8282-6bd1b08969d0 req-785b9698-ea78-4f34-8fe2-68ac79546630 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-38aaa570-f7b1-4640-8282-6bd1b08969d0 req-785b9698-ea78-4f34-8fe2-68ac79546630 service nova] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-38aaa570-f7b1-4640-8282-6bd1b08969d0 req-785b9698-ea78-4f34-8fe2-68ac79546630 service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-38aaa570-f7b1-4640-8282-6bd1b08969d0 req-785b9698-ea78-4f34-8fe2-68ac79546630 service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-38aaa570-f7b1-4640-8282-6bd1b08969d0 req-785b9698-ea78-4f34-8fe2-68ac79546630 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] No waiting events found dispatching network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:38:13 user nova-compute[74630]: WARNING nova.compute.manager [req-38aaa570-f7b1-4640-8282-6bd1b08969d0 req-785b9698-ea78-4f34-8fe2-68ac79546630 service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received unexpected event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 for instance with vm_state rescued and task_state unrescuing.
Oct 26 03:38:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'flavor' on Instance uuid 1e9d2b27-a936-4548-b74a-02a64f180234 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:38:13 user nova-compute[74630]: DEBUG nova.compute.manager [None req-1925fde2-e3b0-49ec-8823-9870f14d194e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:38:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-0dfc6409-705e-4ff2-b980-37ae328e38d1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "1e9d2b27-a936-4548-b74a-02a64f180234" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.921s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG nova.compute.manager [req-c202d343-ddb6-413f-befb-1fc8f8d4e7e5 req-a6a4e46b-f1ab-40f9-af7b-c334f96f09bd service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Received event network-changed-8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG nova.compute.manager [req-c202d343-ddb6-413f-befb-1fc8f8d4e7e5 req-a6a4e46b-f1ab-40f9-af7b-c334f96f09bd service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Refreshing instance network info cache due to event network-changed-8524a132-6deb-46af-9f8d-910a6e7340b0. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c202d343-ddb6-413f-befb-1fc8f8d4e7e5 req-a6a4e46b-f1ab-40f9-af7b-c334f96f09bd service nova] Acquiring lock "refresh_cache-f183da7f-ac50-4b6c-8a7b-62b14939bd5e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c202d343-ddb6-413f-befb-1fc8f8d4e7e5 req-a6a4e46b-f1ab-40f9-af7b-c334f96f09bd service nova] Acquired lock "refresh_cache-f183da7f-ac50-4b6c-8a7b-62b14939bd5e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG nova.network.neutron [req-c202d343-ddb6-413f-befb-1fc8f8d4e7e5 req-a6a4e46b-f1ab-40f9-af7b-c334f96f09bd service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Refreshing network info cache for port 8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG nova.network.neutron [req-c202d343-ddb6-413f-befb-1fc8f8d4e7e5 req-a6a4e46b-f1ab-40f9-af7b-c334f96f09bd service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Updated VIF entry in instance network info cache for port 8524a132-6deb-46af-9f8d-910a6e7340b0. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG nova.network.neutron [req-c202d343-ddb6-413f-befb-1fc8f8d4e7e5 req-a6a4e46b-f1ab-40f9-af7b-c334f96f09bd service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Updating instance_info_cache with network_info: [{"id": "8524a132-6deb-46af-9f8d-910a6e7340b0", "address": "fa:16:3e:3c:00:72", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8524a132-6d", "ovs_interfaceid": "8524a132-6deb-46af-9f8d-910a6e7340b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lazy-loading 'flavor' on Instance uuid f183da7f-ac50-4b6c-8a7b-62b14939bd5e {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c202d343-ddb6-413f-befb-1fc8f8d4e7e5 req-a6a4e46b-f1ab-40f9-af7b-c334f96f09bd service nova] Releasing lock "refresh_cache-f183da7f-ac50-4b6c-8a7b-62b14939bd5e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:14 user nova-compute[74630]: INFO nova.compute.manager [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Attaching volume ab37bb5c-5d91-451a-b8e8-d36f9778ba17 to /dev/vdb
Oct 26 03:38:14 user nova-compute[74630]: DEBUG os_brick.utils [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ac58cc-f46f-4ddf-b56d-8b1701961dae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69bb1c6-d0a4-4ae6-8688-d59a1f8f359a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[168c93e0-443c-4b09-bd39-981fcca18626]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[38abba33-7668-4936-a5a2-f30666abff94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:38:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:38:15 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:38:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b28037-cb67-4474-8c22-92e7299c53bf]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:38:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:38:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:38:15 user nova-compute[74630]: DEBUG os_brick.utils [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:38:15 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Updating existing volume attachment record: 2b958180-8456-4144-b2b0-e8e1cb87f151 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:38:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "0be74854-6a07-4468-bf1c-c41066af14c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:19 user nova-compute[74630]: INFO nova.compute.manager [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Terminating instance
Oct 26 03:38:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-56516fba-c882-4093-98c6-3785be6e8d95 req-d4b6f6df-44c8-4658-87eb-995322322a96 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received event network-vif-unplugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-56516fba-c882-4093-98c6-3785be6e8d95 req-d4b6f6df-44c8-4658-87eb-995322322a96 service nova] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-56516fba-c882-4093-98c6-3785be6e8d95 req-d4b6f6df-44c8-4658-87eb-995322322a96 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-56516fba-c882-4093-98c6-3785be6e8d95 req-d4b6f6df-44c8-4658-87eb-995322322a96 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-56516fba-c882-4093-98c6-3785be6e8d95 req-d4b6f6df-44c8-4658-87eb-995322322a96 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] No waiting events found dispatching network-vif-unplugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-56516fba-c882-4093-98c6-3785be6e8d95 req-d4b6f6df-44c8-4658-87eb-995322322a96 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received event network-vif-unplugged-81e27221-96a7-4492-b72b-a0ed4f496f09 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:20 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Instance destroyed successfully.
Oct 26 03:38:20 user nova-compute[74630]: DEBUG nova.objects.instance [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'resources' on Instance uuid 0be74854-6a07-4468-bf1c-c41066af14c2 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:31:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1950278964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1950278964',id=27,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:34:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e396316ddc243c594c29f5c434501cb',ramdisk_id='',reservation_id='r-014alrj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:36:35Z,user_data=None,user_id='f8694c5db6e34f1e88595b55f8e5fe70',uuid=0be74854-6a07-4468-bf1c-c41066af14c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81e27221-96a7-4492-b72b-a0ed4f496f09", "address": "fa:16:3e:21:e1:c5", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e27221-96", "ovs_interfaceid": "81e27221-96a7-4492-b72b-a0ed4f496f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converting VIF {"id": "81e27221-96a7-4492-b72b-a0ed4f496f09", "address": "fa:16:3e:21:e1:c5", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81e27221-96", "ovs_interfaceid": "81e27221-96a7-4492-b72b-a0ed4f496f09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:e1:c5,bridge_name='br-int',has_traffic_filtering=True,id=81e27221-96a7-4492-b72b-a0ed4f496f09,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e27221-96') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG os_vif [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:e1:c5,bridge_name='br-int',has_traffic_filtering=True,id=81e27221-96a7-4492-b72b-a0ed4f496f09,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e27221-96') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81e27221-96, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05ef291b-3f0f-4227-87f8-6708a5575eaf) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:20 user nova-compute[74630]: INFO os_vif [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:e1:c5,bridge_name='br-int',has_traffic_filtering=True,id=81e27221-96a7-4492-b72b-a0ed4f496f09,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81e27221-96')
Oct 26 03:38:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eajGSbBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:38:20 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:38:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a900653e-ab36-435c-aeab-85cfafa41a27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:38:20 user nova-compute[74630]: No targets found.
Oct 26 03:38:20 user nova-compute[74630]: iSNS:
Oct 26 03:38:20 user nova-compute[74630]: No targets found.
Oct 26 03:38:20 user nova-compute[74630]: STATIC:
Oct 26 03:38:20 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:38:20 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:38:20 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:38:20 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0
Oct 26 03:38:20 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:38:20 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:38:20 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941
Oct 26 03:38:20 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:38:20 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:38:20 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794
Oct 26 03:38:20 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:38:20 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:38:20 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4
Oct 26 03:38:20 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:38:20 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:38:20 user nova-compute[74630]: FIRMWARE:
Oct 26 03:38:20 user nova-compute[74630]: No targets found.
Oct 26 03:38:20 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:38:20 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:38:20 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[558b58bc-87d4-410c-b617-aee4856231c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[74447b65-d24e-4232-9519-692461a24103]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:38:21 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:38:21 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:38:21 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:38:21 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:38:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:38:21 user nova-compute[74630]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 (non-flash)
Oct 26 03:38:21 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:38:21 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:38:21 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:38:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f318464f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4'): ({'sde'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Removing single pathed devices sde {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b641a219-7c97-4169-b059-2201f1cb1203]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b5938c-70b1-45d2-9a59-124ccc05be65]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Flushing IO for device /dev/sde {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb54e0e-b6bb-455d-b57d-5e3d54d65447]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa50937-4714-45ce-81d8-c55222281a30]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] SCSI volumes sde have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc693a124-fa4dfe20a24e1ff8', '/dev/disk/by-id/scsi-26661346466653230', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c693a124') {{(pid=86251) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 03:38:21 user nova-compute[74630]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOc693a124-fa4dfe20a24e1ff8
Oct 26 03:38:21 user nova-compute[74630]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26661346466653230
Oct 26 03:38:21 user nova-compute[74630]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_c693a124
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c67785-0086-43c7-afcd-78c77512227c]: (4, None) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaefe09-1a36-4014-a7e6-e3fe7c2555ab]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f98425-4154-4bdc-9fe8-11251d8bf1e7]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4, portal: 172.16.0.220,3260]
Oct 26 03:38:21 user nova-compute[74630]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4, portal: 172.16.0.220,3260] successful.
Oct 26 03:38:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02cc9efa-096f-4682-b557-ab809630abe4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f11469-8426-45f2-998d-3729ea141922]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] <== disconnect_volume: return (379ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:38:21 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Deleting instance files /opt/stack/data/nova/instances/0be74854-6a07-4468-bf1c-c41066af14c2_del
Oct 26 03:38:21 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Deletion of /opt/stack/data/nova/instances/0be74854-6a07-4468-bf1c-c41066af14c2_del complete
Oct 26 03:38:21 user nova-compute[74630]: INFO nova.compute.manager [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Took 1.36 seconds to destroy the instance on the hypervisor.
Oct 26 03:38:21 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:38:21 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:38:22 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:38:22 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Took 0.68 seconds to deallocate network for instance.
Oct 26 03:38:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-bbc69041-a2c5-40f5-b5dc-d1a804c62b51 req-c0789b2a-7e28-4065-8eb5-976ea4c073aa service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received event network-vif-deleted-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-7841ce4e-2280-448e-9953-4637ba438676 req-4a4c6881-af98-4b5b-8d0a-afe27df89311 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7841ce4e-2280-448e-9953-4637ba438676 req-4a4c6881-af98-4b5b-8d0a-afe27df89311 service nova] Acquiring lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7841ce4e-2280-448e-9953-4637ba438676 req-4a4c6881-af98-4b5b-8d0a-afe27df89311 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7841ce4e-2280-448e-9953-4637ba438676 req-4a4c6881-af98-4b5b-8d0a-afe27df89311 service nova] Lock "0be74854-6a07-4468-bf1c-c41066af14c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-7841ce4e-2280-448e-9953-4637ba438676 req-4a4c6881-af98-4b5b-8d0a-afe27df89311 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] No waiting events found dispatching network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:38:22 user nova-compute[74630]: WARNING nova.compute.manager [req-7841ce4e-2280-448e-9953-4637ba438676 req-4a4c6881-af98-4b5b-8d0a-afe27df89311 service nova] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Received unexpected event network-vif-plugged-81e27221-96a7-4492-b72b-a0ed4f496f09 for instance with vm_state active and task_state deleting.
Oct 26 03:38:23 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:38:23 user nova-compute[74630]: INFO nova.compute.manager [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 0be74854-6a07-4468-bf1c-c41066af14c2] Took 1.00 seconds to detach 1 volumes for instance.
Oct 26 03:38:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:23 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:38:23 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:38:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.509s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:23 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Deleted allocations for instance 0be74854-6a07-4468-bf1c-c41066af14c2
Oct 26 03:38:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-12595357-0ae0-4200-989c-838599f0e1e6 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "0be74854-6a07-4468-bf1c-c41066af14c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.770s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:26 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:38:28 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:38:28 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:38:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:29 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:38:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:38:30 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:38:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:30 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:38:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:30 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:38:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json" returned: 0 in 0.444s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:31 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:38:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:38:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:38:34 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:38:34 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=7380MB free_disk=24.651966094970703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Applying migration context for instance 11c75096-6769-4f10-8515-c96b592958a6 as it has an incoming, in-progress migration 58b423b8-cd9c-4230-8052-bccb86735e68. Migration status is finished {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 03:38:34 user nova-compute[74630]: INFO nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Updating resource usage from migration 58b423b8-cd9c-4230-8052-bccb86735e68
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 32264781-acf7-4afa-830a-5469b6a4c744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 73ac3b23-4f52-4107-989a-bcb38b9e0a00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e9b77844-67a8-4c26-90f2-afc1809b33d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 1e9d2b27-a936-4548-b74a-02a64f180234 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f183da7f-ac50-4b6c-8a7b-62b14939bd5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Migration 58b423b8-cd9c-4230-8052-bccb86735e68 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 11c75096-6769-4f10-8515-c96b592958a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 0fb37042-4106-4bcc-a0fa-5e6ae614627f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:38:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "11c75096-6769-4f10-8515-c96b592958a6" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Going to confirm migration 2 {{(pid=74630) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.643s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquired lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG nova.network.neutron [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lazy-loading 'info_cache' on Instance uuid 11c75096-6769-4f10-8515-c96b592958a6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "32264781-acf7-4afa-830a-5469b6a4c744" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:35 user nova-compute[74630]: INFO nova.compute.manager [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Terminating instance
Oct 26 03:38:35 user nova-compute[74630]: DEBUG nova.compute.manager [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:38:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Updating instance_info_cache with network_info: [{"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Releasing lock "refresh_cache-11c75096-6769-4f10-8515-c96b592958a6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lazy-loading 'migration_context' on Instance uuid 11c75096-6769-4f10-8515-c96b592958a6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.objects.base [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Object Instance<11c75096-6769-4f10-8515-c96b592958a6> lazy-loaded attributes: info_cache,migration_context {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.compute.manager [req-e8599f74-62a0-40ff-8502-922ef93da86f req-b302fbe9-e848-4579-af1d-ab92e2750841 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-unplugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e8599f74-62a0-40ff-8502-922ef93da86f req-b302fbe9-e848-4579-af1d-ab92e2750841 service nova] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e8599f74-62a0-40ff-8502-922ef93da86f req-b302fbe9-e848-4579-af1d-ab92e2750841 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e8599f74-62a0-40ff-8502-922ef93da86f req-b302fbe9-e848-4579-af1d-ab92e2750841 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.compute.manager [req-e8599f74-62a0-40ff-8502-922ef93da86f req-b302fbe9-e848-4579-af1d-ab92e2750841 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] No waiting events found dispatching network-vif-unplugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.compute.manager [req-e8599f74-62a0-40ff-8502-922ef93da86f req-b302fbe9-e848-4579-af1d-ab92e2750841 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-unplugged-13707b78-ccef-402c-9d27-d6897b1eacf3 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Skipping network cache update for instance because it is being deleted. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:36 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Instance destroyed successfully.
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.objects.instance [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lazy-loading 'resources' on Instance uuid 32264781-acf7-4afa-830a-5469b6a4c744 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1719517014',display_name='tempest-ServerRescueNegativeTestJSON-server-1719517014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1719517014',id=4,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:25:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b652c6f02780451b89d51d74178bf6c7',ramdisk_id='',reservation_id='r-q4jggfxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2117587238',owner_user_name='tempest-ServerRescueNegativeTestJSON-2117587238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:27:05Z,user_data=None,user_id='62370747d10a420b81009d23e3ba324b',uuid=32264781-acf7-4afa-830a-5469b6a4c744,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converting VIF {"id": "13707b78-ccef-402c-9d27-d6897b1eacf3", "address": "fa:16:3e:3d:25:1b", "network": {"id": "ebc28b96-76b1-42c9-9a46-7874918e2f52", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-682048445-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b652c6f02780451b89d51d74178bf6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13707b78-cc", "ovs_interfaceid": "13707b78-ccef-402c-9d27-d6897b1eacf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:25:1b,bridge_name='br-int',has_traffic_filtering=True,id=13707b78-ccef-402c-9d27-d6897b1eacf3,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13707b78-cc') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG os_vif [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:25:1b,bridge_name='br-int',has_traffic_filtering=True,id=13707b78-ccef-402c-9d27-d6897b1eacf3,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13707b78-cc') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13707b78-cc, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0441013c-9f49-407e-83a3-a0ac62d84d7a) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:36 user nova-compute[74630]: INFO os_vif [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:25:1b,bridge_name='br-int',has_traffic_filtering=True,id=13707b78-ccef-402c-9d27-d6897b1eacf3,network=Network(ebc28b96-76b1-42c9-9a46-7874918e2f52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13707b78-cc')
Oct 26 03:38:36 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Deleting instance files /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744_del
Oct 26 03:38:36 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Deletion of /opt/stack/data/nova/instances/32264781-acf7-4afa-830a-5469b6a4c744_del complete
Oct 26 03:38:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.592s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:36 user nova-compute[74630]: INFO nova.compute.manager [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Took 1.07 seconds to destroy the instance on the hypervisor.
Oct 26 03:38:36 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:38:36 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:38:37 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Deleted allocation for migration 58b423b8-cd9c-4230-8052-bccb86735e68
Oct 26 03:38:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c912aba2-0862-4a22-9ad9-6524d5535662 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "11c75096-6769-4f10-8515-c96b592958a6" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.047s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:37 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Updating instance_info_cache with network_info: [{"id": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "address": "fa:16:3e:1c:d5:8f", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f91f921-53", "ovs_interfaceid": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:38:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-f9890dde-e678-41d4-8447-24bf626c2983" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:38:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:38:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:38:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:38:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:37 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:38:37 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Took 0.87 seconds to deallocate network for instance.
Oct 26 03:38:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:38 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Deleted allocations for instance 32264781-acf7-4afa-830a-5469b6a4c744
Oct 26 03:38:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-498a2a97-62a5-4e85-ae34-5b5d01519946 tempest-ServerRescueNegativeTestJSON-2117587238 tempest-ServerRescueNegativeTestJSON-2117587238-project-member] Lock "32264781-acf7-4afa-830a-5469b6a4c744" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.530s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] No waiting events found dispatching network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:38:38 user nova-compute[74630]: WARNING nova.compute.manager [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received unexpected event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 for instance with vm_state deleted and task_state None.
Oct 26 03:38:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] No waiting events found dispatching network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:38:38 user nova-compute[74630]: WARNING nova.compute.manager [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received unexpected event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 for instance with vm_state deleted and task_state None.
Oct 26 03:38:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] No waiting events found dispatching network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:38:38 user nova-compute[74630]: WARNING nova.compute.manager [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received unexpected event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 for instance with vm_state deleted and task_state None.
Oct 26 03:38:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] Acquiring lock "32264781-acf7-4afa-830a-5469b6a4c744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] Lock "32264781-acf7-4afa-830a-5469b6a4c744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] No waiting events found dispatching network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:38:38 user nova-compute[74630]: WARNING nova.compute.manager [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received unexpected event network-vif-plugged-13707b78-ccef-402c-9d27-d6897b1eacf3 for instance with vm_state deleted and task_state None.
Oct 26 03:38:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-92acff3b-497f-4f7f-af13-3055bb3bca30 req-c2e0209e-0c17-4207-a5e0-d506f4ce4863 service nova] [instance: 32264781-acf7-4afa-830a-5469b6a4c744] Received event network-vif-deleted-13707b78-ccef-402c-9d27-d6897b1eacf3 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:41 user nova-compute[74630]: INFO nova.compute.manager [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Detaching volume 02eaae64-f1ec-42c8-9300-991e555cada0
Oct 26 03:38:41 user nova-compute[74630]: INFO nova.virt.block_device [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Attempting to driver detach volume 02eaae64-f1ec-42c8-9300-991e555cada0 from mountpoint /dev/vdb
Oct 26 03:38:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Attempting to detach device vdb from instance 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:38:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:38:41 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:38:41 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:38:41 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:38:41 user nova-compute[74630]:   <serial>02eaae64-f1ec-42c8-9300-991e555cada0</serial>
Oct 26 03:38:41 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:38:41 user nova-compute[74630]: </disk>
Oct 26 03:38:41 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:38:41 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Successfully detached device vdb from instance 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 from the persistent domain config.
Oct 26 03:38:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:38:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:38:41 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:38:41 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:38:41 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:38:41 user nova-compute[74630]:   <serial>02eaae64-f1ec-42c8-9300-991e555cada0</serial>
Oct 26 03:38:41 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:38:41 user nova-compute[74630]: </disk>
Oct 26 03:38:41 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:38:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "1e9d2b27-a936-4548-b74a-02a64f180234" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "1e9d2b27-a936-4548-b74a-02a64f180234" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "1e9d2b27-a936-4548-b74a-02a64f180234-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "1e9d2b27-a936-4548-b74a-02a64f180234-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "1e9d2b27-a936-4548-b74a-02a64f180234-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:42 user nova-compute[74630]: INFO nova.compute.manager [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Terminating instance
Oct 26 03:38:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-faa646a1-5089-4e94-9f73-41d47d7fe3c8 req-4c643a53-38bd-452d-aee0-640e983e9f52 service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Received event network-vif-unplugged-6245c02f-13dd-4ab2-b490-8156f850a3de {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-faa646a1-5089-4e94-9f73-41d47d7fe3c8 req-4c643a53-38bd-452d-aee0-640e983e9f52 service nova] Acquiring lock "1e9d2b27-a936-4548-b74a-02a64f180234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-faa646a1-5089-4e94-9f73-41d47d7fe3c8 req-4c643a53-38bd-452d-aee0-640e983e9f52 service nova] Lock "1e9d2b27-a936-4548-b74a-02a64f180234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-faa646a1-5089-4e94-9f73-41d47d7fe3c8 req-4c643a53-38bd-452d-aee0-640e983e9f52 service nova] Lock "1e9d2b27-a936-4548-b74a-02a64f180234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-faa646a1-5089-4e94-9f73-41d47d7fe3c8 req-4c643a53-38bd-452d-aee0-640e983e9f52 service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] No waiting events found dispatching network-vif-unplugged-6245c02f-13dd-4ab2-b490-8156f850a3de {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-faa646a1-5089-4e94-9f73-41d47d7fe3c8 req-4c643a53-38bd-452d-aee0-640e983e9f52 service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Received event network-vif-unplugged-6245c02f-13dd-4ab2-b490-8156f850a3de for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:38:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Instance destroyed successfully.
Oct 26 03:38:42 user nova-compute[74630]: DEBUG nova.objects.instance [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'resources' on Instance uuid 1e9d2b27-a936-4548-b74a-02a64f180234 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:32:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2110881862',display_name='tempest-AttachVolumeNegativeTest-server-2110881862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2110881862',id=30,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZV4zYfM2KgqCkScI1E5UsVYaV/+c7WrUQ445qL4s+LA6gAbg7uONb4EqshspoZJbRuNMNALikQ5FY9oowGd/34b4kcyYiHcNeg6RvW2b+iWAaBYzMLN5Vu5oW2uVP11A==',key_name='tempest-keypair-1280320741',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:32:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ebfc20893da40c1b25be2444441f0c3',ramdisk_id='',reservation_id='r-u4xlh0io',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2146381855',owner_user_name='tempest-AttachVolumeNegativeTest-2146381855-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:32:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc35b87a18e44b3392d122e392a0b8fb',uuid=1e9d2b27-a936-4548-b74a-02a64f180234,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6245c02f-13dd-4ab2-b490-8156f850a3de", "address": "fa:16:3e:28:df:29", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6245c02f-13", "ovs_interfaceid": "6245c02f-13dd-4ab2-b490-8156f850a3de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converting VIF {"id": "6245c02f-13dd-4ab2-b490-8156f850a3de", "address": "fa:16:3e:28:df:29", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6245c02f-13", "ovs_interfaceid": "6245c02f-13dd-4ab2-b490-8156f850a3de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:df:29,bridge_name='br-int',has_traffic_filtering=True,id=6245c02f-13dd-4ab2-b490-8156f850a3de,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6245c02f-13') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG os_vif [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:df:29,bridge_name='br-int',has_traffic_filtering=True,id=6245c02f-13dd-4ab2-b490-8156f850a3de,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6245c02f-13') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6245c02f-13, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34b95158-bc80-45bb-b842-d4e8e0414bbb) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:38:42 user nova-compute[74630]: INFO os_vif [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:df:29,bridge_name='br-int',has_traffic_filtering=True,id=6245c02f-13dd-4ab2-b490-8156f850a3de,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6245c02f-13')
Oct 26 03:38:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Deleting instance files /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234_del
Oct 26 03:38:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Deletion of /opt/stack/data/nova/instances/1e9d2b27-a936-4548-b74a-02a64f180234_del complete
Oct 26 03:38:43 user nova-compute[74630]: INFO nova.compute.manager [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 26 03:38:43 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:38:43 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:38:43 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:38:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:44 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:38:44 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Took 1.04 seconds to deallocate network for instance.
Oct 26 03:38:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-1aaf95b8-e237-42e9-a76b-1d65a161a8d0 req-f59a7a1a-d95e-4050-9720-dbea253d6dff service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Received event network-vif-deleted-6245c02f-13dd-4ab2-b490-8156f850a3de {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:44 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:38:44 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:38:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:44 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Deleted allocations for instance 1e9d2b27-a936-4548-b74a-02a64f180234
Oct 26 03:38:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-391d1230-d124-43cb-9ec2-a31565ebf5f5 req-ba625ee3-6af2-41ad-9b09-16abef644957 service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Received event network-vif-plugged-6245c02f-13dd-4ab2-b490-8156f850a3de {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:38:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-391d1230-d124-43cb-9ec2-a31565ebf5f5 req-ba625ee3-6af2-41ad-9b09-16abef644957 service nova] Acquiring lock "1e9d2b27-a936-4548-b74a-02a64f180234-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-391d1230-d124-43cb-9ec2-a31565ebf5f5 req-ba625ee3-6af2-41ad-9b09-16abef644957 service nova] Lock "1e9d2b27-a936-4548-b74a-02a64f180234-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-391d1230-d124-43cb-9ec2-a31565ebf5f5 req-ba625ee3-6af2-41ad-9b09-16abef644957 service nova] Lock "1e9d2b27-a936-4548-b74a-02a64f180234-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-391d1230-d124-43cb-9ec2-a31565ebf5f5 req-ba625ee3-6af2-41ad-9b09-16abef644957 service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] No waiting events found dispatching network-vif-plugged-6245c02f-13dd-4ab2-b490-8156f850a3de {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:38:44 user nova-compute[74630]: WARNING nova.compute.manager [req-391d1230-d124-43cb-9ec2-a31565ebf5f5 req-ba625ee3-6af2-41ad-9b09-16abef644957 service nova] [instance: 1e9d2b27-a936-4548-b74a-02a64f180234] Received unexpected event network-vif-plugged-6245c02f-13dd-4ab2-b490-8156f850a3de for instance with vm_state deleted and task_state None.
Oct 26 03:38:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a06f5e16-d643-47ac-8ba1-0189132481a1 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "1e9d2b27-a936-4548-b74a-02a64f180234" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.536s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTRnouwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:38:46 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:38:46 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:38:46 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e7f73b-a35c-47cc-a894-a4d1c77b856f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:38:46 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dda3066-3abe-475c-b33b-a0649a847b5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17] added
Oct 26 03:38:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[95701c93-d1e1-41fc-81fa-e439bc10372b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ddb809-3c16-42eb-ad33-55b90b57af93]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GTRnouwg {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GTRnouwg" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef9b444-a4cb-453d-a6f8-97ce5b4d6af7]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GTRnouwg'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3793f274-201a-4b6d-9b9a-f1a96cc21468]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a73d56e-27ee-44ee-98c4-aa8754850775]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:38:46 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:38:46 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:38:46 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:38:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:38:46 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:38:46 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:38:46 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:38:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[384b6d68-c537-45cf-9f54-721395607975]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17, portal: 172.16.0.220,3260]
Oct 26 03:38:46 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17, portal: 172.16.0.220,3260] successful.
Oct 26 03:38:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68f4e06-4070-4d43-83f7-3e1225b0ba95]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec792bb-0021-491f-8888-b01267d6bec2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:38:46 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:38:46 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:38:46 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:38:46 user nova-compute[74630]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 (non-flash)
Oct 26 03:38:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:38:46 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:38:46 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:38:46 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:38:46 user nova-compute[74630]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 (non-flash)
Oct 26 03:38:46 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e58a661-67ec-48aa-8397-8b425f077c4c]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:38:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTRnouwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:38:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:38:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26439363565383432', 'path': '/dev/sde'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:38:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439363565383432', 'path': '/dev/sde'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:38:47 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lazy-loading 'flavor' on Instance uuid f183da7f-ac50-4b6c-8a7b-62b14939bd5e {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:38:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:38:47 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:38:47 user nova-compute[74630]:   <source dev="/dev/sde"/>
Oct 26 03:38:47 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:38:47 user nova-compute[74630]:   <serial>ab37bb5c-5d91-451a-b8e8-d36f9778ba17</serial>
Oct 26 03:38:47 user nova-compute[74630]: </disk>
Oct 26 03:38:47 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:38:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:38:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:38:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] No VIF found with MAC fa:16:3e:3c:00:72, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:38:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c912da6a-1bc7-48ea-89f2-8b5a99dc2f35 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.624s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:38:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:50 user nova-compute[74630]: INFO nova.compute.manager [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Detaching volume ab37bb5c-5d91-451a-b8e8-d36f9778ba17
Oct 26 03:38:50 user nova-compute[74630]: INFO nova.virt.block_device [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Attempting to driver detach volume ab37bb5c-5d91-451a-b8e8-d36f9778ba17 from mountpoint /dev/vdb
Oct 26 03:38:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Attempting to detach device vdb from instance f183da7f-ac50-4b6c-8a7b-62b14939bd5e from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:38:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:38:50 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:38:50 user nova-compute[74630]:   <source dev="/dev/sde"/>
Oct 26 03:38:50 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:38:50 user nova-compute[74630]:   <serial>ab37bb5c-5d91-451a-b8e8-d36f9778ba17</serial>
Oct 26 03:38:50 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:38:50 user nova-compute[74630]: </disk>
Oct 26 03:38:50 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:38:50 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Successfully detached device vdb from instance f183da7f-ac50-4b6c-8a7b-62b14939bd5e from the persistent domain config.
Oct 26 03:38:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f183da7f-ac50-4b6c-8a7b-62b14939bd5e from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:38:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:38:50 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:38:50 user nova-compute[74630]:   <source dev="/dev/sde"/>
Oct 26 03:38:50 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:38:50 user nova-compute[74630]:   <serial>ab37bb5c-5d91-451a-b8e8-d36f9778ba17</serial>
Oct 26 03:38:50 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:38:50 user nova-compute[74630]: </disk>
Oct 26 03:38:50 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:38:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f183da7f-ac50-4b6c-8a7b-62b14939bd5e {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:38:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:38:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:38:51 user nova-compute[74630]: INFO nova.compute.manager [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Detaching volume 4d69e5a1-fcc9-4100-85be-6f868ccb4941
Oct 26 03:38:51 user nova-compute[74630]: INFO nova.virt.block_device [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Attempting to driver detach volume 4d69e5a1-fcc9-4100-85be-6f868ccb4941 from mountpoint /dev/vdc
Oct 26 03:38:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Attempting to detach device vdc from instance 0fb37042-4106-4bcc-a0fa-5e6ae614627f from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:38:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:38:52 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:38:52 user nova-compute[74630]:   <source dev="/dev/sdf"/>
Oct 26 03:38:52 user nova-compute[74630]:   <target dev="vdc" bus="virtio"/>
Oct 26 03:38:52 user nova-compute[74630]:   <serial>4d69e5a1-fcc9-4100-85be-6f868ccb4941</serial>
Oct 26 03:38:52 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 03:38:52 user nova-compute[74630]: </disk>
Oct 26 03:38:52 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:38:52 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Successfully detached device vdc from instance 0fb37042-4106-4bcc-a0fa-5e6ae614627f from the persistent domain config.
Oct 26 03:38:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0fb37042-4106-4bcc-a0fa-5e6ae614627f from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:38:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:38:52 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:38:52 user nova-compute[74630]:   <source dev="/dev/sdf"/>
Oct 26 03:38:52 user nova-compute[74630]:   <target dev="vdc" bus="virtio"/>
Oct 26 03:38:52 user nova-compute[74630]:   <serial>4d69e5a1-fcc9-4100-85be-6f868ccb4941</serial>
Oct 26 03:38:52 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 03:38:52 user nova-compute[74630]: </disk>
Oct 26 03:38:52 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:38:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0fb37042-4106-4bcc-a0fa-5e6ae614627f {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:38:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:38:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:02 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 is timed out.
Oct 26 03:39:02 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Successfully detached device vdb from instance 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 from the live domain config.
Oct 26 03:39:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QaxlvLhb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:39:02 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8beb48fd-0bad-4939-bc8a-ed125aeae520]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:39:02 user nova-compute[74630]: No targets found.
Oct 26 03:39:02 user nova-compute[74630]: iSNS:
Oct 26 03:39:02 user nova-compute[74630]: No targets found.
Oct 26 03:39:02 user nova-compute[74630]: STATIC:
Oct 26 03:39:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:39:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:39:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:39:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0
Oct 26 03:39:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:39:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:39:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941
Oct 26 03:39:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:39:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:39:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794
Oct 26 03:39:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:39:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:39:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17
Oct 26 03:39:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:39:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:39:02 user nova-compute[74630]: FIRMWARE:
Oct 26 03:39:02 user nova-compute[74630]: No targets found.
Oct 26 03:39:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:39:02 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:39:02 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[315fa4cb-a929-48eb-b834-fb421f4a55ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[040c9acf-b18d-47ca-9be9-03e764b404b2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:39:02 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:39:02 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:39:02 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:39:02 user nova-compute[74630]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 (non-flash)
Oct 26 03:39:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:39:02 user nova-compute[74630]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 (non-flash)
Oct 26 03:39:02 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:39:02 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:39:02 user nova-compute[74630]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 (non-flash)
Oct 26 03:39:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c6668c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0'): ({'sdc'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Removing single pathed devices sdc {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc668890-f6e7-492e-960e-ff7bb22ffed8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b637cd8-9cb9-4cca-8cca-a3d6ecbe66ba]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Flushing IO for device /dev/sdc {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[819baa22-98a6-4a20-98ac-4d268815d94c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[29136ab1-ac4c-4b09-b69a-c69795cdbb5c]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd725af3-f6aa-40dd-b02e-c590181b1ad0]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbbff65-133f-4780-ae79-2a382f858891]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0, portal: 172.16.0.220,3260]
Oct 26 03:39:02 user nova-compute[74630]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0, portal: 172.16.0.220,3260] successful.
Oct 26 03:39:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02eaae64-f1ec-42c8-9300-991e555cada0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3deed1a5-07fb-4f83-9b92-96cf8947a967]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] <== disconnect_volume: return (296ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:39:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:03 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lazy-loading 'flavor' on Instance uuid 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:39:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c61e2cd2-901a-4e4b-b268-eee14f89d11e tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.812s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:39:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:39:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:39:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:39:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:11 user nova-compute[74630]: INFO nova.compute.manager [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Terminating instance
Oct 26 03:39:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:11 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f183da7f-ac50-4b6c-8a7b-62b14939bd5e is timed out.
Oct 26 03:39:11 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Successfully detached device vdb from instance f183da7f-ac50-4b6c-8a7b-62b14939bd5e from the live domain config.
Oct 26 03:39:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GTRnouwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:39:11 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[015ffde2-bd9a-4631-ae45-670e39f7c75c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:39:11 user nova-compute[74630]: No targets found.
Oct 26 03:39:11 user nova-compute[74630]: iSNS:
Oct 26 03:39:11 user nova-compute[74630]: No targets found.
Oct 26 03:39:11 user nova-compute[74630]: STATIC:
Oct 26 03:39:11 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:39:11 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:39:11 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:39:11 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941
Oct 26 03:39:11 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:39:11 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:39:11 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794
Oct 26 03:39:11 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:39:11 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:39:11 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17
Oct 26 03:39:11 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:39:11 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:39:11 user nova-compute[74630]: FIRMWARE:
Oct 26 03:39:11 user nova-compute[74630]: No targets found.
Oct 26 03:39:11 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:39:11 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:39:11 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67796c1-3f99-4f45-8a3e-4353cbe724d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5f48f3-3d7b-429b-9bd9-878be6fe9937]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:39:11 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:39:11 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:39:11 user nova-compute[74630]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 (non-flash)
Oct 26 03:39:11 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:39:11 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:39:11 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:39:11 user nova-compute[74630]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 (non-flash)
Oct 26 03:39:11 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f315c720e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17'): ({'sde'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Removing single pathed devices sde {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[22879be0-a5c4-4dfb-bee4-8f5a368589aa]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fb629a-dc22-4d13-902c-af252083c19f]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Flushing IO for device /dev/sde {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc635e1e-9341-4482-a2db-103bcc2cbeb2]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-759eeb20-e89f-4d96-b4db-b1ceda2387ef req-685ab757-c64e-41bd-8775-91b7da7d97bc service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Received event network-vif-unplugged-a56ab20c-9890-481a-b7b0-e5a4ace45c39 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-759eeb20-e89f-4d96-b4db-b1ceda2387ef req-685ab757-c64e-41bd-8775-91b7da7d97bc service nova] Acquiring lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-759eeb20-e89f-4d96-b4db-b1ceda2387ef req-685ab757-c64e-41bd-8775-91b7da7d97bc service nova] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-759eeb20-e89f-4d96-b4db-b1ceda2387ef req-685ab757-c64e-41bd-8775-91b7da7d97bc service nova] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-759eeb20-e89f-4d96-b4db-b1ceda2387ef req-685ab757-c64e-41bd-8775-91b7da7d97bc service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] No waiting events found dispatching network-vif-unplugged-a56ab20c-9890-481a-b7b0-e5a4ace45c39 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-759eeb20-e89f-4d96-b4db-b1ceda2387ef req-685ab757-c64e-41bd-8775-91b7da7d97bc service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Received event network-vif-unplugged-a56ab20c-9890-481a-b7b0-e5a4ace45c39 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5d3f07-9f28-4967-9c11-35db3da02c5d]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] SCSI volumes sde have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a42702e-4629-47e8-815f-d238cd51c0b2]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3501fd21-ffec-427b-9450-e5c66d02f35e]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17, portal: 172.16.0.220,3260]
Oct 26 03:39:11 user nova-compute[74630]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17, portal: 172.16.0.220,3260] successful.
Oct 26 03:39:11 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab37bb5c-5d91-451a-b8e8-d36f9778ba17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd29fb97-48aa-4501-bfc7-d1f823c5e450]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] <== disconnect_volume: return (368ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:39:11 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Instance destroyed successfully.
Oct 26 03:39:11 user nova-compute[74630]: DEBUG nova.objects.instance [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'resources' on Instance uuid 73ac3b23-4f52-4107-989a-bcb38b9e0a00 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:28:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1991759247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1991759247',id=22,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:29:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e396316ddc243c594c29f5c434501cb',ramdisk_id='',reservation_id='r-5uc73x9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:30:52Z,user_data=None,user_id='f8694c5db6e34f1e88595b55f8e5fe70',uuid=73ac3b23-4f52-4107-989a-bcb38b9e0a00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "address": "fa:16:3e:e6:d9:ea", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ab20c-98", "ovs_interfaceid": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converting VIF {"id": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "address": "fa:16:3e:e6:d9:ea", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56ab20c-98", "ovs_interfaceid": "a56ab20c-9890-481a-b7b0-e5a4ace45c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:d9:ea,bridge_name='br-int',has_traffic_filtering=True,id=a56ab20c-9890-481a-b7b0-e5a4ace45c39,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56ab20c-98') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG os_vif [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:d9:ea,bridge_name='br-int',has_traffic_filtering=True,id=a56ab20c-9890-481a-b7b0-e5a4ace45c39,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56ab20c-98') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa56ab20c-98, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=135a4907-f819-4c0e-ad14-462c0fdd3808) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:11 user nova-compute[74630]: INFO os_vif [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:d9:ea,bridge_name='br-int',has_traffic_filtering=True,id=a56ab20c-9890-481a-b7b0-e5a4ace45c39,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56ab20c-98')
Oct 26 03:39:11 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Deleting instance files /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00_del
Oct 26 03:39:11 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Deletion of /opt/stack/data/nova/instances/73ac3b23-4f52-4107-989a-bcb38b9e0a00_del complete
Oct 26 03:39:11 user nova-compute[74630]: INFO nova.compute.manager [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 26 03:39:11 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:39:11 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:39:12 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Took 0.42 seconds to deallocate network for instance.
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:12 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0fb37042-4106-4bcc-a0fa-5e6ae614627f is timed out.
Oct 26 03:39:12 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Successfully detached device vdc from instance 0fb37042-4106-4bcc-a0fa-5e6ae614627f from the live domain config.
Oct 26 03:39:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wINEBGXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:39:12 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[36904b39-8ec6-4673-9145-b4d682cec23f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:39:12 user nova-compute[74630]: No targets found.
Oct 26 03:39:12 user nova-compute[74630]: iSNS:
Oct 26 03:39:12 user nova-compute[74630]: No targets found.
Oct 26 03:39:12 user nova-compute[74630]: STATIC:
Oct 26 03:39:12 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:39:12 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:39:12 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:39:12 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941
Oct 26 03:39:12 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:39:12 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:39:12 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794
Oct 26 03:39:12 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:39:12 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:39:12 user nova-compute[74630]: FIRMWARE:
Oct 26 03:39:12 user nova-compute[74630]: No targets found.
Oct 26 03:39:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:39:12 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:39:12 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG nova.objects.instance [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lazy-loading 'flavor' on Instance uuid f183da7f-ac50-4b6c-8a7b-62b14939bd5e {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bad0365-7b35-47d1-825b-133d7e0f53ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3396605-0292-462e-9de1-4f5993d4f56e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:39:12 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:39:12 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:39:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:39:12 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:39:12 user nova-compute[74630]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 (non-flash)
Oct 26 03:39:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f315c722e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941'): ({'sdf'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Removing single pathed devices sdf {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2bf8a736-25bf-4b61-93df-2ca32584b7e8 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.912s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c3b284-75a5-499e-b670-119264a3b4d5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad41dffa-f128-4740-92ae-beaa4ddf1b84]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Flushing IO for device /dev/sdf {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4a3d7a-8b5a-44db-8b8d-69f09b77efd7]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7652a5fb-9180-4e8e-8eb7-df70c248af55]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] SCSI volumes sdf have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[819f802d-888c-47f8-924e-4d4385126f4d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc3576f-3933-4b4b-bb02-1126048c7c02]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941, portal: 172.16.0.220,3260]
Oct 26 03:39:12 user nova-compute[74630]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941, portal: 172.16.0.220,3260] successful.
Oct 26 03:39:12 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d69e5a1-fcc9-4100-85be-6f868ccb4941 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd3d7de-b340-487d-b727-d4c3a619a077]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] <== disconnect_volume: return (334ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:39:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:39:12 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Deleted allocations for instance 73ac3b23-4f52-4107-989a-bcb38b9e0a00
Oct 26 03:39:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-38f36e5b-1b93-4038-8602-0055be6a0609 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.917s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-06eace83-b250-4de4-a6ea-28f3a9187fac req-b66962ea-6262-4548-8b77-b950dcd6d2ee service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Received event network-vif-plugged-a56ab20c-9890-481a-b7b0-e5a4ace45c39 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-06eace83-b250-4de4-a6ea-28f3a9187fac req-b66962ea-6262-4548-8b77-b950dcd6d2ee service nova] Acquiring lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-06eace83-b250-4de4-a6ea-28f3a9187fac req-b66962ea-6262-4548-8b77-b950dcd6d2ee service nova] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-06eace83-b250-4de4-a6ea-28f3a9187fac req-b66962ea-6262-4548-8b77-b950dcd6d2ee service nova] Lock "73ac3b23-4f52-4107-989a-bcb38b9e0a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-06eace83-b250-4de4-a6ea-28f3a9187fac req-b66962ea-6262-4548-8b77-b950dcd6d2ee service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] No waiting events found dispatching network-vif-plugged-a56ab20c-9890-481a-b7b0-e5a4ace45c39 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:39:13 user nova-compute[74630]: WARNING nova.compute.manager [req-06eace83-b250-4de4-a6ea-28f3a9187fac req-b66962ea-6262-4548-8b77-b950dcd6d2ee service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Received unexpected event network-vif-plugged-a56ab20c-9890-481a-b7b0-e5a4ace45c39 for instance with vm_state deleted and task_state None.
Oct 26 03:39:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-06eace83-b250-4de4-a6ea-28f3a9187fac req-b66962ea-6262-4548-8b77-b950dcd6d2ee service nova] [instance: 73ac3b23-4f52-4107-989a-bcb38b9e0a00] Received event network-vif-deleted-a56ab20c-9890-481a-b7b0-e5a4ace45c39 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'flavor' on Instance uuid 0fb37042-4106-4bcc-a0fa-5e6ae614627f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:39:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d49c7b19-24d8-4f66-9d0f-898487060204 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.929s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:23 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:39:26 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:39:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:28 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:39:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:29 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:39:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:39:30 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:39:31 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:39:31 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:39:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:39:31 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:39:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:32 user nova-compute[74630]: INFO nova.compute.manager [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Terminating instance
Oct 26 03:39:32 user nova-compute[74630]: DEBUG nova.compute.manager [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG nova.compute.manager [req-4ea2ab82-2bad-4777-bb31-2c2ebe3386ad req-4a9d1976-e3c5-4585-8704-6c17352f863a service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-vif-unplugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4ea2ab82-2bad-4777-bb31-2c2ebe3386ad req-4a9d1976-e3c5-4585-8704-6c17352f863a service nova] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4ea2ab82-2bad-4777-bb31-2c2ebe3386ad req-4a9d1976-e3c5-4585-8704-6c17352f863a service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4ea2ab82-2bad-4777-bb31-2c2ebe3386ad req-4a9d1976-e3c5-4585-8704-6c17352f863a service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG nova.compute.manager [req-4ea2ab82-2bad-4777-bb31-2c2ebe3386ad req-4a9d1976-e3c5-4585-8704-6c17352f863a service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] No waiting events found dispatching network-vif-unplugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG nova.compute.manager [req-4ea2ab82-2bad-4777-bb31-2c2ebe3386ad req-4a9d1976-e3c5-4585-8704-6c17352f863a service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-vif-unplugged-02a0e249-0a94-475c-9754-2834697559c2 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:33 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Instance destroyed successfully.
Oct 26 03:39:33 user nova-compute[74630]: DEBUG nova.objects.instance [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lazy-loading 'resources' on Instance uuid 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1868004368',display_name='tempest-ServerStableDeviceRescueTest-server-1868004368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1868004368',id=28,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFC6NXMSPyyw1g6+xSeE/vl9+H/GvU/He8VS7Yjec0ZqF+S6tvl0L4Bk1vv8WgmPnj146MkMUEtWtP4csR+EGR8rXD4vtkUnhByB4CIzoqcFtEPCAqMZloduZRLpZTLz+A==',key_name='tempest-keypair-533323538',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:36:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='400857740007472cb751dac6b40d881e',ramdisk_id='',reservation_id='r-4nompxck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1839582341',owner_user_name='tempest-ServerStableDeviceRescueTest-1839582341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:38:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ac12db50b4d49068be8b20c4ea28651',uuid=6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Converting VIF {"id": "02a0e249-0a94-475c-9754-2834697559c2", "address": "fa:16:3e:22:15:28", "network": {"id": "14b85bdb-a349-4db4-8fd4-dada8a2eb901", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-646081355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "400857740007472cb751dac6b40d881e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02a0e249-0a", "ovs_interfaceid": "02a0e249-0a94-475c-9754-2834697559c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:15:28,bridge_name='br-int',has_traffic_filtering=True,id=02a0e249-0a94-475c-9754-2834697559c2,network=Network(14b85bdb-a349-4db4-8fd4-dada8a2eb901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a0e249-0a') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG os_vif [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:15:28,bridge_name='br-int',has_traffic_filtering=True,id=02a0e249-0a94-475c-9754-2834697559c2,network=Network(14b85bdb-a349-4db4-8fd4-dada8a2eb901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a0e249-0a') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02a0e249-0a, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f42d993-fb45-4e87-a282-947e305a63f9) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:39:33 user nova-compute[74630]: INFO os_vif [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:15:28,bridge_name='br-int',has_traffic_filtering=True,id=02a0e249-0a94-475c-9754-2834697559c2,network=Network(14b85bdb-a349-4db4-8fd4-dada8a2eb901),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02a0e249-0a')
Oct 26 03:39:33 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Deleting instance files /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9_del
Oct 26 03:39:33 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Deletion of /opt/stack/data/nova/instances/6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9_del complete
Oct 26 03:39:33 user nova-compute[74630]: INFO nova.compute.manager [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 26 03:39:33 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:39:34 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:39:34 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=7804MB free_disk=24.806777954101562GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:39:34 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Took 1.04 seconds to deallocate network for instance.
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 40316e54-eee2-4072-b436-4c5bb31724a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e9b77844-67a8-4c26-90f2-afc1809b33d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f183da7f-ac50-4b6c-8a7b-62b14939bd5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 11c75096-6769-4f10-8515-c96b592958a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 0fb37042-4106-4bcc-a0fa-5e6ae614627f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.253s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-4b3fad04-1e62-4937-aef1-9e18341edcf8 req-3e482f34-017d-4c5b-aa43-569d384c2fbb service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4b3fad04-1e62-4937-aef1-9e18341edcf8 req-3e482f34-017d-4c5b-aa43-569d384c2fbb service nova] Acquiring lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4b3fad04-1e62-4937-aef1-9e18341edcf8 req-3e482f34-017d-4c5b-aa43-569d384c2fbb service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4b3fad04-1e62-4937-aef1-9e18341edcf8 req-3e482f34-017d-4c5b-aa43-569d384c2fbb service nova] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-4b3fad04-1e62-4937-aef1-9e18341edcf8 req-3e482f34-017d-4c5b-aa43-569d384c2fbb service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] No waiting events found dispatching network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:39:34 user nova-compute[74630]: WARNING nova.compute.manager [req-4b3fad04-1e62-4937-aef1-9e18341edcf8 req-3e482f34-017d-4c5b-aa43-569d384c2fbb service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received unexpected event network-vif-plugged-02a0e249-0a94-475c-9754-2834697559c2 for instance with vm_state deleted and task_state None.
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-4b3fad04-1e62-4937-aef1-9e18341edcf8 req-3e482f34-017d-4c5b-aa43-569d384c2fbb service nova] [instance: 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9] Received event network-vif-deleted-02a0e249-0a94-475c-9754-2834697559c2 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:39:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:34 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Deleted allocations for instance 6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9
Oct 26 03:39:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-53dadd23-38ab-41cf-845e-a562f9751d24 tempest-ServerStableDeviceRescueTest-1839582341 tempest-ServerStableDeviceRescueTest-1839582341-project-member] Lock "6e1b8bb0-1665-4b20-a8cb-42aa1ba3a5e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.709s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:35 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:39:35 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:39:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:39:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:39:35 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:39:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Updating instance_info_cache with network_info: [{"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:39:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-40316e54-eee2-4072-b436-4c5bb31724a9" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:39:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:39:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "c23e567d-8284-4039-b3af-5189d6ccdc80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:39:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:36 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:39:36 user nova-compute[74630]: INFO nova.compute.claims [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Claim successful on node user
Oct 26 03:39:36 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:39:36 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:39:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:39:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:39:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:39:36 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:39:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:39:36 user nova-compute[74630]: DEBUG nova.policy [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc35b87a18e44b3392d122e392a0b8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebfc20893da40c1b25be2444441f0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:39:37 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Creating image(s)
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "/opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "/opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "/opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk 1073741824" returned: 0 in 0.049s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG nova.network.neutron [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Successfully created port: b93b79db-e438-4365-98e8-04df7ba83fb0 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Cannot resize image /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Ensure instance console log exists: /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.network.neutron [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Successfully updated port: b93b79db-e438-4365-98e8-04df7ba83fb0 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "refresh_cache-c23e567d-8284-4039-b3af-5189d6ccdc80" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquired lock "refresh_cache-c23e567d-8284-4039-b3af-5189d6ccdc80" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.network.neutron [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-51025eae-b518-4747-af9d-49d064ee8fc9 req-13387b4f-37e7-4b17-9aed-3201ad277258 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Received event network-changed-b93b79db-e438-4365-98e8-04df7ba83fb0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-51025eae-b518-4747-af9d-49d064ee8fc9 req-13387b4f-37e7-4b17-9aed-3201ad277258 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Refreshing instance network info cache due to event network-changed-b93b79db-e438-4365-98e8-04df7ba83fb0. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-51025eae-b518-4747-af9d-49d064ee8fc9 req-13387b4f-37e7-4b17-9aed-3201ad277258 service nova] Acquiring lock "refresh_cache-c23e567d-8284-4039-b3af-5189d6ccdc80" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.network.neutron [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.network.neutron [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Updating instance_info_cache with network_info: [{"id": "b93b79db-e438-4365-98e8-04df7ba83fb0", "address": "fa:16:3e:80:e0:5a", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93b79db-e4", "ovs_interfaceid": "b93b79db-e438-4365-98e8-04df7ba83fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Releasing lock "refresh_cache-c23e567d-8284-4039-b3af-5189d6ccdc80" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.compute.manager [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Instance network_info: |[{"id": "b93b79db-e438-4365-98e8-04df7ba83fb0", "address": "fa:16:3e:80:e0:5a", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93b79db-e4", "ovs_interfaceid": "b93b79db-e438-4365-98e8-04df7ba83fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-51025eae-b518-4747-af9d-49d064ee8fc9 req-13387b4f-37e7-4b17-9aed-3201ad277258 service nova] Acquired lock "refresh_cache-c23e567d-8284-4039-b3af-5189d6ccdc80" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.network.neutron [req-51025eae-b518-4747-af9d-49d064ee8fc9 req-13387b4f-37e7-4b17-9aed-3201ad277258 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Refreshing network info cache for port b93b79db-e438-4365-98e8-04df7ba83fb0 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Start _get_guest_xml network_info=[{"id": "b93b79db-e438-4365-98e8-04df7ba83fb0", "address": "fa:16:3e:80:e0:5a", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93b79db-e4", "ovs_interfaceid": "b93b79db-e438-4365-98e8-04df7ba83fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:39:38 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:39:38 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-694327487',display_name='tempest-AttachVolumeNegativeTest-server-694327487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-694327487',id=35,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOo/r67AvEkXTnrLT21cSCg+B2msPTgvA/BC1WbvJGt4ELiRabg4KBY0WaTTKfjkww7RAyCF3ncO9ht0UP6tHiIGDEDGcxJdCyNZSpR34pjXSg9E8PqZr50I60R2PzUSuQ==',key_name='tempest-keypair-599849009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ebfc20893da40c1b25be2444441f0c3',ramdisk_id='',reservation_id='r-66vs0hrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2146381855',owner_user_name='tempest-AttachVolumeNegativeTest-2146381855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc35b87a18e44b3392d122e392a0b8fb',uuid=c23e567d-8284-4039-b3af-5189d6ccdc80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b93b79db-e438-4365-98e8-04df7ba83fb0", "address": "fa:16:3e:80:e0:5a", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93b79db-e4", "ovs_interfaceid": "b93b79db-e438-4365-98e8-04df7ba83fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converting VIF {"id": "b93b79db-e438-4365-98e8-04df7ba83fb0", "address": "fa:16:3e:80:e0:5a", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93b79db-e4", "ovs_interfaceid": "b93b79db-e438-4365-98e8-04df7ba83fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:e0:5a,bridge_name='br-int',has_traffic_filtering=True,id=b93b79db-e438-4365-98e8-04df7ba83fb0,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb93b79db-e4') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.objects.instance [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'pci_devices' on Instance uuid c23e567d-8284-4039-b3af-5189d6ccdc80 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:39:38 user nova-compute[74630]:   <uuid>c23e567d-8284-4039-b3af-5189d6ccdc80</uuid>
Oct 26 03:39:38 user nova-compute[74630]:   <name>instance-00000023</name>
Oct 26 03:39:38 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:39:38 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:39:38 user nova-compute[74630]:   <metadata>
Oct 26 03:39:38 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:39:38 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:39:38 user nova-compute[74630]:       <nova:name>tempest-AttachVolumeNegativeTest-server-694327487</nova:name>
Oct 26 03:39:38 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:39:38</nova:creationTime>
Oct 26 03:39:38 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:39:38 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:39:38 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:39:38 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:39:38 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:39:38 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:39:38 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:39:38 user nova-compute[74630]:       <nova:owner>
Oct 26 03:39:38 user nova-compute[74630]:         <nova:user uuid="bc35b87a18e44b3392d122e392a0b8fb">tempest-AttachVolumeNegativeTest-2146381855-project-member</nova:user>
Oct 26 03:39:38 user nova-compute[74630]:         <nova:project uuid="0ebfc20893da40c1b25be2444441f0c3">tempest-AttachVolumeNegativeTest-2146381855</nova:project>
Oct 26 03:39:38 user nova-compute[74630]:       </nova:owner>
Oct 26 03:39:38 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:39:38 user nova-compute[74630]:       <nova:ports>
Oct 26 03:39:38 user nova-compute[74630]:         <nova:port uuid="b93b79db-e438-4365-98e8-04df7ba83fb0">
Oct 26 03:39:38 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 03:39:38 user nova-compute[74630]:         </nova:port>
Oct 26 03:39:38 user nova-compute[74630]:       </nova:ports>
Oct 26 03:39:38 user nova-compute[74630]:     </nova:instance>
Oct 26 03:39:38 user nova-compute[74630]:   </metadata>
Oct 26 03:39:38 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:39:38 user nova-compute[74630]:     <system>
Oct 26 03:39:38 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:39:38 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:39:38 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:39:38 user nova-compute[74630]:       <entry name="serial">c23e567d-8284-4039-b3af-5189d6ccdc80</entry>
Oct 26 03:39:38 user nova-compute[74630]:       <entry name="uuid">c23e567d-8284-4039-b3af-5189d6ccdc80</entry>
Oct 26 03:39:38 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:39:38 user nova-compute[74630]:     </system>
Oct 26 03:39:38 user nova-compute[74630]:   </sysinfo>
Oct 26 03:39:38 user nova-compute[74630]:   <os>
Oct 26 03:39:38 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:39:38 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:39:38 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:39:38 user nova-compute[74630]:   </os>
Oct 26 03:39:38 user nova-compute[74630]:   <features>
Oct 26 03:39:38 user nova-compute[74630]:     <acpi/>
Oct 26 03:39:38 user nova-compute[74630]:     <apic/>
Oct 26 03:39:38 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:39:38 user nova-compute[74630]:   </features>
Oct 26 03:39:38 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:39:38 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:39:38 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:39:38 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:39:38 user nova-compute[74630]:   </clock>
Oct 26 03:39:38 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:39:38 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:39:38 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:39:38 user nova-compute[74630]:   </cpu>
Oct 26 03:39:38 user nova-compute[74630]:   <devices>
Oct 26 03:39:38 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:39:38 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:39:38 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk"/>
Oct 26 03:39:38 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:39:38 user nova-compute[74630]:     </disk>
Oct 26 03:39:38 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:39:38 user nova-compute[74630]:       <mac address="fa:16:3e:80:e0:5a"/>
Oct 26 03:39:38 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:39:38 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:39:38 user nova-compute[74630]:       <target dev="tapb93b79db-e4"/>
Oct 26 03:39:38 user nova-compute[74630]:     </interface>
Oct 26 03:39:38 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:39:38 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/console.log" append="off"/>
Oct 26 03:39:38 user nova-compute[74630]:     </serial>
Oct 26 03:39:38 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:39:38 user nova-compute[74630]:     <video>
Oct 26 03:39:38 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:39:38 user nova-compute[74630]:     </video>
Oct 26 03:39:38 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:39:38 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:39:38 user nova-compute[74630]:     </rng>
Oct 26 03:39:38 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:39:38 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:39:38 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:39:38 user nova-compute[74630]:     </memballoon>
Oct 26 03:39:38 user nova-compute[74630]:   </devices>
Oct 26 03:39:38 user nova-compute[74630]: </domain>
Oct 26 03:39:38 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-694327487',display_name='tempest-AttachVolumeNegativeTest-server-694327487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-694327487',id=35,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOo/r67AvEkXTnrLT21cSCg+B2msPTgvA/BC1WbvJGt4ELiRabg4KBY0WaTTKfjkww7RAyCF3ncO9ht0UP6tHiIGDEDGcxJdCyNZSpR34pjXSg9E8PqZr50I60R2PzUSuQ==',key_name='tempest-keypair-599849009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ebfc20893da40c1b25be2444441f0c3',ramdisk_id='',reservation_id='r-66vs0hrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2146381855',owner_user_name='tempest-AttachVolumeNegativeTest-2146381855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc35b87a18e44b3392d122e392a0b8fb',uuid=c23e567d-8284-4039-b3af-5189d6ccdc80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b93b79db-e438-4365-98e8-04df7ba83fb0", "address": "fa:16:3e:80:e0:5a", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93b79db-e4", "ovs_interfaceid": "b93b79db-e438-4365-98e8-04df7ba83fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converting VIF {"id": "b93b79db-e438-4365-98e8-04df7ba83fb0", "address": "fa:16:3e:80:e0:5a", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93b79db-e4", "ovs_interfaceid": "b93b79db-e438-4365-98e8-04df7ba83fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:e0:5a,bridge_name='br-int',has_traffic_filtering=True,id=b93b79db-e438-4365-98e8-04df7ba83fb0,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb93b79db-e4') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG os_vif [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:e0:5a,bridge_name='br-int',has_traffic_filtering=True,id=b93b79db-e438-4365-98e8-04df7ba83fb0,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb93b79db-e4') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00959936-2133-5b2b-a2e8-c5d70f4480f8', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb93b79db-e4, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb93b79db-e4, col_values=(('qos', UUID('7cae992d-bff3-4ee6-a0fd-486a2739db60')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb93b79db-e4, col_values=(('external_ids', {'iface-id': 'b93b79db-e438-4365-98e8-04df7ba83fb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:e0:5a', 'vm-uuid': 'c23e567d-8284-4039-b3af-5189d6ccdc80'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:38 user nova-compute[74630]: INFO os_vif [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:e0:5a,bridge_name='br-int',has_traffic_filtering=True,id=b93b79db-e438-4365-98e8-04df7ba83fb0,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb93b79db-e4')
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No VIF found with MAC fa:16:3e:80:e0:5a, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.network.neutron [req-51025eae-b518-4747-af9d-49d064ee8fc9 req-13387b4f-37e7-4b17-9aed-3201ad277258 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Updated VIF entry in instance network info cache for port b93b79db-e438-4365-98e8-04df7ba83fb0. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:39:38 user nova-compute[74630]: DEBUG nova.network.neutron [req-51025eae-b518-4747-af9d-49d064ee8fc9 req-13387b4f-37e7-4b17-9aed-3201ad277258 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Updating instance_info_cache with network_info: [{"id": "b93b79db-e438-4365-98e8-04df7ba83fb0", "address": "fa:16:3e:80:e0:5a", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93b79db-e4", "ovs_interfaceid": "b93b79db-e438-4365-98e8-04df7ba83fb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:39:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-51025eae-b518-4747-af9d-49d064ee8fc9 req-13387b4f-37e7-4b17-9aed-3201ad277258 service nova] Releasing lock "refresh_cache-c23e567d-8284-4039-b3af-5189d6ccdc80" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:39:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-6f33aab3-15a6-4da5-9078-5c5e8f0240e7 req-bb1b11b7-cb17-449e-978a-c4bdd5efa190 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Received event network-vif-plugged-b93b79db-e438-4365-98e8-04df7ba83fb0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6f33aab3-15a6-4da5-9078-5c5e8f0240e7 req-bb1b11b7-cb17-449e-978a-c4bdd5efa190 service nova] Acquiring lock "c23e567d-8284-4039-b3af-5189d6ccdc80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6f33aab3-15a6-4da5-9078-5c5e8f0240e7 req-bb1b11b7-cb17-449e-978a-c4bdd5efa190 service nova] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6f33aab3-15a6-4da5-9078-5c5e8f0240e7 req-bb1b11b7-cb17-449e-978a-c4bdd5efa190 service nova] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-6f33aab3-15a6-4da5-9078-5c5e8f0240e7 req-bb1b11b7-cb17-449e-978a-c4bdd5efa190 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] No waiting events found dispatching network-vif-plugged-b93b79db-e438-4365-98e8-04df7ba83fb0 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:39:40 user nova-compute[74630]: WARNING nova.compute.manager [req-6f33aab3-15a6-4da5-9078-5c5e8f0240e7 req-bb1b11b7-cb17-449e-978a-c4bdd5efa190 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Received unexpected event network-vif-plugged-b93b79db-e438-4365-98e8-04df7ba83fb0 for instance with vm_state building and task_state spawning.
Oct 26 03:39:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-91314279-d479-43db-b2c9-d183690d5ef8 req-377fe6af-5c39-4fb2-980c-51a1674a6acb service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Received event network-changed-8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-91314279-d479-43db-b2c9-d183690d5ef8 req-377fe6af-5c39-4fb2-980c-51a1674a6acb service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Refreshing instance network info cache due to event network-changed-8524a132-6deb-46af-9f8d-910a6e7340b0. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-91314279-d479-43db-b2c9-d183690d5ef8 req-377fe6af-5c39-4fb2-980c-51a1674a6acb service nova] Acquiring lock "refresh_cache-f183da7f-ac50-4b6c-8a7b-62b14939bd5e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-91314279-d479-43db-b2c9-d183690d5ef8 req-377fe6af-5c39-4fb2-980c-51a1674a6acb service nova] Acquired lock "refresh_cache-f183da7f-ac50-4b6c-8a7b-62b14939bd5e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG nova.network.neutron [req-91314279-d479-43db-b2c9-d183690d5ef8 req-377fe6af-5c39-4fb2-980c-51a1674a6acb service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Refreshing network info cache for port 8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:41 user nova-compute[74630]: INFO nova.compute.manager [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Terminating instance
Oct 26 03:39:41 user nova-compute[74630]: DEBUG nova.compute.manager [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG nova.network.neutron [req-91314279-d479-43db-b2c9-d183690d5ef8 req-377fe6af-5c39-4fb2-980c-51a1674a6acb service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Updated VIF entry in instance network info cache for port 8524a132-6deb-46af-9f8d-910a6e7340b0. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG nova.network.neutron [req-91314279-d479-43db-b2c9-d183690d5ef8 req-377fe6af-5c39-4fb2-980c-51a1674a6acb service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Updating instance_info_cache with network_info: [{"id": "8524a132-6deb-46af-9f8d-910a6e7340b0", "address": "fa:16:3e:3c:00:72", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8524a132-6d", "ovs_interfaceid": "8524a132-6deb-46af-9f8d-910a6e7340b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-91314279-d479-43db-b2c9-d183690d5ef8 req-377fe6af-5c39-4fb2-980c-51a1674a6acb service nova] Releasing lock "refresh_cache-f183da7f-ac50-4b6c-8a7b-62b14939bd5e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:39:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:42 user nova-compute[74630]: INFO nova.compute.manager [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Terminating instance
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Instance destroyed successfully.
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.objects.instance [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lazy-loading 'resources' on Instance uuid f183da7f-ac50-4b6c-8a7b-62b14939bd5e {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:36:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-215099074',display_name='tempest-TestStampPattern-server-215099074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-215099074',id=34,image_ref='a81a41a5-1289-4883-9e84-3375b36283f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsUi1JFav2rUQ4amatuW91o6BTV1PUkbeAhUKUE9hmgaI99WgwyETHpA4Y+2RpaoFdsnsCe7I0YgyLj8QbS8GQub3NG5km5MaVTjvf64ODji9wzJUh+5eSPSYEe519qTQ==',key_name='tempest-TestStampPattern-1907926505',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:36:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3feb502c9d64505b7fc186fbd271f98',ramdisk_id='',reservation_id='r-rghcmkmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e9b77844-67a8-4c26-90f2-afc1809b33d1',image_min_disk='1',image_min_ram='0',image_owner_id='b3feb502c9d64505b7fc186fbd271f98',image_owner_project_name='tempest-TestStampPattern-1086414073',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1086414073-project-member',image_user_id='2ecfe593558b4abc88818fd1cf7bbdb8',owner_project_name='tempest-TestStampPattern-1086414073',owner_user_name='tempest-TestStampPattern-1086414073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:36:31Z,user_data=None,user_id='2ecfe593558b4abc88818fd1cf7bbdb8',uuid=f183da7f-ac50-4b6c-8a7b-62b14939bd5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8524a132-6deb-46af-9f8d-910a6e7340b0", "address": "fa:16:3e:3c:00:72", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8524a132-6d", "ovs_interfaceid": "8524a132-6deb-46af-9f8d-910a6e7340b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Converting VIF {"id": "8524a132-6deb-46af-9f8d-910a6e7340b0", "address": "fa:16:3e:3c:00:72", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8524a132-6d", "ovs_interfaceid": "8524a132-6deb-46af-9f8d-910a6e7340b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:00:72,bridge_name='br-int',has_traffic_filtering=True,id=8524a132-6deb-46af-9f8d-910a6e7340b0,network=Network(2b989db0-17d0-4283-a2c4-84f29f5cf56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8524a132-6d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG os_vif [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:00:72,bridge_name='br-int',has_traffic_filtering=True,id=8524a132-6deb-46af-9f8d-910a6e7340b0,network=Network(2b989db0-17d0-4283-a2c4-84f29f5cf56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8524a132-6d') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8524a132-6d, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0423e21a-c7db-4168-8b37-8eb38337479d) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-9ebe6fb3-e685-447a-9666-060e7492604b req-90df1698-504d-4151-b8ab-be99c8ab7c91 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Received event network-vif-plugged-b93b79db-e438-4365-98e8-04df7ba83fb0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9ebe6fb3-e685-447a-9666-060e7492604b req-90df1698-504d-4151-b8ab-be99c8ab7c91 service nova] Acquiring lock "c23e567d-8284-4039-b3af-5189d6ccdc80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9ebe6fb3-e685-447a-9666-060e7492604b req-90df1698-504d-4151-b8ab-be99c8ab7c91 service nova] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9ebe6fb3-e685-447a-9666-060e7492604b req-90df1698-504d-4151-b8ab-be99c8ab7c91 service nova] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-9ebe6fb3-e685-447a-9666-060e7492604b req-90df1698-504d-4151-b8ab-be99c8ab7c91 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] No waiting events found dispatching network-vif-plugged-b93b79db-e438-4365-98e8-04df7ba83fb0 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:39:42 user nova-compute[74630]: WARNING nova.compute.manager [req-9ebe6fb3-e685-447a-9666-060e7492604b req-90df1698-504d-4151-b8ab-be99c8ab7c91 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Received unexpected event network-vif-plugged-b93b79db-e438-4365-98e8-04df7ba83fb0 for instance with vm_state building and task_state spawning.
Oct 26 03:39:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:42 user nova-compute[74630]: INFO os_vif [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:00:72,bridge_name='br-int',has_traffic_filtering=True,id=8524a132-6deb-46af-9f8d-910a6e7340b0,network=Network(2b989db0-17d0-4283-a2c4-84f29f5cf56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8524a132-6d')
Oct 26 03:39:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Deleting instance files /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e_del
Oct 26 03:39:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Deletion of /opt/stack/data/nova/instances/f183da7f-ac50-4b6c-8a7b-62b14939bd5e_del complete
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-089f2213-fc2c-4a1e-9e8c-b8b57e5cb196 req-95a11881-7fd4-4ac4-97c2-48740e3a8024 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received event network-vif-unplugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-089f2213-fc2c-4a1e-9e8c-b8b57e5cb196 req-95a11881-7fd4-4ac4-97c2-48740e3a8024 service nova] Acquiring lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-089f2213-fc2c-4a1e-9e8c-b8b57e5cb196 req-95a11881-7fd4-4ac4-97c2-48740e3a8024 service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-089f2213-fc2c-4a1e-9e8c-b8b57e5cb196 req-95a11881-7fd4-4ac4-97c2-48740e3a8024 service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-089f2213-fc2c-4a1e-9e8c-b8b57e5cb196 req-95a11881-7fd4-4ac4-97c2-48740e3a8024 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] No waiting events found dispatching network-vif-unplugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-089f2213-fc2c-4a1e-9e8c-b8b57e5cb196 req-95a11881-7fd4-4ac4-97c2-48740e3a8024 service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received event network-vif-unplugged-f5f32762-6dc9-47fb-a90d-463f3be1283a for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:39:42 user nova-compute[74630]: INFO nova.compute.manager [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 26 03:39:42 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:39:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Instance spawned successfully.
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:39:42 user nova-compute[74630]: INFO nova.compute.manager [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Took 5.75 seconds to spawn the instance on the hypervisor.
Oct 26 03:39:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:39:42 user nova-compute[74630]: INFO nova.compute.manager [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Took 6.45 seconds to build instance.
Oct 26 03:39:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-739baca5-1236-4f66-959e-99ce0caf9b76 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.558s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:43 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Instance destroyed successfully.
Oct 26 03:39:43 user nova-compute[74630]: DEBUG nova.objects.instance [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'resources' on Instance uuid 0fb37042-4106-4bcc-a0fa-5e6ae614627f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T03:33:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1496039535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1496039535',id=31,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG/wKNBcRL+FImLurheVUXxJaQCN+j/6tyyI7ZspxC0JW8pST9M/flxNHjGMm7/l0OfSdgOLNvLYUlsrZoNQ8hwCUP8SlJPzCSBJ8GUHvHot/N2bjmNrHWhLK/dNtdZsg==',key_name='tempest-keypair-1898419039',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:37:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f44335320f77434999514ed6824a2e23',ramdisk_id='',reservation_id='r-xzpbz7ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1268856411',owner_user_name='tempest-AttachVolumeShelveTestJSON-1268856411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f51acc12a54e7bbd38e975f2d7632e',uuid=0fb37042-4106-4bcc-a0fa-5e6ae614627f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converting VIF {"id": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "address": "fa:16:3e:5d:b2:b3", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f32762-6d", "ovs_interfaceid": "f5f32762-6dc9-47fb-a90d-463f3be1283a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b2:b3,bridge_name='br-int',has_traffic_filtering=True,id=f5f32762-6dc9-47fb-a90d-463f3be1283a,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f32762-6d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG os_vif [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b2:b3,bridge_name='br-int',has_traffic_filtering=True,id=f5f32762-6dc9-47fb-a90d-463f3be1283a,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f32762-6d') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5f32762-6d, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a2dd70b-75c7-4d95-bad3-c316b8e7b356) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:43 user nova-compute[74630]: INFO os_vif [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:b2:b3,bridge_name='br-int',has_traffic_filtering=True,id=f5f32762-6dc9-47fb-a90d-463f3be1283a,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f32762-6d')
Oct 26 03:39:43 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Deleting instance files /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f_del
Oct 26 03:39:43 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Deletion of /opt/stack/data/nova/instances/0fb37042-4106-4bcc-a0fa-5e6ae614627f_del complete
Oct 26 03:39:43 user nova-compute[74630]: INFO nova.compute.manager [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 26 03:39:43 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:39:43 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Took 0.72 seconds to deallocate network for instance.
Oct 26 03:39:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-ab4c6c16-98af-422a-b3de-358491470833 req-a3e6520e-04f4-4190-b168-8acce7d52c67 service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Received event network-vif-unplugged-8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ab4c6c16-98af-422a-b3de-358491470833 req-a3e6520e-04f4-4190-b168-8acce7d52c67 service nova] Acquiring lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ab4c6c16-98af-422a-b3de-358491470833 req-a3e6520e-04f4-4190-b168-8acce7d52c67 service nova] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ab4c6c16-98af-422a-b3de-358491470833 req-a3e6520e-04f4-4190-b168-8acce7d52c67 service nova] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-ab4c6c16-98af-422a-b3de-358491470833 req-a3e6520e-04f4-4190-b168-8acce7d52c67 service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] No waiting events found dispatching network-vif-unplugged-8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:39:43 user nova-compute[74630]: WARNING nova.compute.manager [req-ab4c6c16-98af-422a-b3de-358491470833 req-a3e6520e-04f4-4190-b168-8acce7d52c67 service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Received unexpected event network-vif-unplugged-8524a132-6deb-46af-9f8d-910a6e7340b0 for instance with vm_state deleted and task_state None.
Oct 26 03:39:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-ab4c6c16-98af-422a-b3de-358491470833 req-a3e6520e-04f4-4190-b168-8acce7d52c67 service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Received event network-vif-plugged-8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ab4c6c16-98af-422a-b3de-358491470833 req-a3e6520e-04f4-4190-b168-8acce7d52c67 service nova] Acquiring lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ab4c6c16-98af-422a-b3de-358491470833 req-a3e6520e-04f4-4190-b168-8acce7d52c67 service nova] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ab4c6c16-98af-422a-b3de-358491470833 req-a3e6520e-04f4-4190-b168-8acce7d52c67 service nova] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-ab4c6c16-98af-422a-b3de-358491470833 req-a3e6520e-04f4-4190-b168-8acce7d52c67 service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] No waiting events found dispatching network-vif-plugged-8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:39:43 user nova-compute[74630]: WARNING nova.compute.manager [req-ab4c6c16-98af-422a-b3de-358491470833 req-a3e6520e-04f4-4190-b168-8acce7d52c67 service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Received unexpected event network-vif-plugged-8524a132-6deb-46af-9f8d-910a6e7340b0 for instance with vm_state deleted and task_state None.
Oct 26 03:39:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:39:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:43 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Deleted allocations for instance f183da7f-ac50-4b6c-8a7b-62b14939bd5e
Oct 26 03:39:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-799e4125-dbf2-4577-930c-1808b6d0a6f0 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "f183da7f-ac50-4b6c-8a7b-62b14939bd5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.320s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:44 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:39:44 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Took 1.13 seconds to deallocate network for instance.
Oct 26 03:39:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-6911cae3-1bd5-4dc8-8636-03d12abe1cdb req-364bc7db-93f3-4d04-b065-d5c9a1496c3d service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received event network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6911cae3-1bd5-4dc8-8636-03d12abe1cdb req-364bc7db-93f3-4d04-b065-d5c9a1496c3d service nova] Acquiring lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:39:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6911cae3-1bd5-4dc8-8636-03d12abe1cdb req-364bc7db-93f3-4d04-b065-d5c9a1496c3d service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:39:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6911cae3-1bd5-4dc8-8636-03d12abe1cdb req-364bc7db-93f3-4d04-b065-d5c9a1496c3d service nova] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-6911cae3-1bd5-4dc8-8636-03d12abe1cdb req-364bc7db-93f3-4d04-b065-d5c9a1496c3d service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] No waiting events found dispatching network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:39:44 user nova-compute[74630]: WARNING nova.compute.manager [req-6911cae3-1bd5-4dc8-8636-03d12abe1cdb req-364bc7db-93f3-4d04-b065-d5c9a1496c3d service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received unexpected event network-vif-plugged-f5f32762-6dc9-47fb-a90d-463f3be1283a for instance with vm_state deleted and task_state None.
Oct 26 03:39:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-6911cae3-1bd5-4dc8-8636-03d12abe1cdb req-364bc7db-93f3-4d04-b065-d5c9a1496c3d service nova] [instance: f183da7f-ac50-4b6c-8a7b-62b14939bd5e] Received event network-vif-deleted-8524a132-6deb-46af-9f8d-910a6e7340b0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-6911cae3-1bd5-4dc8-8636-03d12abe1cdb req-364bc7db-93f3-4d04-b065-d5c9a1496c3d service nova] [instance: 0fb37042-4106-4bcc-a0fa-5e6ae614627f] Received event network-vif-deleted-f5f32762-6dc9-47fb-a90d-463f3be1283a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:39:44 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:39:44 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:39:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:44 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Deleted allocations for instance 0fb37042-4106-4bcc-a0fa-5e6ae614627f
Oct 26 03:39:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f51baa02-e419-4811-a93c-be43b587159d tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "0fb37042-4106-4bcc-a0fa-5e6ae614627f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.692s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:39:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:39:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:39:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:39:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:39:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:39:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:39:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "40316e54-eee2-4072-b436-4c5bb31724a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:01 user nova-compute[74630]: INFO nova.compute.manager [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Terminating instance
Oct 26 03:40:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:40:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-8818747e-6345-4f57-adf2-f5b3c50a335e req-6a4e0228-fa23-48db-b162-4c1bc229f48f service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received event network-vif-unplugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8818747e-6345-4f57-adf2-f5b3c50a335e req-6a4e0228-fa23-48db-b162-4c1bc229f48f service nova] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8818747e-6345-4f57-adf2-f5b3c50a335e req-6a4e0228-fa23-48db-b162-4c1bc229f48f service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8818747e-6345-4f57-adf2-f5b3c50a335e req-6a4e0228-fa23-48db-b162-4c1bc229f48f service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-8818747e-6345-4f57-adf2-f5b3c50a335e req-6a4e0228-fa23-48db-b162-4c1bc229f48f service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] No waiting events found dispatching network-vif-unplugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-8818747e-6345-4f57-adf2-f5b3c50a335e req-6a4e0228-fa23-48db-b162-4c1bc229f48f service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received event network-vif-unplugged-09559581-1c5c-4bee-90ea-fb70ae613d86 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:40:02 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Instance destroyed successfully.
Oct 26 03:40:02 user nova-compute[74630]: DEBUG nova.objects.instance [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'resources' on Instance uuid 40316e54-eee2-4072-b436-4c5bb31724a9 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:23:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-158280684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-158280684',id=14,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:25:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e396316ddc243c594c29f5c434501cb',ramdisk_id='',reservation_id='r-wjqons9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:27:06Z,user_data=None,user_id='f8694c5db6e34f1e88595b55f8e5fe70',uuid=40316e54-eee2-4072-b436-4c5bb31724a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converting VIF {"id": "09559581-1c5c-4bee-90ea-fb70ae613d86", "address": "fa:16:3e:cb:fe:2f", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09559581-1c", "ovs_interfaceid": "09559581-1c5c-4bee-90ea-fb70ae613d86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:fe:2f,bridge_name='br-int',has_traffic_filtering=True,id=09559581-1c5c-4bee-90ea-fb70ae613d86,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09559581-1c') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_vif [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:fe:2f,bridge_name='br-int',has_traffic_filtering=True,id=09559581-1c5c-4bee-90ea-fb70ae613d86,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09559581-1c') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09559581-1c, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f52572e1-c27f-4990-8a51-6c88ad396954) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:40:02 user nova-compute[74630]: INFO os_vif [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:fe:2f,bridge_name='br-int',has_traffic_filtering=True,id=09559581-1c5c-4bee-90ea-fb70ae613d86,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09559581-1c')
Oct 26 03:40:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZSsQfDla', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:40:02 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1a35d6-0f64-4bc2-bebd-a7aa58d9f643]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:40:02 user nova-compute[74630]: No targets found.
Oct 26 03:40:02 user nova-compute[74630]: iSNS:
Oct 26 03:40:02 user nova-compute[74630]: No targets found.
Oct 26 03:40:02 user nova-compute[74630]: STATIC:
Oct 26 03:40:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee
Oct 26 03:40:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:40:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:40:02 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794
Oct 26 03:40:02 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:40:02 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:40:02 user nova-compute[74630]: FIRMWARE:
Oct 26 03:40:02 user nova-compute[74630]: No targets found.
Oct 26 03:40:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:40:02 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:40:02 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0de8b5-3936-4e75-a85d-ac034221a0a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b53886-8695-4719-87ab-b9d46e38ad8e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:40:02 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:40:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee (non-flash)
Oct 26 03:40:02 user nova-compute[74630]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:40:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f315c778a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6994d00f-cd13-4beb-8b88-16954d39a9cd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[455bb54a-82ff-4dde-b20b-dc5420ffb055]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe5f6d1-fa6a-4730-811b-c23ce7a1c6c6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[994d4ec4-80b3-45ee-94a4-bc659a0094bb]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.075s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebce2e68-cd42-4f68-9df7-78d170d1b6c2]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d230ec25-03b9-4a9c-83c6-cd560498db61]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee, portal: 172.16.0.220,3260]
Oct 26 03:40:02 user nova-compute[74630]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee, portal: 172.16.0.220,3260] successful.
Oct 26 03:40:02 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89dadf3d-bdf3-448e-9b5c-e2613cc0adee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[af493cbb-818d-477e-999b-fd4aef0e8e4e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] <== disconnect_volume: return (375ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:40:02 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Deleting instance files /opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9_del
Oct 26 03:40:02 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Deletion of /opt/stack/data/nova/instances/40316e54-eee2-4072-b436-4c5bb31724a9_del complete
Oct 26 03:40:02 user nova-compute[74630]: INFO nova.compute.manager [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 26 03:40:02 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:40:02 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:40:03 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:40:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-566a6727-ce7a-46ac-86a0-9059919946b7 req-c7e13f72-5a16-4bf5-819a-e63e2a7704ca service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received event network-vif-deleted-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:40:03 user nova-compute[74630]: INFO nova.compute.manager [req-566a6727-ce7a-46ac-86a0-9059919946b7 req-c7e13f72-5a16-4bf5-819a-e63e2a7704ca service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Neutron deleted interface 09559581-1c5c-4bee-90ea-fb70ae613d86; detaching it from the instance and deleting it from the info cache
Oct 26 03:40:03 user nova-compute[74630]: DEBUG nova.network.neutron [req-566a6727-ce7a-46ac-86a0-9059919946b7 req-c7e13f72-5a16-4bf5-819a-e63e2a7704ca service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:40:03 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Took 0.46 seconds to deallocate network for instance.
Oct 26 03:40:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-566a6727-ce7a-46ac-86a0-9059919946b7 req-c7e13f72-5a16-4bf5-819a-e63e2a7704ca service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Detach interface failed, port_id=09559581-1c5c-4bee-90ea-fb70ae613d86, reason: Instance 40316e54-eee2-4072-b436-4c5bb31724a9 could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 03:40:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:04 user nova-compute[74630]: INFO nova.compute.manager [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Took 0.87 seconds to detach 1 volumes for instance.
Oct 26 03:40:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-e1592c35-57bd-4af9-a55f-0c6cc84cc278 req-0e834ec2-87c3-405b-b757-ad3b3fb804a4 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:40:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e1592c35-57bd-4af9-a55f-0c6cc84cc278 req-0e834ec2-87c3-405b-b757-ad3b3fb804a4 service nova] Acquiring lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e1592c35-57bd-4af9-a55f-0c6cc84cc278 req-0e834ec2-87c3-405b-b757-ad3b3fb804a4 service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e1592c35-57bd-4af9-a55f-0c6cc84cc278 req-0e834ec2-87c3-405b-b757-ad3b3fb804a4 service nova] Lock "40316e54-eee2-4072-b436-4c5bb31724a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-e1592c35-57bd-4af9-a55f-0c6cc84cc278 req-0e834ec2-87c3-405b-b757-ad3b3fb804a4 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] No waiting events found dispatching network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:40:04 user nova-compute[74630]: WARNING nova.compute.manager [req-e1592c35-57bd-4af9-a55f-0c6cc84cc278 req-0e834ec2-87c3-405b-b757-ad3b3fb804a4 service nova] [instance: 40316e54-eee2-4072-b436-4c5bb31724a9] Received unexpected event network-vif-plugged-09559581-1c5c-4bee-90ea-fb70ae613d86 for instance with vm_state deleted and task_state None.
Oct 26 03:40:04 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:40:04 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:40:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:04 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Deleted allocations for instance 40316e54-eee2-4072-b436-4c5bb31724a9
Oct 26 03:40:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7b35e9c2-23ee-4769-acfd-42ff064e92e0 tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "40316e54-eee2-4072-b436-4c5bb31724a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.039s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:40:24 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:40:26 user nova-compute[74630]: INFO nova.compute.manager [None req-c773f1ab-961a-40d9-8a01-96da18ecb3fa tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Get console output
Oct 26 03:40:26 user nova-compute[74630]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 26 03:40:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:40:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:30 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:40:30 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:40:30 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:40:31 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:40:31 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:40:31 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:40:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:40:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:40:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:33 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:40:33 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:40:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8291MB free_disk=24.929237365722656GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:40:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:40:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:40:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e9b77844-67a8-4c26-90f2-afc1809b33d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:40:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 11c75096-6769-4f10-8515-c96b592958a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:40:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance c23e567d-8284-4039-b3af-5189d6ccdc80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:40:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:40:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:40:33 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:40:33 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:40:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:40:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:35 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:40:35 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:40:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-e9b77844-67a8-4c26-90f2-afc1809b33d1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:40:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-e9b77844-67a8-4c26-90f2-afc1809b33d1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:40:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:40:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "6f24bc2f-0ebe-4396-8092-e47359e487f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:40:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:36 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:40:36 user nova-compute[74630]: INFO nova.compute.claims [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Claim successful on node user
Oct 26 03:40:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Updating instance_info_cache with network_info: [{"id": "d789f079-694d-48c0-91ed-ae69fa259a1a", "address": "fa:16:3e:e1:1e:5c", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd789f079-69", "ovs_interfaceid": "d789f079-694d-48c0-91ed-ae69fa259a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:40:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-e9b77844-67a8-4c26-90f2-afc1809b33d1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:40:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:40:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG nova.network.neutron [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:40:37 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:40:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG nova.policy [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89f51acc12a54e7bbd38e975f2d7632e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f44335320f77434999514ed6824a2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:40:37 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Creating image(s)
Oct 26 03:40:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "/opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "/opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk 1073741824" returned: 0 in 0.057s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG nova.network.neutron [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Successfully created port: 589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Cannot resize image /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Ensure instance console log exists: /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG nova.network.neutron [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Successfully updated port: 589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquired lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG nova.network.neutron [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-0ee8d1b4-424b-417d-8308-db5b5811519d req-0958c303-d4f1-458e-858e-9f75952b2a8a service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received event network-changed-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-0ee8d1b4-424b-417d-8308-db5b5811519d req-0958c303-d4f1-458e-858e-9f75952b2a8a service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Refreshing instance network info cache due to event network-changed-589b5294-80b4-4245-88b8-ea2a3b0a2560. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0ee8d1b4-424b-417d-8308-db5b5811519d req-0958c303-d4f1-458e-858e-9f75952b2a8a service nova] Acquiring lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:40:38 user nova-compute[74630]: DEBUG nova.network.neutron [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.network.neutron [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Updating instance_info_cache with network_info: [{"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Releasing lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.compute.manager [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Instance network_info: |[{"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0ee8d1b4-424b-417d-8308-db5b5811519d req-0958c303-d4f1-458e-858e-9f75952b2a8a service nova] Acquired lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.network.neutron [req-0ee8d1b4-424b-417d-8308-db5b5811519d req-0958c303-d4f1-458e-858e-9f75952b2a8a service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Refreshing network info cache for port 589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Start _get_guest_xml network_info=[{"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:40:39 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:40:39 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1079081659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1079081659',id=36,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4pnXjePQKongg0073ePUq3elKsrVvcE0c6puyFMqhhc7dNiVqwmLETRyyKnopMZJ324XyvbebT/3iS0ew2/xmsVpLHHUPRLKIWUHbyzzDJsFfQClV/n9RroLJy7l6mcA==',key_name='tempest-keypair-1872227064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f44335320f77434999514ed6824a2e23',ramdisk_id='',reservation_id='r-7ajka82n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1268856411',owner_user_name='tempest-AttachVolumeShelveTestJSON-1268856411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:40:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f51acc12a54e7bbd38e975f2d7632e',uuid=6f24bc2f-0ebe-4396-8092-e47359e487f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converting VIF {"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=589b5294-80b4-4245-88b8-ea2a3b0a2560,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589b5294-80') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.objects.instance [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f24bc2f-0ebe-4396-8092-e47359e487f7 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:40:39 user nova-compute[74630]:   <uuid>6f24bc2f-0ebe-4396-8092-e47359e487f7</uuid>
Oct 26 03:40:39 user nova-compute[74630]:   <name>instance-00000024</name>
Oct 26 03:40:39 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:40:39 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:40:39 user nova-compute[74630]:   <metadata>
Oct 26 03:40:39 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:40:39 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:40:39 user nova-compute[74630]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1079081659</nova:name>
Oct 26 03:40:39 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:40:39</nova:creationTime>
Oct 26 03:40:39 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:40:39 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:40:39 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:40:39 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:40:39 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:40:39 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:40:39 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:40:39 user nova-compute[74630]:       <nova:owner>
Oct 26 03:40:39 user nova-compute[74630]:         <nova:user uuid="89f51acc12a54e7bbd38e975f2d7632e">tempest-AttachVolumeShelveTestJSON-1268856411-project-member</nova:user>
Oct 26 03:40:39 user nova-compute[74630]:         <nova:project uuid="f44335320f77434999514ed6824a2e23">tempest-AttachVolumeShelveTestJSON-1268856411</nova:project>
Oct 26 03:40:39 user nova-compute[74630]:       </nova:owner>
Oct 26 03:40:39 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:40:39 user nova-compute[74630]:       <nova:ports>
Oct 26 03:40:39 user nova-compute[74630]:         <nova:port uuid="589b5294-80b4-4245-88b8-ea2a3b0a2560">
Oct 26 03:40:39 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 03:40:39 user nova-compute[74630]:         </nova:port>
Oct 26 03:40:39 user nova-compute[74630]:       </nova:ports>
Oct 26 03:40:39 user nova-compute[74630]:     </nova:instance>
Oct 26 03:40:39 user nova-compute[74630]:   </metadata>
Oct 26 03:40:39 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:40:39 user nova-compute[74630]:     <system>
Oct 26 03:40:39 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:40:39 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:40:39 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:40:39 user nova-compute[74630]:       <entry name="serial">6f24bc2f-0ebe-4396-8092-e47359e487f7</entry>
Oct 26 03:40:39 user nova-compute[74630]:       <entry name="uuid">6f24bc2f-0ebe-4396-8092-e47359e487f7</entry>
Oct 26 03:40:39 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:40:39 user nova-compute[74630]:     </system>
Oct 26 03:40:39 user nova-compute[74630]:   </sysinfo>
Oct 26 03:40:39 user nova-compute[74630]:   <os>
Oct 26 03:40:39 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:40:39 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:40:39 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:40:39 user nova-compute[74630]:   </os>
Oct 26 03:40:39 user nova-compute[74630]:   <features>
Oct 26 03:40:39 user nova-compute[74630]:     <acpi/>
Oct 26 03:40:39 user nova-compute[74630]:     <apic/>
Oct 26 03:40:39 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:40:39 user nova-compute[74630]:   </features>
Oct 26 03:40:39 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:40:39 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:40:39 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:40:39 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:40:39 user nova-compute[74630]:   </clock>
Oct 26 03:40:39 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:40:39 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:40:39 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:40:39 user nova-compute[74630]:   </cpu>
Oct 26 03:40:39 user nova-compute[74630]:   <devices>
Oct 26 03:40:39 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:40:39 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:40:39 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk"/>
Oct 26 03:40:39 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:40:39 user nova-compute[74630]:     </disk>
Oct 26 03:40:39 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:40:39 user nova-compute[74630]:       <mac address="fa:16:3e:51:b4:36"/>
Oct 26 03:40:39 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:40:39 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:40:39 user nova-compute[74630]:       <target dev="tap589b5294-80"/>
Oct 26 03:40:39 user nova-compute[74630]:     </interface>
Oct 26 03:40:39 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:40:39 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/console.log" append="off"/>
Oct 26 03:40:39 user nova-compute[74630]:     </serial>
Oct 26 03:40:39 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:40:39 user nova-compute[74630]:     <video>
Oct 26 03:40:39 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:40:39 user nova-compute[74630]:     </video>
Oct 26 03:40:39 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:40:39 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:40:39 user nova-compute[74630]:     </rng>
Oct 26 03:40:39 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:40:39 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:40:39 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:40:39 user nova-compute[74630]:     </memballoon>
Oct 26 03:40:39 user nova-compute[74630]:   </devices>
Oct 26 03:40:39 user nova-compute[74630]: </domain>
Oct 26 03:40:39 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1079081659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1079081659',id=36,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4pnXjePQKongg0073ePUq3elKsrVvcE0c6puyFMqhhc7dNiVqwmLETRyyKnopMZJ324XyvbebT/3iS0ew2/xmsVpLHHUPRLKIWUHbyzzDJsFfQClV/n9RroLJy7l6mcA==',key_name='tempest-keypair-1872227064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f44335320f77434999514ed6824a2e23',ramdisk_id='',reservation_id='r-7ajka82n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1268856411',owner_user_name='tempest-AttachVolumeShelveTestJSON-1268856411-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:40:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f51acc12a54e7bbd38e975f2d7632e',uuid=6f24bc2f-0ebe-4396-8092-e47359e487f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converting VIF {"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=589b5294-80b4-4245-88b8-ea2a3b0a2560,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589b5294-80') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG os_vif [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=589b5294-80b4-4245-88b8-ea2a3b0a2560,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589b5294-80') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c41653ff-e38f-5d89-81bd-e315a01156cb', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap589b5294-80, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap589b5294-80, col_values=(('qos', UUID('f54dba6d-1b75-4eb5-9506-2762818d0a03')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap589b5294-80, col_values=(('external_ids', {'iface-id': '589b5294-80b4-4245-88b8-ea2a3b0a2560', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:b4:36', 'vm-uuid': '6f24bc2f-0ebe-4396-8092-e47359e487f7'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:39 user nova-compute[74630]: INFO os_vif [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=589b5294-80b4-4245-88b8-ea2a3b0a2560,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589b5294-80')
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] No VIF found with MAC fa:16:3e:51:b4:36, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.network.neutron [req-0ee8d1b4-424b-417d-8308-db5b5811519d req-0958c303-d4f1-458e-858e-9f75952b2a8a service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Updated VIF entry in instance network info cache for port 589b5294-80b4-4245-88b8-ea2a3b0a2560. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG nova.network.neutron [req-0ee8d1b4-424b-417d-8308-db5b5811519d req-0958c303-d4f1-458e-858e-9f75952b2a8a service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Updating instance_info_cache with network_info: [{"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:40:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0ee8d1b4-424b-417d-8308-db5b5811519d req-0958c303-d4f1-458e-858e-9f75952b2a8a service nova] Releasing lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:40:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-1813691f-01ca-42fc-b937-4400d910e211 req-316a7f4a-41c8-43a3-8dee-d0e03ed055f9 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received event network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:40:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1813691f-01ca-42fc-b937-4400d910e211 req-316a7f4a-41c8-43a3-8dee-d0e03ed055f9 service nova] Acquiring lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1813691f-01ca-42fc-b937-4400d910e211 req-316a7f4a-41c8-43a3-8dee-d0e03ed055f9 service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1813691f-01ca-42fc-b937-4400d910e211 req-316a7f4a-41c8-43a3-8dee-d0e03ed055f9 service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-1813691f-01ca-42fc-b937-4400d910e211 req-316a7f4a-41c8-43a3-8dee-d0e03ed055f9 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] No waiting events found dispatching network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:40:40 user nova-compute[74630]: WARNING nova.compute.manager [req-1813691f-01ca-42fc-b937-4400d910e211 req-316a7f4a-41c8-43a3-8dee-d0e03ed055f9 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received unexpected event network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 for instance with vm_state building and task_state spawning.
Oct 26 03:40:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:40:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:40:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Instance spawned successfully.
Oct 26 03:40:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:40:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:40:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:40:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:40:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:40:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:40:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:40:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-33c6f532-6502-4ff9-b771-61b0fcbd9952 req-82908cd6-0218-48b3-a297-b1929d606cfb service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received event network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:40:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-33c6f532-6502-4ff9-b771-61b0fcbd9952 req-82908cd6-0218-48b3-a297-b1929d606cfb service nova] Acquiring lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-33c6f532-6502-4ff9-b771-61b0fcbd9952 req-82908cd6-0218-48b3-a297-b1929d606cfb service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-33c6f532-6502-4ff9-b771-61b0fcbd9952 req-82908cd6-0218-48b3-a297-b1929d606cfb service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-33c6f532-6502-4ff9-b771-61b0fcbd9952 req-82908cd6-0218-48b3-a297-b1929d606cfb service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] No waiting events found dispatching network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:40:43 user nova-compute[74630]: WARNING nova.compute.manager [req-33c6f532-6502-4ff9-b771-61b0fcbd9952 req-82908cd6-0218-48b3-a297-b1929d606cfb service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received unexpected event network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 for instance with vm_state building and task_state spawning.
Oct 26 03:40:43 user nova-compute[74630]: INFO nova.compute.manager [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Took 5.68 seconds to spawn the instance on the hypervisor.
Oct 26 03:40:43 user nova-compute[74630]: DEBUG nova.compute.manager [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:40:43 user nova-compute[74630]: INFO nova.compute.manager [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Took 6.66 seconds to build instance.
Oct 26 03:40:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-504229e9-132a-4d88-a8bb-7cc86ac9acf0 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.785s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:40:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:40:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:40:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:40:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:40:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "fa1dd816-9dc1-4d48-b608-aa0218f22369" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "fa1dd816-9dc1-4d48-b608-aa0218f22369-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:52 user nova-compute[74630]: INFO nova.compute.manager [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Terminating instance
Oct 26 03:40:52 user nova-compute[74630]: DEBUG nova.compute.manager [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:40:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-86a059fc-e775-4435-b842-f8a897ae1993 req-630570dc-1efd-4744-bff2-4e5f976e277f service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Received event network-vif-unplugged-2f8d8a99-3185-41a0-b8a2-85b0c4d22003 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:40:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-86a059fc-e775-4435-b842-f8a897ae1993 req-630570dc-1efd-4744-bff2-4e5f976e277f service nova] Acquiring lock "fa1dd816-9dc1-4d48-b608-aa0218f22369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-86a059fc-e775-4435-b842-f8a897ae1993 req-630570dc-1efd-4744-bff2-4e5f976e277f service nova] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-86a059fc-e775-4435-b842-f8a897ae1993 req-630570dc-1efd-4744-bff2-4e5f976e277f service nova] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-86a059fc-e775-4435-b842-f8a897ae1993 req-630570dc-1efd-4744-bff2-4e5f976e277f service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] No waiting events found dispatching network-vif-unplugged-2f8d8a99-3185-41a0-b8a2-85b0c4d22003 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:40:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-86a059fc-e775-4435-b842-f8a897ae1993 req-630570dc-1efd-4744-bff2-4e5f976e277f service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Received event network-vif-unplugged-2f8d8a99-3185-41a0-b8a2-85b0c4d22003 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:53 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Instance destroyed successfully.
Oct 26 03:40:53 user nova-compute[74630]: DEBUG nova.objects.instance [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lazy-loading 'resources' on Instance uuid fa1dd816-9dc1-4d48-b608-aa0218f22369 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1294714524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1294714524',id=1,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:20:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e396316ddc243c594c29f5c434501cb',ramdisk_id='',reservation_id='r-iud0vxsh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:22:15Z,user_data=None,user_id='f8694c5db6e34f1e88595b55f8e5fe70',uuid=fa1dd816-9dc1-4d48-b608-aa0218f22369,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "address": "fa:16:3e:27:88:e1", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8d8a99-31", "ovs_interfaceid": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converting VIF {"id": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "address": "fa:16:3e:27:88:e1", "network": {"id": "e7889911-7965-4b0d-8f3c-0e7a51a52756", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1979929638-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e396316ddc243c594c29f5c434501cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f8d8a99-31", "ovs_interfaceid": "2f8d8a99-3185-41a0-b8a2-85b0c4d22003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:88:e1,bridge_name='br-int',has_traffic_filtering=True,id=2f8d8a99-3185-41a0-b8a2-85b0c4d22003,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8d8a99-31') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG os_vif [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:88:e1,bridge_name='br-int',has_traffic_filtering=True,id=2f8d8a99-3185-41a0-b8a2-85b0c4d22003,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8d8a99-31') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f8d8a99-31, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87b37f6e-a52d-4693-8a53-d7e99f63122c) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:40:53 user nova-compute[74630]: INFO os_vif [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:88:e1,bridge_name='br-int',has_traffic_filtering=True,id=2f8d8a99-3185-41a0-b8a2-85b0c4d22003,network=Network(e7889911-7965-4b0d-8f3c-0e7a51a52756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f8d8a99-31')
Oct 26 03:40:53 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Deleting instance files /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369_del
Oct 26 03:40:53 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Deletion of /opt/stack/data/nova/instances/fa1dd816-9dc1-4d48-b608-aa0218f22369_del complete
Oct 26 03:40:53 user nova-compute[74630]: INFO nova.compute.manager [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 26 03:40:53 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:40:53 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Took 0.51 seconds to deallocate network for instance.
Oct 26 03:40:53 user nova-compute[74630]: DEBUG nova.compute.manager [req-7e0c2ff5-450d-40c7-bc90-c5b47f7c8a7b req-59b15939-3d04-4e39-bd32-3effe6491001 service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Received event network-vif-deleted-2f8d8a99-3185-41a0-b8a2-85b0c4d22003 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:40:53 user nova-compute[74630]: INFO nova.compute.manager [req-7e0c2ff5-450d-40c7-bc90-c5b47f7c8a7b req-59b15939-3d04-4e39-bd32-3effe6491001 service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Neutron deleted interface 2f8d8a99-3185-41a0-b8a2-85b0c4d22003; detaching it from the instance and deleting it from the info cache
Oct 26 03:40:53 user nova-compute[74630]: DEBUG nova.network.neutron [req-7e0c2ff5-450d-40c7-bc90-c5b47f7c8a7b req-59b15939-3d04-4e39-bd32-3effe6491001 service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG nova.compute.manager [req-7e0c2ff5-450d-40c7-bc90-c5b47f7c8a7b req-59b15939-3d04-4e39-bd32-3effe6491001 service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Detach interface failed, port_id=2f8d8a99-3185-41a0-b8a2-85b0c4d22003, reason: Instance fa1dd816-9dc1-4d48-b608-aa0218f22369 could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:54 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Deleted allocations for instance fa1dd816-9dc1-4d48-b608-aa0218f22369
Oct 26 03:40:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "e9b77844-67a8-4c26-90f2-afc1809b33d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:54 user nova-compute[74630]: INFO nova.compute.manager [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Terminating instance
Oct 26 03:40:54 user nova-compute[74630]: DEBUG nova.compute.manager [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-28865169-80f3-4fa6-95bc-833e23b5b58c tempest-ServerBootFromVolumeStableRescueTest-1296515996 tempest-ServerBootFromVolumeStableRescueTest-1296515996-project-member] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.074s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG nova.compute.manager [req-c275971f-b6a9-4169-a286-d91221a05ea1 req-067fcf55-a61f-440e-87d7-272eb8ae9e2b service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Received event network-vif-unplugged-d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c275971f-b6a9-4169-a286-d91221a05ea1 req-067fcf55-a61f-440e-87d7-272eb8ae9e2b service nova] Acquiring lock "e9b77844-67a8-4c26-90f2-afc1809b33d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c275971f-b6a9-4169-a286-d91221a05ea1 req-067fcf55-a61f-440e-87d7-272eb8ae9e2b service nova] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c275971f-b6a9-4169-a286-d91221a05ea1 req-067fcf55-a61f-440e-87d7-272eb8ae9e2b service nova] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG nova.compute.manager [req-c275971f-b6a9-4169-a286-d91221a05ea1 req-067fcf55-a61f-440e-87d7-272eb8ae9e2b service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] No waiting events found dispatching network-vif-unplugged-d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:40:54 user nova-compute[74630]: DEBUG nova.compute.manager [req-c275971f-b6a9-4169-a286-d91221a05ea1 req-067fcf55-a61f-440e-87d7-272eb8ae9e2b service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Received event network-vif-unplugged-d789f079-694d-48c0-91ed-ae69fa259a1a for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-2f497c78-334b-451a-99d5-4db7c179453a req-73af32da-58d9-4964-b58e-c218e97f9c90 service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Received event network-vif-plugged-2f8d8a99-3185-41a0-b8a2-85b0c4d22003 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2f497c78-334b-451a-99d5-4db7c179453a req-73af32da-58d9-4964-b58e-c218e97f9c90 service nova] Acquiring lock "fa1dd816-9dc1-4d48-b608-aa0218f22369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2f497c78-334b-451a-99d5-4db7c179453a req-73af32da-58d9-4964-b58e-c218e97f9c90 service nova] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2f497c78-334b-451a-99d5-4db7c179453a req-73af32da-58d9-4964-b58e-c218e97f9c90 service nova] Lock "fa1dd816-9dc1-4d48-b608-aa0218f22369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-2f497c78-334b-451a-99d5-4db7c179453a req-73af32da-58d9-4964-b58e-c218e97f9c90 service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] No waiting events found dispatching network-vif-plugged-2f8d8a99-3185-41a0-b8a2-85b0c4d22003 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:40:55 user nova-compute[74630]: WARNING nova.compute.manager [req-2f497c78-334b-451a-99d5-4db7c179453a req-73af32da-58d9-4964-b58e-c218e97f9c90 service nova] [instance: fa1dd816-9dc1-4d48-b608-aa0218f22369] Received unexpected event network-vif-plugged-2f8d8a99-3185-41a0-b8a2-85b0c4d22003 for instance with vm_state deleted and task_state None.
Oct 26 03:40:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-2f497c78-334b-451a-99d5-4db7c179453a req-73af32da-58d9-4964-b58e-c218e97f9c90 service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Received event network-changed-d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-2f497c78-334b-451a-99d5-4db7c179453a req-73af32da-58d9-4964-b58e-c218e97f9c90 service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Refreshing instance network info cache due to event network-changed-d789f079-694d-48c0-91ed-ae69fa259a1a. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2f497c78-334b-451a-99d5-4db7c179453a req-73af32da-58d9-4964-b58e-c218e97f9c90 service nova] Acquiring lock "refresh_cache-e9b77844-67a8-4c26-90f2-afc1809b33d1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2f497c78-334b-451a-99d5-4db7c179453a req-73af32da-58d9-4964-b58e-c218e97f9c90 service nova] Acquired lock "refresh_cache-e9b77844-67a8-4c26-90f2-afc1809b33d1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG nova.network.neutron [req-2f497c78-334b-451a-99d5-4db7c179453a req-73af32da-58d9-4964-b58e-c218e97f9c90 service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Refreshing network info cache for port d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:40:55 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Instance destroyed successfully.
Oct 26 03:40:55 user nova-compute[74630]: DEBUG nova.objects.instance [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lazy-loading 'resources' on Instance uuid e9b77844-67a8-4c26-90f2-afc1809b33d1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-178489544',display_name='tempest-TestStampPattern-server-178489544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-178489544',id=29,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsUi1JFav2rUQ4amatuW91o6BTV1PUkbeAhUKUE9hmgaI99WgwyETHpA4Y+2RpaoFdsnsCe7I0YgyLj8QbS8GQub3NG5km5MaVTjvf64ODji9wzJUh+5eSPSYEe519qTQ==',key_name='tempest-TestStampPattern-1907926505',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:32:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3feb502c9d64505b7fc186fbd271f98',ramdisk_id='',reservation_id='r-u4sc53qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1086414073',owner_user_name='tempest-TestStampPattern-1086414073-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:36:21Z,user_data=None,user_id='2ecfe593558b4abc88818fd1cf7bbdb8',uuid=e9b77844-67a8-4c26-90f2-afc1809b33d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d789f079-694d-48c0-91ed-ae69fa259a1a", "address": "fa:16:3e:e1:1e:5c", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd789f079-69", "ovs_interfaceid": "d789f079-694d-48c0-91ed-ae69fa259a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Converting VIF {"id": "d789f079-694d-48c0-91ed-ae69fa259a1a", "address": "fa:16:3e:e1:1e:5c", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd789f079-69", "ovs_interfaceid": "d789f079-694d-48c0-91ed-ae69fa259a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=d789f079-694d-48c0-91ed-ae69fa259a1a,network=Network(2b989db0-17d0-4283-a2c4-84f29f5cf56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd789f079-69') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG os_vif [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=d789f079-694d-48c0-91ed-ae69fa259a1a,network=Network(2b989db0-17d0-4283-a2c4-84f29f5cf56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd789f079-69') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd789f079-69, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=769a2cc5-136f-4d55-a27a-429479126fd8) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:40:55 user nova-compute[74630]: INFO os_vif [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:1e:5c,bridge_name='br-int',has_traffic_filtering=True,id=d789f079-694d-48c0-91ed-ae69fa259a1a,network=Network(2b989db0-17d0-4283-a2c4-84f29f5cf56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd789f079-69')
Oct 26 03:40:55 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Deleting instance files /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1_del
Oct 26 03:40:55 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Deletion of /opt/stack/data/nova/instances/e9b77844-67a8-4c26-90f2-afc1809b33d1_del complete
Oct 26 03:40:55 user nova-compute[74630]: INFO nova.compute.manager [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 26 03:40:55 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG nova.network.neutron [req-2f497c78-334b-451a-99d5-4db7c179453a req-73af32da-58d9-4964-b58e-c218e97f9c90 service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Updated VIF entry in instance network info cache for port d789f079-694d-48c0-91ed-ae69fa259a1a. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG nova.network.neutron [req-2f497c78-334b-451a-99d5-4db7c179453a req-73af32da-58d9-4964-b58e-c218e97f9c90 service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Updating instance_info_cache with network_info: [{"id": "d789f079-694d-48c0-91ed-ae69fa259a1a", "address": "fa:16:3e:e1:1e:5c", "network": {"id": "2b989db0-17d0-4283-a2c4-84f29f5cf56f", "bridge": "br-int", "label": "tempest-TestStampPattern-926572405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3feb502c9d64505b7fc186fbd271f98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd789f079-69", "ovs_interfaceid": "d789f079-694d-48c0-91ed-ae69fa259a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2f497c78-334b-451a-99d5-4db7c179453a req-73af32da-58d9-4964-b58e-c218e97f9c90 service nova] Releasing lock "refresh_cache-e9b77844-67a8-4c26-90f2-afc1809b33d1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:40:55 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Took 0.56 seconds to deallocate network for instance.
Oct 26 03:40:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:56 user nova-compute[74630]: DEBUG nova.compute.manager [req-44761447-2838-4a4d-9d16-ae77c5332b64 req-27047f79-d402-476f-8a72-5d88ea2a8c48 service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Received event network-vif-deleted-d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:40:56 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:40:56 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:40:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:56 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Deleted allocations for instance e9b77844-67a8-4c26-90f2-afc1809b33d1
Oct 26 03:40:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31678535-8b97-4e11-bf76-93164204ff23 tempest-TestStampPattern-1086414073 tempest-TestStampPattern-1086414073-project-member] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.057s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:56 user nova-compute[74630]: DEBUG nova.compute.manager [req-bb9413f8-8e13-4653-9321-d18af48946ac req-ca97d418-d97b-4b48-9498-95b347d653bd service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Received event network-vif-plugged-d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:40:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bb9413f8-8e13-4653-9321-d18af48946ac req-ca97d418-d97b-4b48-9498-95b347d653bd service nova] Acquiring lock "e9b77844-67a8-4c26-90f2-afc1809b33d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:40:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bb9413f8-8e13-4653-9321-d18af48946ac req-ca97d418-d97b-4b48-9498-95b347d653bd service nova] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:40:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bb9413f8-8e13-4653-9321-d18af48946ac req-ca97d418-d97b-4b48-9498-95b347d653bd service nova] Lock "e9b77844-67a8-4c26-90f2-afc1809b33d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:40:56 user nova-compute[74630]: DEBUG nova.compute.manager [req-bb9413f8-8e13-4653-9321-d18af48946ac req-ca97d418-d97b-4b48-9498-95b347d653bd service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] No waiting events found dispatching network-vif-plugged-d789f079-694d-48c0-91ed-ae69fa259a1a {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:40:56 user nova-compute[74630]: WARNING nova.compute.manager [req-bb9413f8-8e13-4653-9321-d18af48946ac req-ca97d418-d97b-4b48-9498-95b347d653bd service nova] [instance: e9b77844-67a8-4c26-90f2-afc1809b33d1] Received unexpected event network-vif-plugged-d789f079-694d-48c0-91ed-ae69fa259a1a for instance with vm_state deleted and task_state None.
Oct 26 03:40:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:41:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 03:41:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] There are 0 instances to clean {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 03:41:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:24 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:41:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "11c75096-6769-4f10-8515-c96b592958a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:27 user nova-compute[74630]: INFO nova.compute.manager [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Terminating instance
Oct 26 03:41:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-34417399-8305-460b-a59e-3fc513db88d1 req-2af8e887-dba0-48d2-ae47-afd0906c7020 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Received event network-changed-b93b79db-e438-4365-98e8-04df7ba83fb0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-34417399-8305-460b-a59e-3fc513db88d1 req-2af8e887-dba0-48d2-ae47-afd0906c7020 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Refreshing instance network info cache due to event network-changed-b93b79db-e438-4365-98e8-04df7ba83fb0. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-34417399-8305-460b-a59e-3fc513db88d1 req-2af8e887-dba0-48d2-ae47-afd0906c7020 service nova] Acquiring lock "refresh_cache-c23e567d-8284-4039-b3af-5189d6ccdc80" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-34417399-8305-460b-a59e-3fc513db88d1 req-2af8e887-dba0-48d2-ae47-afd0906c7020 service nova] Acquired lock "refresh_cache-c23e567d-8284-4039-b3af-5189d6ccdc80" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG nova.network.neutron [req-34417399-8305-460b-a59e-3fc513db88d1 req-2af8e887-dba0-48d2-ae47-afd0906c7020 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Refreshing network info cache for port b93b79db-e438-4365-98e8-04df7ba83fb0 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-3c66673f-6a9c-42dc-8b9b-04a897263522 req-381b21eb-38df-467f-8b1f-58501d7b80e2 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-vif-unplugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3c66673f-6a9c-42dc-8b9b-04a897263522 req-381b21eb-38df-467f-8b1f-58501d7b80e2 service nova] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3c66673f-6a9c-42dc-8b9b-04a897263522 req-381b21eb-38df-467f-8b1f-58501d7b80e2 service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3c66673f-6a9c-42dc-8b9b-04a897263522 req-381b21eb-38df-467f-8b1f-58501d7b80e2 service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-3c66673f-6a9c-42dc-8b9b-04a897263522 req-381b21eb-38df-467f-8b1f-58501d7b80e2 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] No waiting events found dispatching network-vif-unplugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-3c66673f-6a9c-42dc-8b9b-04a897263522 req-381b21eb-38df-467f-8b1f-58501d7b80e2 service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-vif-unplugged-3c4b3126-d447-40d7-821e-2395434c6d58 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:28 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Instance destroyed successfully.
Oct 26 03:41:28 user nova-compute[74630]: DEBUG nova.objects.instance [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lazy-loading 'resources' on Instance uuid 11c75096-6769-4f10-8515-c96b592958a6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:34:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1119894',display_name='tempest-ServerActionsTestOtherA-server-1119894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1119894',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwoLYfCM8lwvIIEciV36xGOUw+XalItY+5dZPbHAKn3DqpiwNygwALzSy5pOoP4seOCkowdcCG1fNBC8K731mmxBiQFtvBIY61aup2H6JCAGn52TG97PQD1ZIY1c0HtiA==',key_name='tempest-keypair-1565174322',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:37:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51542ffdf7a84ac5a61f14e124eb2087',ramdisk_id='',reservation_id='r-o5vn07pm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-41539930',owner_user_name='tempest-ServerActionsTestOtherA-41539930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a419737713f4797ab27db62d5aa746c',uuid=11c75096-6769-4f10-8515-c96b592958a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converting VIF {"id": "3c4b3126-d447-40d7-821e-2395434c6d58", "address": "fa:16:3e:32:fd:96", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c4b3126-d4", "ovs_interfaceid": "3c4b3126-d447-40d7-821e-2395434c6d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:fd:96,bridge_name='br-int',has_traffic_filtering=True,id=3c4b3126-d447-40d7-821e-2395434c6d58,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4b3126-d4') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_vif [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:fd:96,bridge_name='br-int',has_traffic_filtering=True,id=3c4b3126-d447-40d7-821e-2395434c6d58,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4b3126-d4') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c4b3126-d4, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e12c847-d3b7-497f-a1a8-a01224087581) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:28 user nova-compute[74630]: INFO os_vif [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:fd:96,bridge_name='br-int',has_traffic_filtering=True,id=3c4b3126-d447-40d7-821e-2395434c6d58,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c4b3126-d4')
Oct 26 03:41:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncIyXWaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:41:28 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG nova.network.neutron [req-34417399-8305-460b-a59e-3fc513db88d1 req-2af8e887-dba0-48d2-ae47-afd0906c7020 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Updated VIF entry in instance network info cache for port b93b79db-e438-4365-98e8-04df7ba83fb0. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG nova.network.neutron [req-34417399-8305-460b-a59e-3fc513db88d1 req-2af8e887-dba0-48d2-ae47-afd0906c7020 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Updating instance_info_cache with network_info: [{"id": "b93b79db-e438-4365-98e8-04df7ba83fb0", "address": "fa:16:3e:80:e0:5a", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93b79db-e4", "ovs_interfaceid": "b93b79db-e438-4365-98e8-04df7ba83fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b5190c-2221-43d3-a227-b4cbeffe62e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:41:28 user nova-compute[74630]: No targets found.
Oct 26 03:41:28 user nova-compute[74630]: iSNS:
Oct 26 03:41:28 user nova-compute[74630]: No targets found.
Oct 26 03:41:28 user nova-compute[74630]: STATIC:
Oct 26 03:41:28 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794
Oct 26 03:41:28 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:41:28 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:41:28 user nova-compute[74630]: FIRMWARE:
Oct 26 03:41:28 user nova-compute[74630]: No targets found.
Oct 26 03:41:28 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:41:28 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:41:28 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-34417399-8305-460b-a59e-3fc513db88d1 req-2af8e887-dba0-48d2-ae47-afd0906c7020 service nova] Releasing lock "refresh_cache-c23e567d-8284-4039-b3af-5189d6ccdc80" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e345d98a-4cde-4a1d-a8a6-21fe2f9199b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee341a8-f1c1-4053-b10e-af3bb1b5368f]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:41:28 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 (non-flash)
Oct 26 03:41:28 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f315c779870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794'): ({'sdd'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Removing single pathed devices sdd {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[909f6b93-d49c-4d11-ba71-775136237a02]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[564b8211-6b2d-49a3-be2b-fd75d264a61b]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Flushing IO for device /dev/sdd {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a208648b-3536-4627-8280-8cb107efad08]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca7b3c8-3324-4c80-b474-50a6b3967b7e]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d34368-cafb-431b-b3cb-d89bfca4a61d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c8983e-42e3-46e2-9dd0-de45f188c353]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260]
Oct 26 03:41:28 user nova-compute[74630]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794, portal: 172.16.0.220,3260] successful.
Oct 26 03:41:28 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b57f591-6788-40fb-b889-6c0117ae1794 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef7106c-65f8-46eb-b682-5a412ec2faaf]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] <== disconnect_volume: return (345ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:41:28 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Deleting instance files /opt/stack/data/nova/instances/11c75096-6769-4f10-8515-c96b592958a6_del
Oct 26 03:41:28 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Deletion of /opt/stack/data/nova/instances/11c75096-6769-4f10-8515-c96b592958a6_del complete
Oct 26 03:41:28 user nova-compute[74630]: INFO nova.compute.manager [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Took 1.26 seconds to destroy the instance on the hypervisor.
Oct 26 03:41:28 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 11c75096-6769-4f10-8515-c96b592958a6] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:41:29 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Took 0.84 seconds to deallocate network for instance.
Oct 26 03:41:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-d3f24e24-7c76-48aa-8ff4-a5850bfa6e70 req-30df4e54-6c88-4348-b308-3204f8298b7e service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-vif-deleted-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] No waiting events found dispatching network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:41:29 user nova-compute[74630]: WARNING nova.compute.manager [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received unexpected event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 for instance with vm_state active and task_state deleting.
Oct 26 03:41:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] No waiting events found dispatching network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:41:29 user nova-compute[74630]: WARNING nova.compute.manager [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received unexpected event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 for instance with vm_state active and task_state deleting.
Oct 26 03:41:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] No waiting events found dispatching network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:41:29 user nova-compute[74630]: WARNING nova.compute.manager [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received unexpected event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 for instance with vm_state active and task_state deleting.
Oct 26 03:41:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-vif-unplugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] No waiting events found dispatching network-vif-unplugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-vif-unplugged-3c4b3126-d447-40d7-821e-2395434c6d58 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] Acquiring lock "11c75096-6769-4f10-8515-c96b592958a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] Lock "11c75096-6769-4f10-8515-c96b592958a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] No waiting events found dispatching network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:41:29 user nova-compute[74630]: WARNING nova.compute.manager [req-77a5e50c-f11f-4211-9b1f-e7a5f29a3703 req-2389ecf2-f4d4-47e9-8d93-a8189876dbaf service nova] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Received unexpected event network-vif-plugged-3c4b3126-d447-40d7-821e-2395434c6d58 for instance with vm_state active and task_state deleting.
Oct 26 03:41:30 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:41:30 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:41:30 user nova-compute[74630]: INFO nova.compute.manager [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Took 0.96 seconds to detach 1 volumes for instance.
Oct 26 03:41:30 user nova-compute[74630]: DEBUG nova.compute.manager [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: 11c75096-6769-4f10-8515-c96b592958a6] Deleting volume: 1b57f591-6788-40fb-b889-6c0117ae1794 {{(pid=74630) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 03:41:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:30 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:41:30 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:41:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:30 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Deleted allocations for instance 11c75096-6769-4f10-8515-c96b592958a6
Oct 26 03:41:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-68848792-2249-407a-8b2a-36701150ad33 tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "11c75096-6769-4f10-8515-c96b592958a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.543s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:31 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:41:31 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:41:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:31 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:41:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:32 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:32 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:41:32 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:41:32 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8453MB free_disk=25.139598846435547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:41:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:32 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9890dde-e678-41d4-8447-24bf626c2983 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:41:32 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance c23e567d-8284-4039-b3af-5189d6ccdc80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:41:32 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 6f24bc2f-0ebe-4396-8092-e47359e487f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:41:32 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:41:32 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "c23e567d-8284-4039-b3af-5189d6ccdc80" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG nova.objects.instance [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'flavor' on Instance uuid c23e567d-8284-4039-b3af-5189d6ccdc80 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "c23e567d-8284-4039-b3af-5189d6ccdc80" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:33 user nova-compute[74630]: INFO nova.compute.manager [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Attaching volume 08c8af4f-b40c-4c07-bef3-f8ea7e067e13 to /dev/vdb
Oct 26 03:41:33 user nova-compute[74630]: DEBUG os_brick.utils [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7dfcb4-7eeb-4fa6-b5b5-e1bc0b5a7cd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf6cd0d-d29f-40ae-837c-5f715ac5fb99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f1d853-3aed-453f-8f1a-847042fea378]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[950c7bd1-83a0-4d2d-b0b6-000da98cbe33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:41:33 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:41:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb74638-42ea-435d-acf1-fbe7dbe0df52]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG os_brick.utils [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Updating existing volume attachment record: 39c8b87d-109f-4bcf-8958-b8ed127c41f9 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:34 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:41:34 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:41:34 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:41:34 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 03:41:34 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:41:34 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74630) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 03:41:35 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:41:38 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:41:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:41 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:41:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Acquiring lock "e7ca45f7-c3c0-454f-b77e-465c4d804661" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "e7ca45f7-c3c0-454f-b77e-465c4d804661" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:52 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:41:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:52 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:41:52 user nova-compute[74630]: INFO nova.compute.claims [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Claim successful on node user
Oct 26 03:41:52 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Refreshing inventories for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 03:41:52 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Updating ProviderTree inventory for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 03:41:52 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Updating inventory in ProviderTree for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 03:41:52 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Refreshing aggregate associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, aggregates: None {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 03:41:52 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Refreshing trait associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, traits: HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 03:41:52 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:41:52 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:41:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:52 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:41:52 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:41:52 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:41:52 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:41:52 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG nova.policy [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dabd935281a74c1796c7c9108f6445bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df37ca5f0923438cb0db3771a979daa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:41:53 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Creating image(s)
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "/opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "/opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.258s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.222s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzLOWkae', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:41:53 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:41:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:41:53 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:41:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:41:53 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk 1073741824" returned: 0 in 0.065s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[154cefe1-bad1-45c6-8ef2-53564f179b6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:41:53 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27914d4-2d03-4324-88be-38189929e3d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13] added
Oct 26 03:41:53 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8554ad2b-ed0f-4fef-952b-81ed9baf7944]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[be035499-0050-4575-a927-297e88bc57f1]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xzLOWkae {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xzLOWkae" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5c76b1-7fbd-4753-8521-483fb1da3fcd]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xzLOWkae'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba39103-90cf-4dfd-ab25-75c3910c8437]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b251853-fb22-4a73-b5ad-5ccac056ece2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 03:41:53 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 03:41:53 user nova-compute[74630]:  {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:41:53 user nova-compute[74630]: WARNING os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 03:41:53 user nova-compute[74630]: 
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.206s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[17079422-7e3e-43d2-b906-59d31b0e9f4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13, portal: 172.16.0.220,3260]
Oct 26 03:41:53 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13, portal: 172.16.0.220,3260] successful.
Oct 26 03:41:53 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4127a009-a6dc-4a31-bce2-8af7b4518138]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:41:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7f4b9b-8100-4358-94bb-41ec99942386]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 (non-flash)
Oct 26 03:41:54 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 (non-flash)
Oct 26 03:41:54 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb301d9-076b-462c-a82a-4d3ff6019a1a]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzLOWkae', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Cannot resize image /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Ensure instance console log exists: /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:54 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Successfully created port: 83101951-90e2-4167-a52a-2b09bce51027 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26131336234633761', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131336234633761', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG nova.objects.instance [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'flavor' on Instance uuid c23e567d-8284-4039-b3af-5189d6ccdc80 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:41:55 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:41:55 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 03:41:55 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:41:55 user nova-compute[74630]:   <serial>08c8af4f-b40c-4c07-bef3-f8ea7e067e13</serial>
Oct 26 03:41:55 user nova-compute[74630]: </disk>
Oct 26 03:41:55 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No VIF found with MAC fa:16:3e:80:e0:5a, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Successfully updated port: 83101951-90e2-4167-a52a-2b09bce51027 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Acquiring lock "refresh_cache-e7ca45f7-c3c0-454f-b77e-465c4d804661" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Acquired lock "refresh_cache-e7ca45f7-c3c0-454f-b77e-465c4d804661" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-362d6685-b9fa-4ef2-8a60-9a512afe540d req-41bd82bf-a127-4237-a708-041269518554 service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Received event network-changed-83101951-90e2-4167-a52a-2b09bce51027 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-362d6685-b9fa-4ef2-8a60-9a512afe540d req-41bd82bf-a127-4237-a708-041269518554 service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Refreshing instance network info cache due to event network-changed-83101951-90e2-4167-a52a-2b09bce51027. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-362d6685-b9fa-4ef2-8a60-9a512afe540d req-41bd82bf-a127-4237-a708-041269518554 service nova] Acquiring lock "refresh_cache-e7ca45f7-c3c0-454f-b77e-465c4d804661" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-31f3c886-30c4-421d-91e9-40621a002f0e tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.465s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Updating instance_info_cache with network_info: [{"id": "83101951-90e2-4167-a52a-2b09bce51027", "address": "fa:16:3e:1a:aa:3b", "network": {"id": "42c4178a-4a05-4b0e-a0f6-1f5310fe8927", "bridge": "br-int", "label": "tempest-VolumesActionsTest-192494792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df37ca5f0923438cb0db3771a979daa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83101951-90", "ovs_interfaceid": "83101951-90e2-4167-a52a-2b09bce51027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Releasing lock "refresh_cache-e7ca45f7-c3c0-454f-b77e-465c4d804661" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Instance network_info: |[{"id": "83101951-90e2-4167-a52a-2b09bce51027", "address": "fa:16:3e:1a:aa:3b", "network": {"id": "42c4178a-4a05-4b0e-a0f6-1f5310fe8927", "bridge": "br-int", "label": "tempest-VolumesActionsTest-192494792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df37ca5f0923438cb0db3771a979daa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83101951-90", "ovs_interfaceid": "83101951-90e2-4167-a52a-2b09bce51027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-362d6685-b9fa-4ef2-8a60-9a512afe540d req-41bd82bf-a127-4237-a708-041269518554 service nova] Acquired lock "refresh_cache-e7ca45f7-c3c0-454f-b77e-465c4d804661" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.network.neutron [req-362d6685-b9fa-4ef2-8a60-9a512afe540d req-41bd82bf-a127-4237-a708-041269518554 service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Refreshing network info cache for port 83101951-90e2-4167-a52a-2b09bce51027 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Start _get_guest_xml network_info=[{"id": "83101951-90e2-4167-a52a-2b09bce51027", "address": "fa:16:3e:1a:aa:3b", "network": {"id": "42c4178a-4a05-4b0e-a0f6-1f5310fe8927", "bridge": "br-int", "label": "tempest-VolumesActionsTest-192494792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df37ca5f0923438cb0db3771a979daa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83101951-90", "ovs_interfaceid": "83101951-90e2-4167-a52a-2b09bce51027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:41:56 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:41:56 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-60809324',display_name='tempest-VolumesActionsTest-instance-60809324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-60809324',id=37,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df37ca5f0923438cb0db3771a979daa4',ramdisk_id='',reservation_id='r-cjs8sode',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-733929121',owner_user_name='tempest-VolumesActionsTest-733929121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:41:53Z,user_data=None,user_id='dabd935281a74c1796c7c9108f6445bd',uuid=e7ca45f7-c3c0-454f-b77e-465c4d804661,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83101951-90e2-4167-a52a-2b09bce51027", "address": "fa:16:3e:1a:aa:3b", "network": {"id": "42c4178a-4a05-4b0e-a0f6-1f5310fe8927", "bridge": "br-int", "label": "tempest-VolumesActionsTest-192494792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df37ca5f0923438cb0db3771a979daa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83101951-90", "ovs_interfaceid": "83101951-90e2-4167-a52a-2b09bce51027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Converting VIF {"id": "83101951-90e2-4167-a52a-2b09bce51027", "address": "fa:16:3e:1a:aa:3b", "network": {"id": "42c4178a-4a05-4b0e-a0f6-1f5310fe8927", "bridge": "br-int", "label": "tempest-VolumesActionsTest-192494792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df37ca5f0923438cb0db3771a979daa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83101951-90", "ovs_interfaceid": "83101951-90e2-4167-a52a-2b09bce51027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:aa:3b,bridge_name='br-int',has_traffic_filtering=True,id=83101951-90e2-4167-a52a-2b09bce51027,network=Network(42c4178a-4a05-4b0e-a0f6-1f5310fe8927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83101951-90') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lazy-loading 'pci_devices' on Instance uuid e7ca45f7-c3c0-454f-b77e-465c4d804661 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:41:56 user nova-compute[74630]:   <uuid>e7ca45f7-c3c0-454f-b77e-465c4d804661</uuid>
Oct 26 03:41:56 user nova-compute[74630]:   <name>instance-00000025</name>
Oct 26 03:41:56 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:41:56 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:41:56 user nova-compute[74630]:   <metadata>
Oct 26 03:41:56 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:41:56 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:41:56 user nova-compute[74630]:       <nova:name>tempest-VolumesActionsTest-instance-60809324</nova:name>
Oct 26 03:41:56 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:41:56</nova:creationTime>
Oct 26 03:41:56 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:41:56 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:41:56 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:41:56 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:41:56 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:41:56 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:41:56 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:41:56 user nova-compute[74630]:       <nova:owner>
Oct 26 03:41:56 user nova-compute[74630]:         <nova:user uuid="dabd935281a74c1796c7c9108f6445bd">tempest-VolumesActionsTest-733929121-project-member</nova:user>
Oct 26 03:41:56 user nova-compute[74630]:         <nova:project uuid="df37ca5f0923438cb0db3771a979daa4">tempest-VolumesActionsTest-733929121</nova:project>
Oct 26 03:41:56 user nova-compute[74630]:       </nova:owner>
Oct 26 03:41:56 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:41:56 user nova-compute[74630]:       <nova:ports>
Oct 26 03:41:56 user nova-compute[74630]:         <nova:port uuid="83101951-90e2-4167-a52a-2b09bce51027">
Oct 26 03:41:56 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 03:41:56 user nova-compute[74630]:         </nova:port>
Oct 26 03:41:56 user nova-compute[74630]:       </nova:ports>
Oct 26 03:41:56 user nova-compute[74630]:     </nova:instance>
Oct 26 03:41:56 user nova-compute[74630]:   </metadata>
Oct 26 03:41:56 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:41:56 user nova-compute[74630]:     <system>
Oct 26 03:41:56 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:41:56 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:41:56 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:41:56 user nova-compute[74630]:       <entry name="serial">e7ca45f7-c3c0-454f-b77e-465c4d804661</entry>
Oct 26 03:41:56 user nova-compute[74630]:       <entry name="uuid">e7ca45f7-c3c0-454f-b77e-465c4d804661</entry>
Oct 26 03:41:56 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:41:56 user nova-compute[74630]:     </system>
Oct 26 03:41:56 user nova-compute[74630]:   </sysinfo>
Oct 26 03:41:56 user nova-compute[74630]:   <os>
Oct 26 03:41:56 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:41:56 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:41:56 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:41:56 user nova-compute[74630]:   </os>
Oct 26 03:41:56 user nova-compute[74630]:   <features>
Oct 26 03:41:56 user nova-compute[74630]:     <acpi/>
Oct 26 03:41:56 user nova-compute[74630]:     <apic/>
Oct 26 03:41:56 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:41:56 user nova-compute[74630]:   </features>
Oct 26 03:41:56 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:41:56 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:41:56 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:41:56 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:41:56 user nova-compute[74630]:   </clock>
Oct 26 03:41:56 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:41:56 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:41:56 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:41:56 user nova-compute[74630]:   </cpu>
Oct 26 03:41:56 user nova-compute[74630]:   <devices>
Oct 26 03:41:56 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:41:56 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:41:56 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk"/>
Oct 26 03:41:56 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:41:56 user nova-compute[74630]:     </disk>
Oct 26 03:41:56 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:41:56 user nova-compute[74630]:       <mac address="fa:16:3e:1a:aa:3b"/>
Oct 26 03:41:56 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:41:56 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:41:56 user nova-compute[74630]:       <target dev="tap83101951-90"/>
Oct 26 03:41:56 user nova-compute[74630]:     </interface>
Oct 26 03:41:56 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:41:56 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/console.log" append="off"/>
Oct 26 03:41:56 user nova-compute[74630]:     </serial>
Oct 26 03:41:56 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:41:56 user nova-compute[74630]:     <video>
Oct 26 03:41:56 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:41:56 user nova-compute[74630]:     </video>
Oct 26 03:41:56 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:41:56 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:41:56 user nova-compute[74630]:     </rng>
Oct 26 03:41:56 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:41:56 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:41:56 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:41:56 user nova-compute[74630]:     </memballoon>
Oct 26 03:41:56 user nova-compute[74630]:   </devices>
Oct 26 03:41:56 user nova-compute[74630]: </domain>
Oct 26 03:41:56 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-60809324',display_name='tempest-VolumesActionsTest-instance-60809324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-60809324',id=37,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df37ca5f0923438cb0db3771a979daa4',ramdisk_id='',reservation_id='r-cjs8sode',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-733929121',owner_user_name='tempest-VolumesActionsTest-733929121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:41:53Z,user_data=None,user_id='dabd935281a74c1796c7c9108f6445bd',uuid=e7ca45f7-c3c0-454f-b77e-465c4d804661,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83101951-90e2-4167-a52a-2b09bce51027", "address": "fa:16:3e:1a:aa:3b", "network": {"id": "42c4178a-4a05-4b0e-a0f6-1f5310fe8927", "bridge": "br-int", "label": "tempest-VolumesActionsTest-192494792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df37ca5f0923438cb0db3771a979daa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83101951-90", "ovs_interfaceid": "83101951-90e2-4167-a52a-2b09bce51027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Converting VIF {"id": "83101951-90e2-4167-a52a-2b09bce51027", "address": "fa:16:3e:1a:aa:3b", "network": {"id": "42c4178a-4a05-4b0e-a0f6-1f5310fe8927", "bridge": "br-int", "label": "tempest-VolumesActionsTest-192494792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df37ca5f0923438cb0db3771a979daa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83101951-90", "ovs_interfaceid": "83101951-90e2-4167-a52a-2b09bce51027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:aa:3b,bridge_name='br-int',has_traffic_filtering=True,id=83101951-90e2-4167-a52a-2b09bce51027,network=Network(42c4178a-4a05-4b0e-a0f6-1f5310fe8927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83101951-90') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG os_vif [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:aa:3b,bridge_name='br-int',has_traffic_filtering=True,id=83101951-90e2-4167-a52a-2b09bce51027,network=Network(42c4178a-4a05-4b0e-a0f6-1f5310fe8927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83101951-90') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38e89870-25d9-5294-ab77-e7a48babdc8d', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83101951-90, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83101951-90, col_values=(('qos', UUID('7a287928-d719-4e3c-a736-448952e5d283')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83101951-90, col_values=(('external_ids', {'iface-id': '83101951-90e2-4167-a52a-2b09bce51027', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:aa:3b', 'vm-uuid': 'e7ca45f7-c3c0-454f-b77e-465c4d804661'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:56 user nova-compute[74630]: INFO os_vif [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:aa:3b,bridge_name='br-int',has_traffic_filtering=True,id=83101951-90e2-4167-a52a-2b09bce51027,network=Network(42c4178a-4a05-4b0e-a0f6-1f5310fe8927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83101951-90')
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] No VIF found with MAC fa:16:3e:1a:aa:3b, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "c23e567d-8284-4039-b3af-5189d6ccdc80" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.network.neutron [req-362d6685-b9fa-4ef2-8a60-9a512afe540d req-41bd82bf-a127-4237-a708-041269518554 service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Updated VIF entry in instance network info cache for port 83101951-90e2-4167-a52a-2b09bce51027. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.network.neutron [req-362d6685-b9fa-4ef2-8a60-9a512afe540d req-41bd82bf-a127-4237-a708-041269518554 service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Updating instance_info_cache with network_info: [{"id": "83101951-90e2-4167-a52a-2b09bce51027", "address": "fa:16:3e:1a:aa:3b", "network": {"id": "42c4178a-4a05-4b0e-a0f6-1f5310fe8927", "bridge": "br-int", "label": "tempest-VolumesActionsTest-192494792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df37ca5f0923438cb0db3771a979daa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83101951-90", "ovs_interfaceid": "83101951-90e2-4167-a52a-2b09bce51027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:41:56 user nova-compute[74630]: INFO nova.compute.manager [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Detaching volume 08c8af4f-b40c-4c07-bef3-f8ea7e067e13
Oct 26 03:41:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-362d6685-b9fa-4ef2-8a60-9a512afe540d req-41bd82bf-a127-4237-a708-041269518554 service nova] Releasing lock "refresh_cache-e7ca45f7-c3c0-454f-b77e-465c4d804661" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:41:56 user nova-compute[74630]: INFO nova.virt.block_device [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Attempting to driver detach volume 08c8af4f-b40c-4c07-bef3-f8ea7e067e13 from mountpoint /dev/vdb
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Attempting to detach device vdb from instance c23e567d-8284-4039-b3af-5189d6ccdc80 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:41:56 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:41:56 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 03:41:56 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:41:56 user nova-compute[74630]:   <serial>08c8af4f-b40c-4c07-bef3-f8ea7e067e13</serial>
Oct 26 03:41:56 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:41:56 user nova-compute[74630]: </disk>
Oct 26 03:41:56 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:41:56 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Successfully detached device vdb from instance c23e567d-8284-4039-b3af-5189d6ccdc80 from the persistent domain config.
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c23e567d-8284-4039-b3af-5189d6ccdc80 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:41:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:41:56 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:41:56 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 03:41:56 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:41:56 user nova-compute[74630]:   <serial>08c8af4f-b40c-4c07-bef3-f8ea7e067e13</serial>
Oct 26 03:41:56 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:41:56 user nova-compute[74630]: </disk>
Oct 26 03:41:56 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:41:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c23e567d-8284-4039-b3af-5189d6ccdc80 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:41:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:41:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:41:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:41:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:41:59 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:41:59 user nova-compute[74630]: INFO nova.compute.claims [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Claim successful on node user
Oct 26 03:41:59 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:41:59 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:41:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:41:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:41:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:41:59 user nova-compute[74630]: DEBUG nova.network.neutron [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:41:59 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:41:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG nova.policy [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2adadef6a5a8437b8ee3931cbeff5467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671ecf470da4c5093899caa0e5b8313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:42:00 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Creating image(s)
Oct 26 03:42:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "/opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "/opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "/opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.219s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.211s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk 1073741824" returned: 0 in 0.061s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:42:00 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Instance spawned successfully.
Oct 26 03:42:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.201s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Checking if we can resize image /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Successfully created port: 9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:42:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:42:00 user nova-compute[74630]: INFO nova.compute.manager [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Took 7.85 seconds to spawn the instance on the hypervisor.
Oct 26 03:42:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:42:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-5b4e9adf-0fc8-4368-8d47-2f01d38bfa98 req-c386daef-b714-4a99-a061-5a7b0f92028b service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Received event network-vif-plugged-83101951-90e2-4167-a52a-2b09bce51027 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:42:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5b4e9adf-0fc8-4368-8d47-2f01d38bfa98 req-c386daef-b714-4a99-a061-5a7b0f92028b service nova] Acquiring lock "e7ca45f7-c3c0-454f-b77e-465c4d804661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5b4e9adf-0fc8-4368-8d47-2f01d38bfa98 req-c386daef-b714-4a99-a061-5a7b0f92028b service nova] Lock "e7ca45f7-c3c0-454f-b77e-465c4d804661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5b4e9adf-0fc8-4368-8d47-2f01d38bfa98 req-c386daef-b714-4a99-a061-5a7b0f92028b service nova] Lock "e7ca45f7-c3c0-454f-b77e-465c4d804661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-5b4e9adf-0fc8-4368-8d47-2f01d38bfa98 req-c386daef-b714-4a99-a061-5a7b0f92028b service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] No waiting events found dispatching network-vif-plugged-83101951-90e2-4167-a52a-2b09bce51027 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:42:01 user nova-compute[74630]: WARNING nova.compute.manager [req-5b4e9adf-0fc8-4368-8d47-2f01d38bfa98 req-c386daef-b714-4a99-a061-5a7b0f92028b service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Received unexpected event network-vif-plugged-83101951-90e2-4167-a52a-2b09bce51027 for instance with vm_state building and task_state spawning.
Oct 26 03:42:01 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:01 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Cannot resize image /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:42:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:42:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Ensure instance console log exists: /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:42:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:01 user nova-compute[74630]: INFO nova.compute.manager [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Took 9.00 seconds to build instance.
Oct 26 03:42:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b72b18f3-b8ca-46fe-8e1d-057dd8d0ced6 tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "e7ca45f7-c3c0-454f-b77e-465c4d804661" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.142s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Successfully updated port: 9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquired lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-8cf0c037-6efd-4074-b8ed-84fb2e1650f9 req-47b58146-3916-4f78-a9f3-4cd656c2c419 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-changed-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-8cf0c037-6efd-4074-b8ed-84fb2e1650f9 req-47b58146-3916-4f78-a9f3-4cd656c2c419 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Refreshing instance network info cache due to event network-changed-9e37d096-7f88-44a3-829f-e02f76065b09. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8cf0c037-6efd-4074-b8ed-84fb2e1650f9 req-47b58146-3916-4f78-a9f3-4cd656c2c419 service nova] Acquiring lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updating instance_info_cache with network_info: [{"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Releasing lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.compute.manager [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Instance network_info: |[{"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8cf0c037-6efd-4074-b8ed-84fb2e1650f9 req-47b58146-3916-4f78-a9f3-4cd656c2c419 service nova] Acquired lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.network.neutron [req-8cf0c037-6efd-4074-b8ed-84fb2e1650f9 req-47b58146-3916-4f78-a9f3-4cd656c2c419 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Refreshing network info cache for port 9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Start _get_guest_xml network_info=[{"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:42:02 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:42:02 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1259939742',display_name='tempest-AttachVolumeTestJSON-server-1259939742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1259939742',id=38,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7EEO3GuKn+8kaEXSCwjJz8D30OIv6uEvszdV2tRdyXKLs86UHQIA++ZVypTxQLfMuMGfMKD5aQHpdWbHtpzsnVd6ppNb9G1YnsHZ9J9cAEGP3hhxc9zL5ZdfAWkgTL4A==',key_name='tempest-keypair-1586338171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2671ecf470da4c5093899caa0e5b8313',ramdisk_id='',reservation_id='r-myp0eptt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2036216451',owner_user_name='tempest-AttachVolumeTestJSON-2036216451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:42:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adadef6a5a8437b8ee3931cbeff5467',uuid=374e50f7-3158-4514-a033-24dba936ecc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converting VIF {"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.objects.instance [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'pci_devices' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:42:02 user nova-compute[74630]:   <uuid>374e50f7-3158-4514-a033-24dba936ecc5</uuid>
Oct 26 03:42:02 user nova-compute[74630]:   <name>instance-00000026</name>
Oct 26 03:42:02 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:42:02 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:42:02 user nova-compute[74630]:   <metadata>
Oct 26 03:42:02 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:42:02 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:42:02 user nova-compute[74630]:       <nova:name>tempest-AttachVolumeTestJSON-server-1259939742</nova:name>
Oct 26 03:42:02 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:42:02</nova:creationTime>
Oct 26 03:42:02 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:42:02 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:42:02 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:42:02 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:42:02 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:42:02 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:42:02 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:42:02 user nova-compute[74630]:       <nova:owner>
Oct 26 03:42:02 user nova-compute[74630]:         <nova:user uuid="2adadef6a5a8437b8ee3931cbeff5467">tempest-AttachVolumeTestJSON-2036216451-project-member</nova:user>
Oct 26 03:42:02 user nova-compute[74630]:         <nova:project uuid="2671ecf470da4c5093899caa0e5b8313">tempest-AttachVolumeTestJSON-2036216451</nova:project>
Oct 26 03:42:02 user nova-compute[74630]:       </nova:owner>
Oct 26 03:42:02 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:42:02 user nova-compute[74630]:       <nova:ports>
Oct 26 03:42:02 user nova-compute[74630]:         <nova:port uuid="9e37d096-7f88-44a3-829f-e02f76065b09">
Oct 26 03:42:02 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 03:42:02 user nova-compute[74630]:         </nova:port>
Oct 26 03:42:02 user nova-compute[74630]:       </nova:ports>
Oct 26 03:42:02 user nova-compute[74630]:     </nova:instance>
Oct 26 03:42:02 user nova-compute[74630]:   </metadata>
Oct 26 03:42:02 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:42:02 user nova-compute[74630]:     <system>
Oct 26 03:42:02 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:42:02 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:42:02 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:42:02 user nova-compute[74630]:       <entry name="serial">374e50f7-3158-4514-a033-24dba936ecc5</entry>
Oct 26 03:42:02 user nova-compute[74630]:       <entry name="uuid">374e50f7-3158-4514-a033-24dba936ecc5</entry>
Oct 26 03:42:02 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:42:02 user nova-compute[74630]:     </system>
Oct 26 03:42:02 user nova-compute[74630]:   </sysinfo>
Oct 26 03:42:02 user nova-compute[74630]:   <os>
Oct 26 03:42:02 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:42:02 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:42:02 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:42:02 user nova-compute[74630]:   </os>
Oct 26 03:42:02 user nova-compute[74630]:   <features>
Oct 26 03:42:02 user nova-compute[74630]:     <acpi/>
Oct 26 03:42:02 user nova-compute[74630]:     <apic/>
Oct 26 03:42:02 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:42:02 user nova-compute[74630]:   </features>
Oct 26 03:42:02 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:42:02 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:42:02 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:42:02 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:42:02 user nova-compute[74630]:   </clock>
Oct 26 03:42:02 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:42:02 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:42:02 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:42:02 user nova-compute[74630]:   </cpu>
Oct 26 03:42:02 user nova-compute[74630]:   <devices>
Oct 26 03:42:02 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:42:02 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:42:02 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk"/>
Oct 26 03:42:02 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:42:02 user nova-compute[74630]:     </disk>
Oct 26 03:42:02 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:42:02 user nova-compute[74630]:       <mac address="fa:16:3e:95:80:23"/>
Oct 26 03:42:02 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:42:02 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:42:02 user nova-compute[74630]:       <target dev="tap9e37d096-7f"/>
Oct 26 03:42:02 user nova-compute[74630]:     </interface>
Oct 26 03:42:02 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:42:02 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/console.log" append="off"/>
Oct 26 03:42:02 user nova-compute[74630]:     </serial>
Oct 26 03:42:02 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:42:02 user nova-compute[74630]:     <video>
Oct 26 03:42:02 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:42:02 user nova-compute[74630]:     </video>
Oct 26 03:42:02 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:42:02 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:42:02 user nova-compute[74630]:     </rng>
Oct 26 03:42:02 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:42:02 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:42:02 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:42:02 user nova-compute[74630]:     </memballoon>
Oct 26 03:42:02 user nova-compute[74630]:   </devices>
Oct 26 03:42:02 user nova-compute[74630]: </domain>
Oct 26 03:42:02 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1259939742',display_name='tempest-AttachVolumeTestJSON-server-1259939742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1259939742',id=38,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7EEO3GuKn+8kaEXSCwjJz8D30OIv6uEvszdV2tRdyXKLs86UHQIA++ZVypTxQLfMuMGfMKD5aQHpdWbHtpzsnVd6ppNb9G1YnsHZ9J9cAEGP3hhxc9zL5ZdfAWkgTL4A==',key_name='tempest-keypair-1586338171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2671ecf470da4c5093899caa0e5b8313',ramdisk_id='',reservation_id='r-myp0eptt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2036216451',owner_user_name='tempest-AttachVolumeTestJSON-2036216451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:42:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adadef6a5a8437b8ee3931cbeff5467',uuid=374e50f7-3158-4514-a033-24dba936ecc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converting VIF {"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG os_vif [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '523365ec-4501-5a9c-8f66-df07c8d5957c', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e37d096-7f, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e37d096-7f, col_values=(('qos', UUID('a8a9849f-3a04-43a2-a363-0fe6bfbd01a0')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e37d096-7f, col_values=(('external_ids', {'iface-id': '9e37d096-7f88-44a3-829f-e02f76065b09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:80:23', 'vm-uuid': '374e50f7-3158-4514-a033-24dba936ecc5'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:42:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:02 user nova-compute[74630]: INFO os_vif [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f')
Oct 26 03:42:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:42:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] No VIF found with MAC fa:16:3e:95:80:23, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:42:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-534ffbeb-be85-4574-a2ee-9326648b21cb req-0542604a-f5f5-44b2-b8f7-6ec12289c413 service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Received event network-vif-plugged-83101951-90e2-4167-a52a-2b09bce51027 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:42:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-534ffbeb-be85-4574-a2ee-9326648b21cb req-0542604a-f5f5-44b2-b8f7-6ec12289c413 service nova] Acquiring lock "e7ca45f7-c3c0-454f-b77e-465c4d804661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-534ffbeb-be85-4574-a2ee-9326648b21cb req-0542604a-f5f5-44b2-b8f7-6ec12289c413 service nova] Lock "e7ca45f7-c3c0-454f-b77e-465c4d804661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-534ffbeb-be85-4574-a2ee-9326648b21cb req-0542604a-f5f5-44b2-b8f7-6ec12289c413 service nova] Lock "e7ca45f7-c3c0-454f-b77e-465c4d804661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-534ffbeb-be85-4574-a2ee-9326648b21cb req-0542604a-f5f5-44b2-b8f7-6ec12289c413 service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] No waiting events found dispatching network-vif-plugged-83101951-90e2-4167-a52a-2b09bce51027 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:42:03 user nova-compute[74630]: WARNING nova.compute.manager [req-534ffbeb-be85-4574-a2ee-9326648b21cb req-0542604a-f5f5-44b2-b8f7-6ec12289c413 service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Received unexpected event network-vif-plugged-83101951-90e2-4167-a52a-2b09bce51027 for instance with vm_state active and task_state None.
Oct 26 03:42:03 user nova-compute[74630]: DEBUG nova.network.neutron [req-8cf0c037-6efd-4074-b8ed-84fb2e1650f9 req-47b58146-3916-4f78-a9f3-4cd656c2c419 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updated VIF entry in instance network info cache for port 9e37d096-7f88-44a3-829f-e02f76065b09. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:42:03 user nova-compute[74630]: DEBUG nova.network.neutron [req-8cf0c037-6efd-4074-b8ed-84fb2e1650f9 req-47b58146-3916-4f78-a9f3-4cd656c2c419 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updating instance_info_cache with network_info: [{"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:42:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8cf0c037-6efd-4074-b8ed-84fb2e1650f9 req-47b58146-3916-4f78-a9f3-4cd656c2c419 service nova] Releasing lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:42:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-cdb5aa50-fd50-4c7b-9ae0-e5dd013c86cc req-e46b5a56-cdf2-4092-b775-a2103d58b46a service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:42:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cdb5aa50-fd50-4c7b-9ae0-e5dd013c86cc req-e46b5a56-cdf2-4092-b775-a2103d58b46a service nova] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cdb5aa50-fd50-4c7b-9ae0-e5dd013c86cc req-e46b5a56-cdf2-4092-b775-a2103d58b46a service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cdb5aa50-fd50-4c7b-9ae0-e5dd013c86cc req-e46b5a56-cdf2-4092-b775-a2103d58b46a service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-cdb5aa50-fd50-4c7b-9ae0-e5dd013c86cc req-e46b5a56-cdf2-4092-b775-a2103d58b46a service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] No waiting events found dispatching network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:42:05 user nova-compute[74630]: WARNING nova.compute.manager [req-cdb5aa50-fd50-4c7b-9ae0-e5dd013c86cc req-e46b5a56-cdf2-4092-b775-a2103d58b46a service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received unexpected event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 for instance with vm_state building and task_state spawning.
Oct 26 03:42:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-cdb5aa50-fd50-4c7b-9ae0-e5dd013c86cc req-e46b5a56-cdf2-4092-b775-a2103d58b46a service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:42:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cdb5aa50-fd50-4c7b-9ae0-e5dd013c86cc req-e46b5a56-cdf2-4092-b775-a2103d58b46a service nova] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cdb5aa50-fd50-4c7b-9ae0-e5dd013c86cc req-e46b5a56-cdf2-4092-b775-a2103d58b46a service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cdb5aa50-fd50-4c7b-9ae0-e5dd013c86cc req-e46b5a56-cdf2-4092-b775-a2103d58b46a service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-cdb5aa50-fd50-4c7b-9ae0-e5dd013c86cc req-e46b5a56-cdf2-4092-b775-a2103d58b46a service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] No waiting events found dispatching network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:42:05 user nova-compute[74630]: WARNING nova.compute.manager [req-cdb5aa50-fd50-4c7b-9ae0-e5dd013c86cc req-e46b5a56-cdf2-4092-b775-a2103d58b46a service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received unexpected event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 for instance with vm_state building and task_state spawning.
Oct 26 03:42:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:06 user nova-compute[74630]: DEBUG nova.compute.manager [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:42:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:42:06 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Instance spawned successfully.
Oct 26 03:42:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:42:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:42:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:42:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:42:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:42:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:42:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:42:06 user nova-compute[74630]: INFO nova.compute.manager [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Took 6.88 seconds to spawn the instance on the hypervisor.
Oct 26 03:42:06 user nova-compute[74630]: DEBUG nova.compute.manager [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:42:07 user nova-compute[74630]: INFO nova.compute.manager [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Took 7.55 seconds to build instance.
Oct 26 03:42:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-bdbda39c-5bd5-47b9-9ee7-1b1218374631 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.649s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:17 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c23e567d-8284-4039-b3af-5189d6ccdc80 is timed out.
Oct 26 03:42:17 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Successfully detached device vdb from instance c23e567d-8284-4039-b3af-5189d6ccdc80 from the live domain config.
Oct 26 03:42:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzLOWkae', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:42:17 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8524cc-ed1a-4763-82a9-875d21bb03d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:42:17 user nova-compute[74630]: No targets found.
Oct 26 03:42:17 user nova-compute[74630]: iSNS:
Oct 26 03:42:17 user nova-compute[74630]: No targets found.
Oct 26 03:42:17 user nova-compute[74630]: STATIC:
Oct 26 03:42:17 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13
Oct 26 03:42:17 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:42:17 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:42:17 user nova-compute[74630]: FIRMWARE:
Oct 26 03:42:17 user nova-compute[74630]: No targets found.
Oct 26 03:42:17 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:42:17 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:42:17 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[878c2c5b-c970-461c-841b-e6d89fdc7422]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b90d40f-e46b-47de-9154-9c3d30bee683]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 (non-flash)
Oct 26 03:42:17 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 (non-flash)
Oct 26 03:42:17 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c0fecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1120be1e-19b7-44da-88f3-58db9e6877e9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[82912265-950e-4adf-be04-e02dfe405964]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c508ff4-c11f-4448-b620-fef4297231d6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1c925e-f176-418d-b7ae-74ab4338b39c]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[27993e88-0682-43e2-bad9-b3fc52013b26]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cf7425-1170-4daf-b1c4-a514b862ee59]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13, portal: 172.16.0.220,3260]
Oct 26 03:42:17 user nova-compute[74630]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13, portal: 172.16.0.220,3260] successful.
Oct 26 03:42:17 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08c8af4f-b40c-4c07-bef3-f8ea7e067e13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdb42ac-971d-4681-b964-c2a7a92ff6e9]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:42:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:42:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:42:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] <== disconnect_volume: return (332ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:42:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:42:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:22 user nova-compute[74630]: DEBUG nova.objects.instance [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'flavor' on Instance uuid c23e567d-8284-4039-b3af-5189d6ccdc80 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:42:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4c43c64a-4386-4503-99b4-6786df573ca2 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.403s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:25 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:42:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-54fee319-b80e-4c6c-b4a1-1065a54fa02b req-ea0e5f3b-5231-400a-9175-e31fcb92ba85 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received event network-changed-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:42:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-54fee319-b80e-4c6c-b4a1-1065a54fa02b req-ea0e5f3b-5231-400a-9175-e31fcb92ba85 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Refreshing instance network info cache due to event network-changed-589b5294-80b4-4245-88b8-ea2a3b0a2560. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:42:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-54fee319-b80e-4c6c-b4a1-1065a54fa02b req-ea0e5f3b-5231-400a-9175-e31fcb92ba85 service nova] Acquiring lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:42:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-54fee319-b80e-4c6c-b4a1-1065a54fa02b req-ea0e5f3b-5231-400a-9175-e31fcb92ba85 service nova] Acquired lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:42:27 user nova-compute[74630]: DEBUG nova.network.neutron [req-54fee319-b80e-4c6c-b4a1-1065a54fa02b req-ea0e5f3b-5231-400a-9175-e31fcb92ba85 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Refreshing network info cache for port 589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:42:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:28 user nova-compute[74630]: DEBUG nova.network.neutron [req-54fee319-b80e-4c6c-b4a1-1065a54fa02b req-ea0e5f3b-5231-400a-9175-e31fcb92ba85 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Updated VIF entry in instance network info cache for port 589b5294-80b4-4245-88b8-ea2a3b0a2560. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:42:28 user nova-compute[74630]: DEBUG nova.network.neutron [req-54fee319-b80e-4c6c-b4a1-1065a54fa02b req-ea0e5f3b-5231-400a-9175-e31fcb92ba85 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Updating instance_info_cache with network_info: [{"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:42:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-54fee319-b80e-4c6c-b4a1-1065a54fa02b req-ea0e5f3b-5231-400a-9175-e31fcb92ba85 service nova] Releasing lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:42:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "f9890dde-e678-41d4-8447-24bf626c2983" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f9890dde-e678-41d4-8447-24bf626c2983" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "f9890dde-e678-41d4-8447-24bf626c2983-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f9890dde-e678-41d4-8447-24bf626c2983-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f9890dde-e678-41d4-8447-24bf626c2983-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:28 user nova-compute[74630]: INFO nova.compute.manager [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Terminating instance
Oct 26 03:42:28 user nova-compute[74630]: DEBUG nova.compute.manager [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-b3c77b27-37ad-4492-af99-b5ddddfe9f14 req-81ffe096-9e75-4e1d-87ad-523966d8c3c8 service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Received event network-vif-unplugged-8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b3c77b27-37ad-4492-af99-b5ddddfe9f14 req-81ffe096-9e75-4e1d-87ad-523966d8c3c8 service nova] Acquiring lock "f9890dde-e678-41d4-8447-24bf626c2983-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b3c77b27-37ad-4492-af99-b5ddddfe9f14 req-81ffe096-9e75-4e1d-87ad-523966d8c3c8 service nova] Lock "f9890dde-e678-41d4-8447-24bf626c2983-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b3c77b27-37ad-4492-af99-b5ddddfe9f14 req-81ffe096-9e75-4e1d-87ad-523966d8c3c8 service nova] Lock "f9890dde-e678-41d4-8447-24bf626c2983-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-b3c77b27-37ad-4492-af99-b5ddddfe9f14 req-81ffe096-9e75-4e1d-87ad-523966d8c3c8 service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] No waiting events found dispatching network-vif-unplugged-8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-b3c77b27-37ad-4492-af99-b5ddddfe9f14 req-81ffe096-9e75-4e1d-87ad-523966d8c3c8 service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Received event network-vif-unplugged-8f91f921-5357-4156-b113-a4a3b0ef6e2e for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:42:29 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Instance destroyed successfully.
Oct 26 03:42:29 user nova-compute[74630]: DEBUG nova.objects.instance [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lazy-loading 'resources' on Instance uuid f9890dde-e678-41d4-8447-24bf626c2983 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1042598755',display_name='tempest-ServerActionsTestOtherA-server-1042598755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1042598755',id=7,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwoLYfCM8lwvIIEciV36xGOUw+XalItY+5dZPbHAKn3DqpiwNygwALzSy5pOoP4seOCkowdcCG1fNBC8K731mmxBiQFtvBIY61aup2H6JCAGn52TG97PQD1ZIY1c0HtiA==',key_name='tempest-keypair-1565174322',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:20:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51542ffdf7a84ac5a61f14e124eb2087',ramdisk_id='',reservation_id='r-y0p22zy4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-41539930',owner_user_name='tempest-ServerActionsTestOtherA-41539930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a419737713f4797ab27db62d5aa746c',uuid=f9890dde-e678-41d4-8447-24bf626c2983,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "address": "fa:16:3e:1c:d5:8f", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f91f921-53", "ovs_interfaceid": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converting VIF {"id": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "address": "fa:16:3e:1c:d5:8f", "network": {"id": "35163292-d401-49db-b8e3-2f71a00117db", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1431377105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51542ffdf7a84ac5a61f14e124eb2087", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f91f921-53", "ovs_interfaceid": "8f91f921-5357-4156-b113-a4a3b0ef6e2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:d5:8f,bridge_name='br-int',has_traffic_filtering=True,id=8f91f921-5357-4156-b113-a4a3b0ef6e2e,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f91f921-53') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG os_vif [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:d5:8f,bridge_name='br-int',has_traffic_filtering=True,id=8f91f921-5357-4156-b113-a4a3b0ef6e2e,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f91f921-53') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f91f921-53, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=deba95fd-6945-4ebd-880c-7ee81124fc07) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:42:29 user nova-compute[74630]: INFO os_vif [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:d5:8f,bridge_name='br-int',has_traffic_filtering=True,id=8f91f921-5357-4156-b113-a4a3b0ef6e2e,network=Network(35163292-d401-49db-b8e3-2f71a00117db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f91f921-53')
Oct 26 03:42:29 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Deleting instance files /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983_del
Oct 26 03:42:29 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Deletion of /opt/stack/data/nova/instances/f9890dde-e678-41d4-8447-24bf626c2983_del complete
Oct 26 03:42:29 user nova-compute[74630]: INFO nova.compute.manager [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 26 03:42:29 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:42:29 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: f9890dde-e678-41d4-8447-24bf626c2983] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:42:30 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:42:30 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Took 0.44 seconds to deallocate network for instance.
Oct 26 03:42:30 user nova-compute[74630]: DEBUG nova.compute.manager [req-02b44338-9e42-430f-97cf-b90ec3dbf469 req-f75d15ee-9ef2-4c92-ab3f-12447854e667 service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Received event network-vif-deleted-8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:42:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:30 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:42:30 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:42:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:30 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Deleted allocations for instance f9890dde-e678-41d4-8447-24bf626c2983
Oct 26 03:42:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-136ab3f4-cf4d-458f-a64e-38495fd6a2fb tempest-ServerActionsTestOtherA-41539930 tempest-ServerActionsTestOtherA-41539930-project-member] Lock "f9890dde-e678-41d4-8447-24bf626c2983" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.552s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-b6261daf-5b4c-423c-b5ef-d30bb8c56ff1 req-a95277c2-aabc-433c-9a26-9bb3d81dde44 service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Received event network-vif-plugged-8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:42:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b6261daf-5b4c-423c-b5ef-d30bb8c56ff1 req-a95277c2-aabc-433c-9a26-9bb3d81dde44 service nova] Acquiring lock "f9890dde-e678-41d4-8447-24bf626c2983-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b6261daf-5b4c-423c-b5ef-d30bb8c56ff1 req-a95277c2-aabc-433c-9a26-9bb3d81dde44 service nova] Lock "f9890dde-e678-41d4-8447-24bf626c2983-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b6261daf-5b4c-423c-b5ef-d30bb8c56ff1 req-a95277c2-aabc-433c-9a26-9bb3d81dde44 service nova] Lock "f9890dde-e678-41d4-8447-24bf626c2983-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-b6261daf-5b4c-423c-b5ef-d30bb8c56ff1 req-a95277c2-aabc-433c-9a26-9bb3d81dde44 service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] No waiting events found dispatching network-vif-plugged-8f91f921-5357-4156-b113-a4a3b0ef6e2e {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:42:31 user nova-compute[74630]: WARNING nova.compute.manager [req-b6261daf-5b4c-423c-b5ef-d30bb8c56ff1 req-a95277c2-aabc-433c-9a26-9bb3d81dde44 service nova] [instance: f9890dde-e678-41d4-8447-24bf626c2983] Received unexpected event network-vif-plugged-8f91f921-5357-4156-b113-a4a3b0ef6e2e for instance with vm_state deleted and task_state None.
Oct 26 03:42:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:42:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:42:32 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:42:33 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:42:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:33 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:42:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "6f24bc2f-0ebe-4396-8092-e47359e487f7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:35 user nova-compute[74630]: INFO nova.compute.manager [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Shelving
Oct 26 03:42:35 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:42:35 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:42:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8362MB free_disk=25.09680938720703GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance c23e567d-8284-4039-b3af-5189d6ccdc80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 6f24bc2f-0ebe-4396-8092-e47359e487f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e7ca45f7-c3c0-454f-b77e-465c4d804661 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 374e50f7-3158-4514-a033-24dba936ecc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG nova.compute.manager [req-49462e27-5982-4a07-adef-d2babcabff80 req-3f6dbd39-b0dd-49b6-b77e-eef1c33f24aa service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received event network-vif-unplugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-49462e27-5982-4a07-adef-d2babcabff80 req-3f6dbd39-b0dd-49b6-b77e-eef1c33f24aa service nova] Acquiring lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-49462e27-5982-4a07-adef-d2babcabff80 req-3f6dbd39-b0dd-49b6-b77e-eef1c33f24aa service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-49462e27-5982-4a07-adef-d2babcabff80 req-3f6dbd39-b0dd-49b6-b77e-eef1c33f24aa service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG nova.compute.manager [req-49462e27-5982-4a07-adef-d2babcabff80 req-3f6dbd39-b0dd-49b6-b77e-eef1c33f24aa service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] No waiting events found dispatching network-vif-unplugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:42:35 user nova-compute[74630]: WARNING nova.compute.manager [req-49462e27-5982-4a07-adef-d2babcabff80 req-3f6dbd39-b0dd-49b6-b77e-eef1c33f24aa service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received unexpected event network-vif-unplugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 for instance with vm_state active and task_state shelving.
Oct 26 03:42:35 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:35 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Instance destroyed successfully.
Oct 26 03:42:35 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Beginning cold snapshot process
Oct 26 03:42:36 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:42:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk /opt/stack/data/nova/instances/snapshots/tmpldek9_vr/98a3632912a547a3a5c0645703254162 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:42:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:42:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:42:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:42:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:42:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:42:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-c23e567d-8284-4039-b3af-5189d6ccdc80" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:42:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-c23e567d-8284-4039-b3af-5189d6ccdc80" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:42:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:42:36 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid c23e567d-8284-4039-b3af-5189d6ccdc80 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:42:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk /opt/stack/data/nova/instances/snapshots/tmpldek9_vr/98a3632912a547a3a5c0645703254162" returned: 0 in 0.885s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:42:36 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Snapshot extracted, beginning image upload
Oct 26 03:42:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Updating instance_info_cache with network_info: [{"id": "b93b79db-e438-4365-98e8-04df7ba83fb0", "address": "fa:16:3e:80:e0:5a", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93b79db-e4", "ovs_interfaceid": "b93b79db-e438-4365-98e8-04df7ba83fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:42:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-c23e567d-8284-4039-b3af-5189d6ccdc80" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:42:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:42:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:42:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-7b5fbaef-9d48-4670-bdfb-ed09828f9104 req-488e44b2-8aa9-4fa3-a3b4-ef02e478e390 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received event network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:42:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7b5fbaef-9d48-4670-bdfb-ed09828f9104 req-488e44b2-8aa9-4fa3-a3b4-ef02e478e390 service nova] Acquiring lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7b5fbaef-9d48-4670-bdfb-ed09828f9104 req-488e44b2-8aa9-4fa3-a3b4-ef02e478e390 service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7b5fbaef-9d48-4670-bdfb-ed09828f9104 req-488e44b2-8aa9-4fa3-a3b4-ef02e478e390 service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-7b5fbaef-9d48-4670-bdfb-ed09828f9104 req-488e44b2-8aa9-4fa3-a3b4-ef02e478e390 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] No waiting events found dispatching network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:42:37 user nova-compute[74630]: WARNING nova.compute.manager [req-7b5fbaef-9d48-4670-bdfb-ed09828f9104 req-488e44b2-8aa9-4fa3-a3b4-ef02e478e390 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received unexpected event network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 03:42:38 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:42:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:39 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Snapshot image upload complete
Oct 26 03:42:39 user nova-compute[74630]: DEBUG nova.compute.manager [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:42:39 user nova-compute[74630]: INFO nova.compute.manager [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Shelve offloading
Oct 26 03:42:39 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Instance destroyed successfully.
Oct 26 03:42:39 user nova-compute[74630]: DEBUG nova.compute.manager [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:42:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:42:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquired lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:42:39 user nova-compute[74630]: DEBUG nova.network.neutron [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:42:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:39 user nova-compute[74630]: DEBUG nova.network.neutron [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Updating instance_info_cache with network_info: [{"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:42:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Releasing lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:42:40 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Instance destroyed successfully.
Oct 26 03:42:40 user nova-compute[74630]: DEBUG nova.objects.instance [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'resources' on Instance uuid 6f24bc2f-0ebe-4396-8092-e47359e487f7 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1079081659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1079081659',id=36,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4pnXjePQKongg0073ePUq3elKsrVvcE0c6puyFMqhhc7dNiVqwmLETRyyKnopMZJ324XyvbebT/3iS0ew2/xmsVpLHHUPRLKIWUHbyzzDJsFfQClV/n9RroLJy7l6mcA==',key_name='tempest-keypair-1872227064',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:40:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f44335320f77434999514ed6824a2e23',ramdisk_id='',reservation_id='r-7ajka82n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1268856411',owner_user_name='tempest-AttachVolumeShelveTestJSON-1268856411-project-member',shelved_at='2023-10-26T03:42:39.175544',shelved_host='user',shelved_image_id='ce88732f-8461-45cd-a0c1-f79e805cbe58'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:42:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f51acc12a54e7bbd38e975f2d7632e',uuid=6f24bc2f-0ebe-4396-8092-e47359e487f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converting VIF {"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=589b5294-80b4-4245-88b8-ea2a3b0a2560,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589b5294-80') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG os_vif [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=589b5294-80b4-4245-88b8-ea2a3b0a2560,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589b5294-80') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap589b5294-80, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-e5e6474b-fd95-42bf-bd4e-2b4cd9513474 req-16bcf2ba-ee6f-43ca-8fbe-623f1bce670a service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received event network-changed-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-e5e6474b-fd95-42bf-bd4e-2b4cd9513474 req-16bcf2ba-ee6f-43ca-8fbe-623f1bce670a service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Refreshing instance network info cache due to event network-changed-589b5294-80b4-4245-88b8-ea2a3b0a2560. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e5e6474b-fd95-42bf-bd4e-2b4cd9513474 req-16bcf2ba-ee6f-43ca-8fbe-623f1bce670a service nova] Acquiring lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e5e6474b-fd95-42bf-bd4e-2b4cd9513474 req-16bcf2ba-ee6f-43ca-8fbe-623f1bce670a service nova] Acquired lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG nova.network.neutron [req-e5e6474b-fd95-42bf-bd4e-2b4cd9513474 req-16bcf2ba-ee6f-43ca-8fbe-623f1bce670a service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Refreshing network info cache for port 589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f54dba6d-1b75-4eb5-9506-2762818d0a03) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:42:40 user nova-compute[74630]: INFO os_vif [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=589b5294-80b4-4245-88b8-ea2a3b0a2560,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589b5294-80')
Oct 26 03:42:40 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Deleting instance files /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7_del
Oct 26 03:42:40 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Deletion of /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7_del complete
Oct 26 03:42:40 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Deleted allocations for instance 6f24bc2f-0ebe-4396-8092-e47359e487f7
Oct 26 03:42:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG nova.objects.instance [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'numa_topology' on Instance uuid 6f24bc2f-0ebe-4396-8092-e47359e487f7 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG nova.objects.base [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Object Instance<6f24bc2f-0ebe-4396-8092-e47359e487f7> lazy-loaded attributes: resources,numa_topology {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG nova.network.neutron [req-e5e6474b-fd95-42bf-bd4e-2b4cd9513474 req-16bcf2ba-ee6f-43ca-8fbe-623f1bce670a service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Updated VIF entry in instance network info cache for port 589b5294-80b4-4245-88b8-ea2a3b0a2560. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG nova.network.neutron [req-e5e6474b-fd95-42bf-bd4e-2b4cd9513474 req-16bcf2ba-ee6f-43ca-8fbe-623f1bce670a service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Updating instance_info_cache with network_info: [{"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap589b5294-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e5e6474b-fd95-42bf-bd4e-2b4cd9513474 req-16bcf2ba-ee6f-43ca-8fbe-623f1bce670a service nova] Releasing lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:42:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-baa4588a-b67a-4f2c-bb6f-362e0a3f8506 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.682s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "c23e567d-8284-4039-b3af-5189d6ccdc80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "c23e567d-8284-4039-b3af-5189d6ccdc80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:47 user nova-compute[74630]: INFO nova.compute.manager [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Terminating instance
Oct 26 03:42:47 user nova-compute[74630]: DEBUG nova.compute.manager [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:42:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-22fa16a6-9249-40ed-8929-d92e3f9a7946 req-4edfe92d-ffaa-40a7-a542-44a5cce8e180 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Received event network-vif-unplugged-b93b79db-e438-4365-98e8-04df7ba83fb0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:42:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-22fa16a6-9249-40ed-8929-d92e3f9a7946 req-4edfe92d-ffaa-40a7-a542-44a5cce8e180 service nova] Acquiring lock "c23e567d-8284-4039-b3af-5189d6ccdc80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-22fa16a6-9249-40ed-8929-d92e3f9a7946 req-4edfe92d-ffaa-40a7-a542-44a5cce8e180 service nova] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-22fa16a6-9249-40ed-8929-d92e3f9a7946 req-4edfe92d-ffaa-40a7-a542-44a5cce8e180 service nova] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-22fa16a6-9249-40ed-8929-d92e3f9a7946 req-4edfe92d-ffaa-40a7-a542-44a5cce8e180 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] No waiting events found dispatching network-vif-unplugged-b93b79db-e438-4365-98e8-04df7ba83fb0 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:42:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-22fa16a6-9249-40ed-8929-d92e3f9a7946 req-4edfe92d-ffaa-40a7-a542-44a5cce8e180 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Received event network-vif-unplugged-b93b79db-e438-4365-98e8-04df7ba83fb0 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:42:48 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Instance destroyed successfully.
Oct 26 03:42:48 user nova-compute[74630]: DEBUG nova.objects.instance [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'resources' on Instance uuid c23e567d-8284-4039-b3af-5189d6ccdc80 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:42:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-694327487',display_name='tempest-AttachVolumeNegativeTest-server-694327487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-694327487',id=35,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOo/r67AvEkXTnrLT21cSCg+B2msPTgvA/BC1WbvJGt4ELiRabg4KBY0WaTTKfjkww7RAyCF3ncO9ht0UP6tHiIGDEDGcxJdCyNZSpR34pjXSg9E8PqZr50I60R2PzUSuQ==',key_name='tempest-keypair-599849009',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:39:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ebfc20893da40c1b25be2444441f0c3',ramdisk_id='',reservation_id='r-66vs0hrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2146381855',owner_user_name='tempest-AttachVolumeNegativeTest-2146381855-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:39:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc35b87a18e44b3392d122e392a0b8fb',uuid=c23e567d-8284-4039-b3af-5189d6ccdc80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b93b79db-e438-4365-98e8-04df7ba83fb0", "address": "fa:16:3e:80:e0:5a", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93b79db-e4", "ovs_interfaceid": "b93b79db-e438-4365-98e8-04df7ba83fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:42:48 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converting VIF {"id": "b93b79db-e438-4365-98e8-04df7ba83fb0", "address": "fa:16:3e:80:e0:5a", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb93b79db-e4", "ovs_interfaceid": "b93b79db-e438-4365-98e8-04df7ba83fb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:42:48 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:e0:5a,bridge_name='br-int',has_traffic_filtering=True,id=b93b79db-e438-4365-98e8-04df7ba83fb0,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb93b79db-e4') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:42:48 user nova-compute[74630]: DEBUG os_vif [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:e0:5a,bridge_name='br-int',has_traffic_filtering=True,id=b93b79db-e438-4365-98e8-04df7ba83fb0,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb93b79db-e4') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:42:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb93b79db-e4, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:42:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:42:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cae992d-bff3-4ee6-a0fd-486a2739db60) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:42:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:42:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:42:48 user nova-compute[74630]: INFO os_vif [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:e0:5a,bridge_name='br-int',has_traffic_filtering=True,id=b93b79db-e438-4365-98e8-04df7ba83fb0,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb93b79db-e4')
Oct 26 03:42:48 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Deleting instance files /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80_del
Oct 26 03:42:48 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Deletion of /opt/stack/data/nova/instances/c23e567d-8284-4039-b3af-5189d6ccdc80_del complete
Oct 26 03:42:48 user nova-compute[74630]: INFO nova.compute.manager [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 26 03:42:48 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:42:48 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:42:48 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:42:48 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:42:48 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Took 0.83 seconds to deallocate network for instance.
Oct 26 03:42:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-19e34d3c-612b-4670-8626-0484a8c49894 req-57234eaf-1b9f-469a-b7f4-b418b05ffbad service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Received event network-vif-deleted-b93b79db-e438-4365-98e8-04df7ba83fb0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:42:48 user nova-compute[74630]: INFO nova.compute.manager [req-19e34d3c-612b-4670-8626-0484a8c49894 req-57234eaf-1b9f-469a-b7f4-b418b05ffbad service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Neutron deleted interface b93b79db-e438-4365-98e8-04df7ba83fb0; detaching it from the instance and deleting it from the info cache
Oct 26 03:42:48 user nova-compute[74630]: DEBUG nova.network.neutron [req-19e34d3c-612b-4670-8626-0484a8c49894 req-57234eaf-1b9f-469a-b7f4-b418b05ffbad service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:42:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-19e34d3c-612b-4670-8626-0484a8c49894 req-57234eaf-1b9f-469a-b7f4-b418b05ffbad service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Detach interface failed, port_id=b93b79db-e438-4365-98e8-04df7ba83fb0, reason: Instance c23e567d-8284-4039-b3af-5189d6ccdc80 could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 03:42:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:49 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:42:49 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:42:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:49 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Deleted allocations for instance c23e567d-8284-4039-b3af-5189d6ccdc80
Oct 26 03:42:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a96dd247-3823-4c97-858e-66e1089e8ba3 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-66bdef97-23f3-45c5-acde-9c2298a0706a req-6081e202-b0a7-4fa6-a02d-592c5e22fa50 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Received event network-vif-plugged-b93b79db-e438-4365-98e8-04df7ba83fb0 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:42:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-66bdef97-23f3-45c5-acde-9c2298a0706a req-6081e202-b0a7-4fa6-a02d-592c5e22fa50 service nova] Acquiring lock "c23e567d-8284-4039-b3af-5189d6ccdc80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:42:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-66bdef97-23f3-45c5-acde-9c2298a0706a req-6081e202-b0a7-4fa6-a02d-592c5e22fa50 service nova] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:42:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-66bdef97-23f3-45c5-acde-9c2298a0706a req-6081e202-b0a7-4fa6-a02d-592c5e22fa50 service nova] Lock "c23e567d-8284-4039-b3af-5189d6ccdc80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:42:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-66bdef97-23f3-45c5-acde-9c2298a0706a req-6081e202-b0a7-4fa6-a02d-592c5e22fa50 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] No waiting events found dispatching network-vif-plugged-b93b79db-e438-4365-98e8-04df7ba83fb0 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:42:49 user nova-compute[74630]: WARNING nova.compute.manager [req-66bdef97-23f3-45c5-acde-9c2298a0706a req-6081e202-b0a7-4fa6-a02d-592c5e22fa50 service nova] [instance: c23e567d-8284-4039-b3af-5189d6ccdc80] Received unexpected event network-vif-plugged-b93b79db-e438-4365-98e8-04df7ba83fb0 for instance with vm_state deleted and task_state None.
Oct 26 03:42:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:42:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:42:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:43:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:43:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:43:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:43:30 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:43:33 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:43:33 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:43:33 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:43:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:43:34 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:43:35 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:43:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:43:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:43:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:43:35 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:43:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:43:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:43:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:43:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:43:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:43:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:43:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:43:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:43:36 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:43:36 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:43:36 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8717MB free_disk=25.102203369140625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:43:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:43:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:43:36 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance e7ca45f7-c3c0-454f-b77e-465c4d804661 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:43:36 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 374e50f7-3158-4514-a033-24dba936ecc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:43:36 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:43:36 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:43:36 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:43:36 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:43:36 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:43:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:43:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:43:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:43:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 26 03:43:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-e7ca45f7-c3c0-454f-b77e-465c4d804661" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:43:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-e7ca45f7-c3c0-454f-b77e-465c4d804661" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:43:37 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:43:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:43:38 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Updating instance_info_cache with network_info: [{"id": "83101951-90e2-4167-a52a-2b09bce51027", "address": "fa:16:3e:1a:aa:3b", "network": {"id": "42c4178a-4a05-4b0e-a0f6-1f5310fe8927", "bridge": "br-int", "label": "tempest-VolumesActionsTest-192494792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df37ca5f0923438cb0db3771a979daa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83101951-90", "ovs_interfaceid": "83101951-90e2-4167-a52a-2b09bce51027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:43:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-e7ca45f7-c3c0-454f-b77e-465c4d804661" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:43:38 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:43:38 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:43:39 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:43:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:43:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:43:40 user nova-compute[74630]: DEBUG nova.compute.manager [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:43:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:43:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:43:40 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:43:40 user nova-compute[74630]: INFO nova.compute.claims [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Claim successful on node user
Oct 26 03:43:41 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG nova.compute.manager [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG nova.compute.manager [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG nova.network.neutron [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:43:41 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:43:41 user nova-compute[74630]: DEBUG nova.compute.manager [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG nova.policy [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc35b87a18e44b3392d122e392a0b8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ebfc20893da40c1b25be2444441f0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG nova.compute.manager [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:43:41 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Creating image(s)
Oct 26 03:43:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "/opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "/opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "/opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.213s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.170s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk 1073741824" returned: 0 in 0.056s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:43:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.network.neutron [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Successfully created port: eb39c336-c6f1-44df-8ead-7a1499131787 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.204s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Cannot resize image /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Ensure instance console log exists: /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.network.neutron [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Successfully updated port: eb39c336-c6f1-44df-8ead-7a1499131787 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "refresh_cache-49227d67-dec4-4ee9-aa7b-8e82eef5f65f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquired lock "refresh_cache-49227d67-dec4-4ee9-aa7b-8e82eef5f65f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.network.neutron [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-76336bb0-c10f-4b69-a557-d6b9579f2c1b req-2f949e41-74ee-4823-90ee-762480fbb0a8 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Received event network-changed-eb39c336-c6f1-44df-8ead-7a1499131787 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-76336bb0-c10f-4b69-a557-d6b9579f2c1b req-2f949e41-74ee-4823-90ee-762480fbb0a8 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Refreshing instance network info cache due to event network-changed-eb39c336-c6f1-44df-8ead-7a1499131787. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-76336bb0-c10f-4b69-a557-d6b9579f2c1b req-2f949e41-74ee-4823-90ee-762480fbb0a8 service nova] Acquiring lock "refresh_cache-49227d67-dec4-4ee9-aa7b-8e82eef5f65f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.network.neutron [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.network.neutron [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Updating instance_info_cache with network_info: [{"id": "eb39c336-c6f1-44df-8ead-7a1499131787", "address": "fa:16:3e:5c:1f:6b", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb39c336-c6", "ovs_interfaceid": "eb39c336-c6f1-44df-8ead-7a1499131787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Releasing lock "refresh_cache-49227d67-dec4-4ee9-aa7b-8e82eef5f65f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Instance network_info: |[{"id": "eb39c336-c6f1-44df-8ead-7a1499131787", "address": "fa:16:3e:5c:1f:6b", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb39c336-c6", "ovs_interfaceid": "eb39c336-c6f1-44df-8ead-7a1499131787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-76336bb0-c10f-4b69-a557-d6b9579f2c1b req-2f949e41-74ee-4823-90ee-762480fbb0a8 service nova] Acquired lock "refresh_cache-49227d67-dec4-4ee9-aa7b-8e82eef5f65f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.network.neutron [req-76336bb0-c10f-4b69-a557-d6b9579f2c1b req-2f949e41-74ee-4823-90ee-762480fbb0a8 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Refreshing network info cache for port eb39c336-c6f1-44df-8ead-7a1499131787 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Start _get_guest_xml network_info=[{"id": "eb39c336-c6f1-44df-8ead-7a1499131787", "address": "fa:16:3e:5c:1f:6b", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb39c336-c6", "ovs_interfaceid": "eb39c336-c6f1-44df-8ead-7a1499131787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:43:42 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:43:42 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:43:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-338213653',display_name='tempest-AttachVolumeNegativeTest-server-338213653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-338213653',id=39,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBb9pFBB70saaq0sRLYF+6o89FzYRcHrXVkiA8yGjDNwqwrtFtiV9XygSVcqZ+z/fIZNgCW5+WgoONvqGCPLsSuI1FcnR2QOqHJsLtjiCwvoAWxNCKORj7Bt2cdBk7OHxw==',key_name='tempest-keypair-450160054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ebfc20893da40c1b25be2444441f0c3',ramdisk_id='',reservation_id='r-rr7a9pw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2146381855',owner_user_name='tempest-AttachVolumeNegativeTest-2146381855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:43:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc35b87a18e44b3392d122e392a0b8fb',uuid=49227d67-dec4-4ee9-aa7b-8e82eef5f65f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb39c336-c6f1-44df-8ead-7a1499131787", "address": "fa:16:3e:5c:1f:6b", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb39c336-c6", "ovs_interfaceid": "eb39c336-c6f1-44df-8ead-7a1499131787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converting VIF {"id": "eb39c336-c6f1-44df-8ead-7a1499131787", "address": "fa:16:3e:5c:1f:6b", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb39c336-c6", "ovs_interfaceid": "eb39c336-c6f1-44df-8ead-7a1499131787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:1f:6b,bridge_name='br-int',has_traffic_filtering=True,id=eb39c336-c6f1-44df-8ead-7a1499131787,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb39c336-c6') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.objects.instance [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'pci_devices' on Instance uuid 49227d67-dec4-4ee9-aa7b-8e82eef5f65f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:43:43 user nova-compute[74630]:   <uuid>49227d67-dec4-4ee9-aa7b-8e82eef5f65f</uuid>
Oct 26 03:43:43 user nova-compute[74630]:   <name>instance-00000027</name>
Oct 26 03:43:43 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:43:43 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:43:43 user nova-compute[74630]:   <metadata>
Oct 26 03:43:43 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:43:43 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:43:43 user nova-compute[74630]:       <nova:name>tempest-AttachVolumeNegativeTest-server-338213653</nova:name>
Oct 26 03:43:43 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:43:42</nova:creationTime>
Oct 26 03:43:43 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:43:43 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:43:43 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:43:43 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:43:43 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:43:43 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:43:43 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:43:43 user nova-compute[74630]:       <nova:owner>
Oct 26 03:43:43 user nova-compute[74630]:         <nova:user uuid="bc35b87a18e44b3392d122e392a0b8fb">tempest-AttachVolumeNegativeTest-2146381855-project-member</nova:user>
Oct 26 03:43:43 user nova-compute[74630]:         <nova:project uuid="0ebfc20893da40c1b25be2444441f0c3">tempest-AttachVolumeNegativeTest-2146381855</nova:project>
Oct 26 03:43:43 user nova-compute[74630]:       </nova:owner>
Oct 26 03:43:43 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:43:43 user nova-compute[74630]:       <nova:ports>
Oct 26 03:43:43 user nova-compute[74630]:         <nova:port uuid="eb39c336-c6f1-44df-8ead-7a1499131787">
Oct 26 03:43:43 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 03:43:43 user nova-compute[74630]:         </nova:port>
Oct 26 03:43:43 user nova-compute[74630]:       </nova:ports>
Oct 26 03:43:43 user nova-compute[74630]:     </nova:instance>
Oct 26 03:43:43 user nova-compute[74630]:   </metadata>
Oct 26 03:43:43 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:43:43 user nova-compute[74630]:     <system>
Oct 26 03:43:43 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:43:43 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:43:43 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:43:43 user nova-compute[74630]:       <entry name="serial">49227d67-dec4-4ee9-aa7b-8e82eef5f65f</entry>
Oct 26 03:43:43 user nova-compute[74630]:       <entry name="uuid">49227d67-dec4-4ee9-aa7b-8e82eef5f65f</entry>
Oct 26 03:43:43 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:43:43 user nova-compute[74630]:     </system>
Oct 26 03:43:43 user nova-compute[74630]:   </sysinfo>
Oct 26 03:43:43 user nova-compute[74630]:   <os>
Oct 26 03:43:43 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:43:43 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:43:43 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:43:43 user nova-compute[74630]:   </os>
Oct 26 03:43:43 user nova-compute[74630]:   <features>
Oct 26 03:43:43 user nova-compute[74630]:     <acpi/>
Oct 26 03:43:43 user nova-compute[74630]:     <apic/>
Oct 26 03:43:43 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:43:43 user nova-compute[74630]:   </features>
Oct 26 03:43:43 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:43:43 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:43:43 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:43:43 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:43:43 user nova-compute[74630]:   </clock>
Oct 26 03:43:43 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:43:43 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:43:43 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:43:43 user nova-compute[74630]:   </cpu>
Oct 26 03:43:43 user nova-compute[74630]:   <devices>
Oct 26 03:43:43 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:43:43 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:43:43 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk"/>
Oct 26 03:43:43 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:43:43 user nova-compute[74630]:     </disk>
Oct 26 03:43:43 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:43:43 user nova-compute[74630]:       <mac address="fa:16:3e:5c:1f:6b"/>
Oct 26 03:43:43 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:43:43 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:43:43 user nova-compute[74630]:       <target dev="tapeb39c336-c6"/>
Oct 26 03:43:43 user nova-compute[74630]:     </interface>
Oct 26 03:43:43 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:43:43 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/console.log" append="off"/>
Oct 26 03:43:43 user nova-compute[74630]:     </serial>
Oct 26 03:43:43 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:43:43 user nova-compute[74630]:     <video>
Oct 26 03:43:43 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:43:43 user nova-compute[74630]:     </video>
Oct 26 03:43:43 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:43:43 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:43:43 user nova-compute[74630]:     </rng>
Oct 26 03:43:43 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:43:43 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:43:43 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:43:43 user nova-compute[74630]:     </memballoon>
Oct 26 03:43:43 user nova-compute[74630]:   </devices>
Oct 26 03:43:43 user nova-compute[74630]: </domain>
Oct 26 03:43:43 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-338213653',display_name='tempest-AttachVolumeNegativeTest-server-338213653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-338213653',id=39,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBb9pFBB70saaq0sRLYF+6o89FzYRcHrXVkiA8yGjDNwqwrtFtiV9XygSVcqZ+z/fIZNgCW5+WgoONvqGCPLsSuI1FcnR2QOqHJsLtjiCwvoAWxNCKORj7Bt2cdBk7OHxw==',key_name='tempest-keypair-450160054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ebfc20893da40c1b25be2444441f0c3',ramdisk_id='',reservation_id='r-rr7a9pw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2146381855',owner_user_name='tempest-AttachVolumeNegativeTest-2146381855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:43:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc35b87a18e44b3392d122e392a0b8fb',uuid=49227d67-dec4-4ee9-aa7b-8e82eef5f65f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb39c336-c6f1-44df-8ead-7a1499131787", "address": "fa:16:3e:5c:1f:6b", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb39c336-c6", "ovs_interfaceid": "eb39c336-c6f1-44df-8ead-7a1499131787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converting VIF {"id": "eb39c336-c6f1-44df-8ead-7a1499131787", "address": "fa:16:3e:5c:1f:6b", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb39c336-c6", "ovs_interfaceid": "eb39c336-c6f1-44df-8ead-7a1499131787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:1f:6b,bridge_name='br-int',has_traffic_filtering=True,id=eb39c336-c6f1-44df-8ead-7a1499131787,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb39c336-c6') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG os_vif [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:1f:6b,bridge_name='br-int',has_traffic_filtering=True,id=eb39c336-c6f1-44df-8ead-7a1499131787,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb39c336-c6') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d1dd49c-afdf-5317-884f-b369617e063c', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb39c336-c6, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb39c336-c6, col_values=(('qos', UUID('9d1eb0e6-8b45-4adf-b9cd-9359cf409ffc')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb39c336-c6, col_values=(('external_ids', {'iface-id': 'eb39c336-c6f1-44df-8ead-7a1499131787', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:1f:6b', 'vm-uuid': '49227d67-dec4-4ee9-aa7b-8e82eef5f65f'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:43 user nova-compute[74630]: INFO os_vif [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:1f:6b,bridge_name='br-int',has_traffic_filtering=True,id=eb39c336-c6f1-44df-8ead-7a1499131787,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb39c336-c6')
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No VIF found with MAC fa:16:3e:5c:1f:6b, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.network.neutron [req-76336bb0-c10f-4b69-a557-d6b9579f2c1b req-2f949e41-74ee-4823-90ee-762480fbb0a8 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Updated VIF entry in instance network info cache for port eb39c336-c6f1-44df-8ead-7a1499131787. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG nova.network.neutron [req-76336bb0-c10f-4b69-a557-d6b9579f2c1b req-2f949e41-74ee-4823-90ee-762480fbb0a8 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Updating instance_info_cache with network_info: [{"id": "eb39c336-c6f1-44df-8ead-7a1499131787", "address": "fa:16:3e:5c:1f:6b", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb39c336-c6", "ovs_interfaceid": "eb39c336-c6f1-44df-8ead-7a1499131787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:43:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-76336bb0-c10f-4b69-a557-d6b9579f2c1b req-2f949e41-74ee-4823-90ee-762480fbb0a8 service nova] Releasing lock "refresh_cache-49227d67-dec4-4ee9-aa7b-8e82eef5f65f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:43:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-fa951bd5-c317-4435-8f90-fc7a111fd055 req-27a7b65c-b2dc-47b7-8b2b-101057faac77 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Received event network-vif-plugged-eb39c336-c6f1-44df-8ead-7a1499131787 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:43:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-fa951bd5-c317-4435-8f90-fc7a111fd055 req-27a7b65c-b2dc-47b7-8b2b-101057faac77 service nova] Acquiring lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:43:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-fa951bd5-c317-4435-8f90-fc7a111fd055 req-27a7b65c-b2dc-47b7-8b2b-101057faac77 service nova] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:43:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-fa951bd5-c317-4435-8f90-fc7a111fd055 req-27a7b65c-b2dc-47b7-8b2b-101057faac77 service nova] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:43:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-fa951bd5-c317-4435-8f90-fc7a111fd055 req-27a7b65c-b2dc-47b7-8b2b-101057faac77 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] No waiting events found dispatching network-vif-plugged-eb39c336-c6f1-44df-8ead-7a1499131787 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:43:44 user nova-compute[74630]: WARNING nova.compute.manager [req-fa951bd5-c317-4435-8f90-fc7a111fd055 req-27a7b65c-b2dc-47b7-8b2b-101057faac77 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Received unexpected event network-vif-plugged-eb39c336-c6f1-44df-8ead-7a1499131787 for instance with vm_state building and task_state spawning.
Oct 26 03:43:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-29eaaa4e-410a-43ad-9cac-7fba6cd86567 req-01198e7c-5646-4165-b357-83a712fc3d5f service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Received event network-vif-plugged-eb39c336-c6f1-44df-8ead-7a1499131787 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:43:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-29eaaa4e-410a-43ad-9cac-7fba6cd86567 req-01198e7c-5646-4165-b357-83a712fc3d5f service nova] Acquiring lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:43:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-29eaaa4e-410a-43ad-9cac-7fba6cd86567 req-01198e7c-5646-4165-b357-83a712fc3d5f service nova] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:43:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-29eaaa4e-410a-43ad-9cac-7fba6cd86567 req-01198e7c-5646-4165-b357-83a712fc3d5f service nova] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:43:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-29eaaa4e-410a-43ad-9cac-7fba6cd86567 req-01198e7c-5646-4165-b357-83a712fc3d5f service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] No waiting events found dispatching network-vif-plugged-eb39c336-c6f1-44df-8ead-7a1499131787 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:43:46 user nova-compute[74630]: WARNING nova.compute.manager [req-29eaaa4e-410a-43ad-9cac-7fba6cd86567 req-01198e7c-5646-4165-b357-83a712fc3d5f service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Received unexpected event network-vif-plugged-eb39c336-c6f1-44df-8ead-7a1499131787 for instance with vm_state building and task_state spawning.
Oct 26 03:43:46 user nova-compute[74630]: DEBUG nova.compute.manager [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:43:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:43:46 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Instance spawned successfully.
Oct 26 03:43:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:43:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:43:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:43:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:43:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:43:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:43:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:43:46 user nova-compute[74630]: INFO nova.compute.manager [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Took 5.61 seconds to spawn the instance on the hypervisor.
Oct 26 03:43:46 user nova-compute[74630]: DEBUG nova.compute.manager [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:43:47 user nova-compute[74630]: INFO nova.compute.manager [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Took 6.23 seconds to build instance.
Oct 26 03:43:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-227d6c76-e3fc-43f5-a889-066a7a3d18c4 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.336s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:43:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-7bc8c7c4-8cba-4784-9d11-faadc61d204c req-50fa7509-2382-45ed-8633-66b4054ee890 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-changed-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:43:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-7bc8c7c4-8cba-4784-9d11-faadc61d204c req-50fa7509-2382-45ed-8633-66b4054ee890 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Refreshing instance network info cache due to event network-changed-9e37d096-7f88-44a3-829f-e02f76065b09. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:43:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7bc8c7c4-8cba-4784-9d11-faadc61d204c req-50fa7509-2382-45ed-8633-66b4054ee890 service nova] Acquiring lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:43:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7bc8c7c4-8cba-4784-9d11-faadc61d204c req-50fa7509-2382-45ed-8633-66b4054ee890 service nova] Acquired lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:43:50 user nova-compute[74630]: DEBUG nova.network.neutron [req-7bc8c7c4-8cba-4784-9d11-faadc61d204c req-50fa7509-2382-45ed-8633-66b4054ee890 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Refreshing network info cache for port 9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:43:51 user nova-compute[74630]: DEBUG nova.network.neutron [req-7bc8c7c4-8cba-4784-9d11-faadc61d204c req-50fa7509-2382-45ed-8633-66b4054ee890 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updated VIF entry in instance network info cache for port 9e37d096-7f88-44a3-829f-e02f76065b09. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:43:51 user nova-compute[74630]: DEBUG nova.network.neutron [req-7bc8c7c4-8cba-4784-9d11-faadc61d204c req-50fa7509-2382-45ed-8633-66b4054ee890 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updating instance_info_cache with network_info: [{"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:43:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7bc8c7c4-8cba-4784-9d11-faadc61d204c req-50fa7509-2382-45ed-8633-66b4054ee890 service nova] Releasing lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:43:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG nova.objects.instance [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'flavor' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:43:57 user nova-compute[74630]: INFO nova.compute.manager [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Attaching volume 19b29f4c-d9a5-436b-90c5-a6a3708e3da8 to /dev/vdb
Oct 26 03:43:57 user nova-compute[74630]: DEBUG os_brick.utils [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20c054f-b604-40ca-8275-0913d2b3bde1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[01decda6-0b5f-430a-8797-4583a5f990c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc8e30a-1530-476e-8abe-6543f1f01290]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c383df-ad3b-4af7-ad93-8aeb7c8a1c77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:43:57 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:43:57 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4167065-e5aa-4bc0-93bf-9147c9c773ea]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG os_brick.utils [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:43:57 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updating existing volume attachment record: 33437453-b8f7-409c-bc3a-d31e12411f49 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:43:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:43:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Acquiring lock "e7ca45f7-c3c0-454f-b77e-465c4d804661" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "e7ca45f7-c3c0-454f-b77e-465c4d804661" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Acquiring lock "e7ca45f7-c3c0-454f-b77e-465c4d804661-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "e7ca45f7-c3c0-454f-b77e-465c4d804661-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "e7ca45f7-c3c0-454f-b77e-465c4d804661-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:01 user nova-compute[74630]: INFO nova.compute.manager [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Terminating instance
Oct 26 03:44:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-6d911363-0685-4d21-b476-0c6c54b1d7ef req-cf6d95a4-1895-4596-bcd4-799d0ffbaf30 service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Received event network-vif-unplugged-83101951-90e2-4167-a52a-2b09bce51027 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6d911363-0685-4d21-b476-0c6c54b1d7ef req-cf6d95a4-1895-4596-bcd4-799d0ffbaf30 service nova] Acquiring lock "e7ca45f7-c3c0-454f-b77e-465c4d804661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6d911363-0685-4d21-b476-0c6c54b1d7ef req-cf6d95a4-1895-4596-bcd4-799d0ffbaf30 service nova] Lock "e7ca45f7-c3c0-454f-b77e-465c4d804661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6d911363-0685-4d21-b476-0c6c54b1d7ef req-cf6d95a4-1895-4596-bcd4-799d0ffbaf30 service nova] Lock "e7ca45f7-c3c0-454f-b77e-465c4d804661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-6d911363-0685-4d21-b476-0c6c54b1d7ef req-cf6d95a4-1895-4596-bcd4-799d0ffbaf30 service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] No waiting events found dispatching network-vif-unplugged-83101951-90e2-4167-a52a-2b09bce51027 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG nova.compute.manager [req-6d911363-0685-4d21-b476-0c6c54b1d7ef req-cf6d95a4-1895-4596-bcd4-799d0ffbaf30 service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Received event network-vif-unplugged-83101951-90e2-4167-a52a-2b09bce51027 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:44:01 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Instance destroyed successfully.
Oct 26 03:44:01 user nova-compute[74630]: DEBUG nova.objects.instance [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lazy-loading 'resources' on Instance uuid e7ca45f7-c3c0-454f-b77e-465c4d804661 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-60809324',display_name='tempest-VolumesActionsTest-instance-60809324',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-60809324',id=37,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:42:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df37ca5f0923438cb0db3771a979daa4',ramdisk_id='',reservation_id='r-cjs8sode',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-733929121',owner_user_name='tempest-VolumesActionsTest-733929121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:42:01Z,user_data=None,user_id='dabd935281a74c1796c7c9108f6445bd',uuid=e7ca45f7-c3c0-454f-b77e-465c4d804661,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83101951-90e2-4167-a52a-2b09bce51027", "address": "fa:16:3e:1a:aa:3b", "network": {"id": "42c4178a-4a05-4b0e-a0f6-1f5310fe8927", "bridge": "br-int", "label": "tempest-VolumesActionsTest-192494792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df37ca5f0923438cb0db3771a979daa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83101951-90", "ovs_interfaceid": "83101951-90e2-4167-a52a-2b09bce51027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Converting VIF {"id": "83101951-90e2-4167-a52a-2b09bce51027", "address": "fa:16:3e:1a:aa:3b", "network": {"id": "42c4178a-4a05-4b0e-a0f6-1f5310fe8927", "bridge": "br-int", "label": "tempest-VolumesActionsTest-192494792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df37ca5f0923438cb0db3771a979daa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83101951-90", "ovs_interfaceid": "83101951-90e2-4167-a52a-2b09bce51027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:aa:3b,bridge_name='br-int',has_traffic_filtering=True,id=83101951-90e2-4167-a52a-2b09bce51027,network=Network(42c4178a-4a05-4b0e-a0f6-1f5310fe8927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83101951-90') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG os_vif [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:aa:3b,bridge_name='br-int',has_traffic_filtering=True,id=83101951-90e2-4167-a52a-2b09bce51027,network=Network(42c4178a-4a05-4b0e-a0f6-1f5310fe8927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83101951-90') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83101951-90, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a287928-d719-4e3c-a736-448952e5d283) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:44:01 user nova-compute[74630]: INFO os_vif [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:aa:3b,bridge_name='br-int',has_traffic_filtering=True,id=83101951-90e2-4167-a52a-2b09bce51027,network=Network(42c4178a-4a05-4b0e-a0f6-1f5310fe8927),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83101951-90')
Oct 26 03:44:01 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Deleting instance files /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661_del
Oct 26 03:44:01 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Deletion of /opt/stack/data/nova/instances/e7ca45f7-c3c0-454f-b77e-465c4d804661_del complete
Oct 26 03:44:02 user nova-compute[74630]: INFO nova.compute.manager [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 26 03:44:02 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:44:02 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:44:02 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:44:02 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:44:02 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Took 0.50 seconds to deallocate network for instance.
Oct 26 03:44:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-5313d5f0-4ed1-4c84-b1b3-a99398aab6b9 req-af6da77c-9637-46a7-931d-e5d8ed438b66 service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Received event network-vif-deleted-83101951-90e2-4167-a52a-2b09bce51027 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:44:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:02 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:44:02 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:44:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:02 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Deleted allocations for instance e7ca45f7-c3c0-454f-b77e-465c4d804661
Oct 26 03:44:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6f1d9575-facd-42b0-81e8-e3b9fd1f717e tempest-VolumesActionsTest-733929121 tempest-VolumesActionsTest-733929121-project-member] Lock "e7ca45f7-c3c0-454f-b77e-465c4d804661" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.787s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-0e54985d-cdab-4616-a2e7-73ab3ddae479 req-5300d2a1-e065-4b47-bf8b-21d0ffad2ff3 service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Received event network-vif-plugged-83101951-90e2-4167-a52a-2b09bce51027 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:44:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0e54985d-cdab-4616-a2e7-73ab3ddae479 req-5300d2a1-e065-4b47-bf8b-21d0ffad2ff3 service nova] Acquiring lock "e7ca45f7-c3c0-454f-b77e-465c4d804661-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0e54985d-cdab-4616-a2e7-73ab3ddae479 req-5300d2a1-e065-4b47-bf8b-21d0ffad2ff3 service nova] Lock "e7ca45f7-c3c0-454f-b77e-465c4d804661-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0e54985d-cdab-4616-a2e7-73ab3ddae479 req-5300d2a1-e065-4b47-bf8b-21d0ffad2ff3 service nova] Lock "e7ca45f7-c3c0-454f-b77e-465c4d804661-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-0e54985d-cdab-4616-a2e7-73ab3ddae479 req-5300d2a1-e065-4b47-bf8b-21d0ffad2ff3 service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] No waiting events found dispatching network-vif-plugged-83101951-90e2-4167-a52a-2b09bce51027 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:44:03 user nova-compute[74630]: WARNING nova.compute.manager [req-0e54985d-cdab-4616-a2e7-73ab3ddae479 req-5300d2a1-e065-4b47-bf8b-21d0ffad2ff3 service nova] [instance: e7ca45f7-c3c0-454f-b77e-465c4d804661] Received unexpected event network-vif-plugged-83101951-90e2-4167-a52a-2b09bce51027 for instance with vm_state deleted and task_state None.
Oct 26 03:44:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:44:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DGthFsok', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:44:14 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:44:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:44:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:44:14 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:44:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:44:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:44:14 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:44:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[94026b37-c9e3-491b-a4fc-b2b7838e1033]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:44:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:44:14 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:44:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[28723e6a-4b3d-44a0-90d2-55d794da9f84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8] added
Oct 26 03:44:15 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d64325-02c6-4450-af64-ecb5ce570f04]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a5c01a-ce84-42bb-8c24-f311efe7e283]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DGthFsok {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DGthFsok" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fb97ce-38d5-4e08-b9d7-cf8337652118]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DGthFsok'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe60c855-057e-447a-a68f-d077b8336b54]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8fb6bc-7279-4e93-80fa-e7418f770408]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 03:44:15 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 03:44:15 user nova-compute[74630]:  {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:44:15 user nova-compute[74630]: WARNING os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 03:44:15 user nova-compute[74630]: 
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b422c6-f50c-4c27-8432-37b46f7c08a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260]
Oct 26 03:44:15 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260] successful.
Oct 26 03:44:15 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a664f05-e6f5-4092-b0a8-c08fda75f3de]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[af767e51-5a86-4e17-a92f-ce7a437643be]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)
Oct 26 03:44:15 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)
Oct 26 03:44:15 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f00385f-9b26-4c5e-a8f4-9e4d22b6cd79]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:44:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DGthFsok', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:44:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:44:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23431623939323132', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:44:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431623939323132', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:44:16 user nova-compute[74630]: DEBUG nova.objects.instance [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'flavor' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:44:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:44:16 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:44:16 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 03:44:16 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:44:16 user nova-compute[74630]:   <serial>19b29f4c-d9a5-436b-90c5-a6a3708e3da8</serial>
Oct 26 03:44:16 user nova-compute[74630]: </disk>
Oct 26 03:44:16 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:44:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:44:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:44:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] No VIF found with MAC fa:16:3e:95:80:23, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:44:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2cbbd1e1-7382-4255-8185-6dc189379108 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.427s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-70ed4729-43bb-483a-b01c-cd52e655a701 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-70ed4729-43bb-483a-b01c-cd52e655a701 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-70ed4729-43bb-483a-b01c-cd52e655a701 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:44:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-70ed4729-43bb-483a-b01c-cd52e655a701 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74630) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 26 03:44:17 user nova-compute[74630]: DEBUG nova.objects.instance [None req-70ed4729-43bb-483a-b01c-cd52e655a701 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'flavor' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:44:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-f99b9844-52d3-488e-b0fc-045019e228b9 req-d8f8e553-25d1-422d-939e-4a5d927c4864 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-vif-unplugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:44:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f99b9844-52d3-488e-b0fc-045019e228b9 req-d8f8e553-25d1-422d-939e-4a5d927c4864 service nova] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f99b9844-52d3-488e-b0fc-045019e228b9 req-d8f8e553-25d1-422d-939e-4a5d927c4864 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f99b9844-52d3-488e-b0fc-045019e228b9 req-d8f8e553-25d1-422d-939e-4a5d927c4864 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-f99b9844-52d3-488e-b0fc-045019e228b9 req-d8f8e553-25d1-422d-939e-4a5d927c4864 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] No waiting events found dispatching network-vif-unplugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:44:18 user nova-compute[74630]: WARNING nova.compute.manager [req-f99b9844-52d3-488e-b0fc-045019e228b9 req-d8f8e553-25d1-422d-939e-4a5d927c4864 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received unexpected event network-vif-unplugged-9e37d096-7f88-44a3-829f-e02f76065b09 for instance with vm_state active and task_state powering-off.
Oct 26 03:44:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Instance destroyed successfully.
Oct 26 03:44:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-70ed4729-43bb-483a-b01c-cd52e655a701 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:44:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-70ed4729-43bb-483a-b01c-cd52e655a701 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.863s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-e4faa3d7-b3a4-4dca-9d9d-efa15b3fe7ef req-6e113744-8693-48d4-8016-c064e99813c0 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:44:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e4faa3d7-b3a4-4dca-9d9d-efa15b3fe7ef req-6e113744-8693-48d4-8016-c064e99813c0 service nova] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e4faa3d7-b3a4-4dca-9d9d-efa15b3fe7ef req-6e113744-8693-48d4-8016-c064e99813c0 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e4faa3d7-b3a4-4dca-9d9d-efa15b3fe7ef req-6e113744-8693-48d4-8016-c064e99813c0 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-e4faa3d7-b3a4-4dca-9d9d-efa15b3fe7ef req-6e113744-8693-48d4-8016-c064e99813c0 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] No waiting events found dispatching network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:44:20 user nova-compute[74630]: WARNING nova.compute.manager [req-e4faa3d7-b3a4-4dca-9d9d-efa15b3fe7ef req-6e113744-8693-48d4-8016-c064e99813c0 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received unexpected event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 for instance with vm_state stopped and task_state None.
Oct 26 03:44:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:44:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "6f24bc2f-0ebe-4396-8092-e47359e487f7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:27 user nova-compute[74630]: INFO nova.compute.manager [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Unshelving
Oct 26 03:44:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:27 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'pci_requests' on Instance uuid 6f24bc2f-0ebe-4396-8092-e47359e487f7 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:44:27 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'numa_topology' on Instance uuid 6f24bc2f-0ebe-4396-8092-e47359e487f7 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:44:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:44:27 user nova-compute[74630]: INFO nova.compute.claims [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Claim successful on node user
Oct 26 03:44:27 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:44:27 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:44:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:27 user nova-compute[74630]: INFO nova.network.neutron [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Updating port 589b5294-80b4-4245-88b8-ea2a3b0a2560 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquired lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-d75e8aa2-06f5-45a9-9b2a-d4012ce71d93 req-33e270ad-bd73-4e5d-8fe2-c43aab027bc4 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received event network-changed-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-d75e8aa2-06f5-45a9-9b2a-d4012ce71d93 req-33e270ad-bd73-4e5d-8fe2-c43aab027bc4 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Refreshing instance network info cache due to event network-changed-589b5294-80b4-4245-88b8-ea2a3b0a2560. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d75e8aa2-06f5-45a9-9b2a-d4012ce71d93 req-33e270ad-bd73-4e5d-8fe2-c43aab027bc4 service nova] Acquiring lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG nova.network.neutron [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Updating instance_info_cache with network_info: [{"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Releasing lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:44:28 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Creating image(s)
Oct 26 03:44:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "/opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "/opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6f24bc2f-0ebe-4396-8092-e47359e487f7 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d75e8aa2-06f5-45a9-9b2a-d4012ce71d93 req-33e270ad-bd73-4e5d-8fe2-c43aab027bc4 service nova] Acquired lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG nova.network.neutron [req-d75e8aa2-06f5-45a9-9b2a-d4012ce71d93 req-33e270ad-bd73-4e5d-8fe2-c43aab027bc4 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Refreshing network info cache for port 589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG nova.objects.base [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Object Instance<6f24bc2f-0ebe-4396-8092-e47359e487f7> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "f70d438cd5cfda3aae490ed333e79f0a3cce2948" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "f70d438cd5cfda3aae490ed333e79f0a3cce2948" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948.part --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948.part --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:30 user nova-compute[74630]: DEBUG nova.virt.images [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] ce88732f-8461-45cd-a0c1-f79e805cbe58 was qcow2, converting to raw {{(pid=74630) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 03:44:30 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:44:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948.part /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948.converted {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:30 user nova-compute[74630]: DEBUG nova.network.neutron [req-d75e8aa2-06f5-45a9-9b2a-d4012ce71d93 req-33e270ad-bd73-4e5d-8fe2-c43aab027bc4 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Updated VIF entry in instance network info cache for port 589b5294-80b4-4245-88b8-ea2a3b0a2560. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:44:30 user nova-compute[74630]: DEBUG nova.network.neutron [req-d75e8aa2-06f5-45a9-9b2a-d4012ce71d93 req-33e270ad-bd73-4e5d-8fe2-c43aab027bc4 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Updating instance_info_cache with network_info: [{"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:44:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d75e8aa2-06f5-45a9-9b2a-d4012ce71d93 req-33e270ad-bd73-4e5d-8fe2-c43aab027bc4 service nova] Releasing lock "refresh_cache-6f24bc2f-0ebe-4396-8092-e47359e487f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:44:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948.part /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948.converted" returned: 0 in 0.537s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948.converted --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "f70d438cd5cfda3aae490ed333e79f0a3cce2948" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.143s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948 --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948 --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "f70d438cd5cfda3aae490ed333e79f0a3cce2948" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "f70d438cd5cfda3aae490ed333e79f0a3cce2948" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948 --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948 --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948,backing_fmt=raw /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948,backing_fmt=raw /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk 1073741824" returned: 0 in 0.071s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "f70d438cd5cfda3aae490ed333e79f0a3cce2948" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948 --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948 --force-share --output=json" returned: 0 in 0.176s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:31 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'migration_context' on Instance uuid 6f24bc2f-0ebe-4396-8092-e47359e487f7 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:44:31 user nova-compute[74630]: DEBUG nova.objects.base [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Object Instance<6f24bc2f-0ebe-4396-8092-e47359e487f7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:44:31 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Rebasing disk image.
Oct 26 03:44:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.177s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b -F raw /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:44:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b -F raw /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk" returned: 0 in 2.127s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Ensure instance console log exists: /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Start _get_guest_xml network_info=[{"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='2d167386c42ea7c0f5749b009edb8c24',container_format='bare',created_at=2023-10-26T03:42:35Z,direct_url=<?>,disk_format='qcow2',id=ce88732f-8461-45cd-a0c1-f79e805cbe58,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1079081659-shelved',owner='f44335320f77434999514ed6824a2e23',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T03:42:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:44:33 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:44:33 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2d167386c42ea7c0f5749b009edb8c24',container_format='bare',created_at=2023-10-26T03:42:35Z,direct_url=<?>,disk_format='qcow2',id=ce88732f-8461-45cd-a0c1-f79e805cbe58,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1079081659-shelved',owner='f44335320f77434999514ed6824a2e23',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T03:42:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6f24bc2f-0ebe-4396-8092-e47359e487f7 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.objects.base [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Object Instance<6f24bc2f-0ebe-4396-8092-e47359e487f7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T03:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1079081659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1079081659',id=36,image_ref='ce88732f-8461-45cd-a0c1-f79e805cbe58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1872227064',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:40:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f44335320f77434999514ed6824a2e23',ramdisk_id='',reservation_id='r-7ajka82n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1268856411',owner_user_name='tempest-AttachVolumeShelveTestJSON-1268856411-project-member',shelved_at='2023-10-26T03:42:39.175544',shelved_host='user',shelved_image_id='ce88732f-8461-45cd-a0c1-f79e805cbe58'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f51acc12a54e7bbd38e975f2d7632e',uuid=6f24bc2f-0ebe-4396-8092-e47359e487f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converting VIF {"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=589b5294-80b4-4245-88b8-ea2a3b0a2560,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589b5294-80') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f24bc2f-0ebe-4396-8092-e47359e487f7 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.objects.base [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Object Instance<6f24bc2f-0ebe-4396-8092-e47359e487f7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:44:33 user nova-compute[74630]:   <uuid>6f24bc2f-0ebe-4396-8092-e47359e487f7</uuid>
Oct 26 03:44:33 user nova-compute[74630]:   <name>instance-00000024</name>
Oct 26 03:44:33 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:44:33 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:44:33 user nova-compute[74630]:   <metadata>
Oct 26 03:44:33 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:44:33 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:44:33 user nova-compute[74630]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1079081659</nova:name>
Oct 26 03:44:33 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:44:33</nova:creationTime>
Oct 26 03:44:33 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:44:33 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:44:33 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:44:33 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:44:33 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:44:33 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:44:33 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:44:33 user nova-compute[74630]:       <nova:owner>
Oct 26 03:44:33 user nova-compute[74630]:         <nova:user uuid="89f51acc12a54e7bbd38e975f2d7632e">tempest-AttachVolumeShelveTestJSON-1268856411-project-member</nova:user>
Oct 26 03:44:33 user nova-compute[74630]:         <nova:project uuid="f44335320f77434999514ed6824a2e23">tempest-AttachVolumeShelveTestJSON-1268856411</nova:project>
Oct 26 03:44:33 user nova-compute[74630]:       </nova:owner>
Oct 26 03:44:33 user nova-compute[74630]:       <nova:root type="image" uuid="ce88732f-8461-45cd-a0c1-f79e805cbe58"/>
Oct 26 03:44:33 user nova-compute[74630]:       <nova:ports>
Oct 26 03:44:33 user nova-compute[74630]:         <nova:port uuid="589b5294-80b4-4245-88b8-ea2a3b0a2560">
Oct 26 03:44:33 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 03:44:33 user nova-compute[74630]:         </nova:port>
Oct 26 03:44:33 user nova-compute[74630]:       </nova:ports>
Oct 26 03:44:33 user nova-compute[74630]:     </nova:instance>
Oct 26 03:44:33 user nova-compute[74630]:   </metadata>
Oct 26 03:44:33 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:44:33 user nova-compute[74630]:     <system>
Oct 26 03:44:33 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:44:33 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:44:33 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:44:33 user nova-compute[74630]:       <entry name="serial">6f24bc2f-0ebe-4396-8092-e47359e487f7</entry>
Oct 26 03:44:33 user nova-compute[74630]:       <entry name="uuid">6f24bc2f-0ebe-4396-8092-e47359e487f7</entry>
Oct 26 03:44:33 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:44:33 user nova-compute[74630]:     </system>
Oct 26 03:44:33 user nova-compute[74630]:   </sysinfo>
Oct 26 03:44:33 user nova-compute[74630]:   <os>
Oct 26 03:44:33 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:44:33 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:44:33 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:44:33 user nova-compute[74630]:   </os>
Oct 26 03:44:33 user nova-compute[74630]:   <features>
Oct 26 03:44:33 user nova-compute[74630]:     <acpi/>
Oct 26 03:44:33 user nova-compute[74630]:     <apic/>
Oct 26 03:44:33 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:44:33 user nova-compute[74630]:   </features>
Oct 26 03:44:33 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:44:33 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:44:33 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:44:33 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:44:33 user nova-compute[74630]:   </clock>
Oct 26 03:44:33 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:44:33 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:44:33 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:44:33 user nova-compute[74630]:   </cpu>
Oct 26 03:44:33 user nova-compute[74630]:   <devices>
Oct 26 03:44:33 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:44:33 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:44:33 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk"/>
Oct 26 03:44:33 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:44:33 user nova-compute[74630]:     </disk>
Oct 26 03:44:33 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:44:33 user nova-compute[74630]:       <mac address="fa:16:3e:51:b4:36"/>
Oct 26 03:44:33 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:44:33 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:44:33 user nova-compute[74630]:       <target dev="tap589b5294-80"/>
Oct 26 03:44:33 user nova-compute[74630]:     </interface>
Oct 26 03:44:33 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:44:33 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/console.log" append="off"/>
Oct 26 03:44:33 user nova-compute[74630]:     </serial>
Oct 26 03:44:33 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:44:33 user nova-compute[74630]:     <video>
Oct 26 03:44:33 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:44:33 user nova-compute[74630]:     </video>
Oct 26 03:44:33 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:44:33 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:44:33 user nova-compute[74630]:     </rng>
Oct 26 03:44:33 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:44:33 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:44:33 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:44:33 user nova-compute[74630]:     </memballoon>
Oct 26 03:44:33 user nova-compute[74630]:   </devices>
Oct 26 03:44:33 user nova-compute[74630]: </domain>
Oct 26 03:44:33 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T03:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1079081659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1079081659',id=36,image_ref='ce88732f-8461-45cd-a0c1-f79e805cbe58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1872227064',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:40:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f44335320f77434999514ed6824a2e23',ramdisk_id='',reservation_id='r-7ajka82n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1268856411',owner_user_name='tempest-AttachVolumeShelveTestJSON-1268856411-project-member',shelved_at='2023-10-26T03:42:39.175544',shelved_host='user',shelved_image_id='ce88732f-8461-45cd-a0c1-f79e805cbe58'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f51acc12a54e7bbd38e975f2d7632e',uuid=6f24bc2f-0ebe-4396-8092-e47359e487f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converting VIF {"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=589b5294-80b4-4245-88b8-ea2a3b0a2560,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589b5294-80') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG os_vif [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=589b5294-80b4-4245-88b8-ea2a3b0a2560,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589b5294-80') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c41653ff-e38f-5d89-81bd-e315a01156cb', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap589b5294-80, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap589b5294-80, col_values=(('qos', UUID('ed859440-dab1-4e48-a3ad-4a655580ccb5')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap589b5294-80, col_values=(('external_ids', {'iface-id': '589b5294-80b4-4245-88b8-ea2a3b0a2560', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:b4:36', 'vm-uuid': '6f24bc2f-0ebe-4396-8092-e47359e487f7'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:44:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:33 user nova-compute[74630]: INFO os_vif [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=589b5294-80b4-4245-88b8-ea2a3b0a2560,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589b5294-80')
Oct 26 03:44:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:44:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] No VIF found with MAC fa:16:3e:51:b4:36, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG nova.compute.manager [req-a7783ef0-d94a-43f5-88f5-b8a7736beba7 req-ace9c032-7b8d-4f21-8127-56c14d2682f8 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received event network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a7783ef0-d94a-43f5-88f5-b8a7736beba7 req-ace9c032-7b8d-4f21-8127-56c14d2682f8 service nova] Acquiring lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a7783ef0-d94a-43f5-88f5-b8a7736beba7 req-ace9c032-7b8d-4f21-8127-56c14d2682f8 service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a7783ef0-d94a-43f5-88f5-b8a7736beba7 req-ace9c032-7b8d-4f21-8127-56c14d2682f8 service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG nova.compute.manager [req-a7783ef0-d94a-43f5-88f5-b8a7736beba7 req-ace9c032-7b8d-4f21-8127-56c14d2682f8 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] No waiting events found dispatching network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:44:35 user nova-compute[74630]: WARNING nova.compute.manager [req-a7783ef0-d94a-43f5-88f5-b8a7736beba7 req-ace9c032-7b8d-4f21-8127-56c14d2682f8 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received unexpected event network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 03:44:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:44:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:44:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:44:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:44:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:44:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:44:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:44:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updating instance_info_cache with network_info: [{"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:44:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:44:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:44:37 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Instance spawned successfully.
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-5cc3959d-3d15-4430-a2d0-da4184ac53d6 req-aecd62cf-ebf3-4358-af19-1d2ab992b19a service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received event network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5cc3959d-3d15-4430-a2d0-da4184ac53d6 req-aecd62cf-ebf3-4358-af19-1d2ab992b19a service nova] Acquiring lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5cc3959d-3d15-4430-a2d0-da4184ac53d6 req-aecd62cf-ebf3-4358-af19-1d2ab992b19a service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-5cc3959d-3d15-4430-a2d0-da4184ac53d6 req-aecd62cf-ebf3-4358-af19-1d2ab992b19a service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-5cc3959d-3d15-4430-a2d0-da4184ac53d6 req-aecd62cf-ebf3-4358-af19-1d2ab992b19a service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] No waiting events found dispatching network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:44:37 user nova-compute[74630]: WARNING nova.compute.manager [req-5cc3959d-3d15-4430-a2d0-da4184ac53d6 req-aecd62cf-ebf3-4358-af19-1d2ab992b19a service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received unexpected event network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ce725bcb-5054-4800-9396-84d08193bf41 tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.510s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:44:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:44:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:44:38 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:44:38 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:44:38 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8834MB free_disk=24.968017578125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:44:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:44:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:44:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:38 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 374e50f7-3158-4514-a033-24dba936ecc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:44:38 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 49227d67-dec4-4ee9-aa7b-8e82eef5f65f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:44:38 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 6f24bc2f-0ebe-4396-8092-e47359e487f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:44:38 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:44:38 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:44:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:38 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:44:38 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:44:39 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:44:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:44:41 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:44:41 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:44:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:44:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:44:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:44:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:44:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:44:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:44:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:44:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:44:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:44:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:44:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:45:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:45:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:45:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:45:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:45:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:45:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:45:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:45:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:45:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:45:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:45:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:45:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:45:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:45:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:45:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:45:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:45:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:45:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:45:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-e34340c0-34d9-4f94-a6e0-836521d1fbe2 req-26e9b11c-9782-40c3-b56e-5c00a4d60156 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Received event network-changed-eb39c336-c6f1-44df-8ead-7a1499131787 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:45:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-e34340c0-34d9-4f94-a6e0-836521d1fbe2 req-26e9b11c-9782-40c3-b56e-5c00a4d60156 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Refreshing instance network info cache due to event network-changed-eb39c336-c6f1-44df-8ead-7a1499131787. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:45:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e34340c0-34d9-4f94-a6e0-836521d1fbe2 req-26e9b11c-9782-40c3-b56e-5c00a4d60156 service nova] Acquiring lock "refresh_cache-49227d67-dec4-4ee9-aa7b-8e82eef5f65f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:45:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e34340c0-34d9-4f94-a6e0-836521d1fbe2 req-26e9b11c-9782-40c3-b56e-5c00a4d60156 service nova] Acquired lock "refresh_cache-49227d67-dec4-4ee9-aa7b-8e82eef5f65f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:45:31 user nova-compute[74630]: DEBUG nova.network.neutron [req-e34340c0-34d9-4f94-a6e0-836521d1fbe2 req-26e9b11c-9782-40c3-b56e-5c00a4d60156 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Refreshing network info cache for port eb39c336-c6f1-44df-8ead-7a1499131787 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:45:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:45:32 user nova-compute[74630]: DEBUG nova.network.neutron [req-e34340c0-34d9-4f94-a6e0-836521d1fbe2 req-26e9b11c-9782-40c3-b56e-5c00a4d60156 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Updated VIF entry in instance network info cache for port eb39c336-c6f1-44df-8ead-7a1499131787. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:45:32 user nova-compute[74630]: DEBUG nova.network.neutron [req-e34340c0-34d9-4f94-a6e0-836521d1fbe2 req-26e9b11c-9782-40c3-b56e-5c00a4d60156 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Updating instance_info_cache with network_info: [{"id": "eb39c336-c6f1-44df-8ead-7a1499131787", "address": "fa:16:3e:5c:1f:6b", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb39c336-c6", "ovs_interfaceid": "eb39c336-c6f1-44df-8ead-7a1499131787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:45:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e34340c0-34d9-4f94-a6e0-836521d1fbe2 req-26e9b11c-9782-40c3-b56e-5c00a4d60156 service nova] Releasing lock "refresh_cache-49227d67-dec4-4ee9-aa7b-8e82eef5f65f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:45:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:45:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:45:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:45:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:45:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:45:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:45:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:45:36 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:45:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updating instance_info_cache with network_info: [{"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:45:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:45:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:45:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG nova.objects.instance [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'flavor' on Instance uuid 49227d67-dec4-4ee9-aa7b-8e82eef5f65f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:45:37 user nova-compute[74630]: INFO nova.compute.manager [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Attaching volume 9b96ee83-c24d-475d-86c7-e8fdfbccc503 to /dev/vdb
Oct 26 03:45:37 user nova-compute[74630]: DEBUG os_brick.utils [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ab0fef-8ab8-424f-8a58-60239d7ab4a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e65b20-6755-4db5-86bc-15853fc37a1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[43feec39-7be6-4258-9689-719493c97f59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[784aa054-45b0-440e-9dbb-764d32738bde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:45:37 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:45:37 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[effd102e-284a-45ab-b238-d3bbe0457275]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG os_brick.utils [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:45:37 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Updating existing volume attachment record: 2087c85f-02f6-4f35-ad85-160c5c925447 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:45:39 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:45:39 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:45:39 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8723MB free_disk=25.062923431396484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:45:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:45:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:45:39 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 374e50f7-3158-4514-a033-24dba936ecc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:45:39 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 49227d67-dec4-4ee9-aa7b-8e82eef5f65f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:45:39 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 6f24bc2f-0ebe-4396-8092-e47359e487f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:45:39 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:45:39 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:45:40 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:45:40 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:45:40 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:45:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:45:43 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:45:43 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:45:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:45:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:45:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:45:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:45:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:45:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWZrlPAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:45:56 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:45:56 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:45:56 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[168beade-16b1-472b-b9c3-4c30f6dae34b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:45:56 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3586033-8f32-4482-bb91-c797b50606c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503] added
Oct 26 03:45:56 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7468e320-67db-43da-95de-bf30412eabbe]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[068687ed-ae90-43d9-a672-cbfb0de02ba6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWZrlPAR {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWZrlPAR" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d63f8e-2cf7-4b89-b8a9-3a46a38b4fd6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vWZrlPAR'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f7c689-0bd0-4cab-9d1b-d7b29ee2ee9e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ca3b53-5648-464f-856e-2c2eef7da05a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)
Oct 26 03:45:56 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)
Oct 26 03:45:56 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5010ad7a-73c8-4a51-a1c0-08b1f7920004]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503, portal: 172.16.0.220,3260]
Oct 26 03:45:56 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503, portal: 172.16.0.220,3260] successful.
Oct 26 03:45:56 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[74854fcf-60d7-42e2-81bc-046bf1feff8c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af5a522-d202-46a6-a8c2-8f9f15289d7e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)
Oct 26 03:45:56 user nova-compute[74630]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 (non-flash)
Oct 26 03:45:56 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)
Oct 26 03:45:56 user nova-compute[74630]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 (non-flash)
Oct 26 03:45:56 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[14990f5d-9991-4479-9029-83f8dde1c58e]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:45:56 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:45:57 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:45:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWZrlPAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:45:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:45:57 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26161386538383738', 'path': '/dev/sdc'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:45:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161386538383738', 'path': '/dev/sdc'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:45:57 user nova-compute[74630]: DEBUG nova.objects.instance [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'flavor' on Instance uuid 49227d67-dec4-4ee9-aa7b-8e82eef5f65f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:45:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:45:57 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:45:57 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:45:57 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:45:57 user nova-compute[74630]:   <serial>9b96ee83-c24d-475d-86c7-e8fdfbccc503</serial>
Oct 26 03:45:57 user nova-compute[74630]: </disk>
Oct 26 03:45:57 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:45:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:45:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:45:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] No VIF found with MAC fa:16:3e:5c:1f:6b, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:45:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fe6ee6a1-230e-47d0-b002-777d8e21cd6b tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.416s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:45:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:45:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:45:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:45:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:45:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:45:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:45:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:45:59 user nova-compute[74630]: INFO nova.compute.manager [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Detaching volume 9b96ee83-c24d-475d-86c7-e8fdfbccc503
Oct 26 03:45:59 user nova-compute[74630]: INFO nova.virt.block_device [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Attempting to driver detach volume 9b96ee83-c24d-475d-86c7-e8fdfbccc503 from mountpoint /dev/vdb
Oct 26 03:45:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Attempting to detach device vdb from instance 49227d67-dec4-4ee9-aa7b-8e82eef5f65f from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:45:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:45:59 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:45:59 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:45:59 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:45:59 user nova-compute[74630]:   <serial>9b96ee83-c24d-475d-86c7-e8fdfbccc503</serial>
Oct 26 03:45:59 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:45:59 user nova-compute[74630]: </disk>
Oct 26 03:45:59 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:45:59 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Successfully detached device vdb from instance 49227d67-dec4-4ee9-aa7b-8e82eef5f65f from the persistent domain config.
Oct 26 03:45:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49227d67-dec4-4ee9-aa7b-8e82eef5f65f from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:45:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:45:59 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:45:59 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:45:59 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:45:59 user nova-compute[74630]:   <serial>9b96ee83-c24d-475d-86c7-e8fdfbccc503</serial>
Oct 26 03:45:59 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:45:59 user nova-compute[74630]: </disk>
Oct 26 03:45:59 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:46:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49227d67-dec4-4ee9-aa7b-8e82eef5f65f {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:46:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:08 user nova-compute[74630]: DEBUG nova.objects.instance [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'flavor' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:46:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:46:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquired lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:46:08 user nova-compute[74630]: DEBUG nova.network.neutron [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:46:08 user nova-compute[74630]: DEBUG nova.objects.instance [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'info_cache' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:46:08 user nova-compute[74630]: DEBUG nova.objects.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Object Instance<374e50f7-3158-4514-a033-24dba936ecc5> lazy-loaded attributes: flavor,info_cache {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:46:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.network.neutron [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updating instance_info_cache with network_info: [{"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Releasing lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:46:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Instance destroyed successfully.
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.objects.instance [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'resources' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.objects.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Object Instance<374e50f7-3158-4514-a033-24dba936ecc5> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1259939742',display_name='tempest-AttachVolumeTestJSON-server-1259939742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1259939742',id=38,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7EEO3GuKn+8kaEXSCwjJz8D30OIv6uEvszdV2tRdyXKLs86UHQIA++ZVypTxQLfMuMGfMKD5aQHpdWbHtpzsnVd6ppNb9G1YnsHZ9J9cAEGP3hhxc9zL5ZdfAWkgTL4A==',key_name='tempest-keypair-1586338171',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:42:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2671ecf470da4c5093899caa0e5b8313',ramdisk_id='',reservation_id='r-myp0eptt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2036216451',owner_user_name='tempest-AttachVolumeTestJSON-2036216451-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adadef6a5a8437b8ee3931cbeff5467',uuid=374e50f7-3158-4514-a033-24dba936ecc5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converting VIF {"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_vif [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e37d096-7f, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8a9849f-3a04-43a2-a363-0fe6bfbd01a0) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:09 user nova-compute[74630]: INFO os_vif [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f')
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DGthFsok', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:46:09 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[660bb22d-11fc-46eb-bd90-15100b448f31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:46:09 user nova-compute[74630]: No targets found.
Oct 26 03:46:09 user nova-compute[74630]: iSNS:
Oct 26 03:46:09 user nova-compute[74630]: No targets found.
Oct 26 03:46:09 user nova-compute[74630]: STATIC:
Oct 26 03:46:09 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8
Oct 26 03:46:09 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:46:09 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:46:09 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503
Oct 26 03:46:09 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:46:09 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:46:09 user nova-compute[74630]: FIRMWARE:
Oct 26 03:46:09 user nova-compute[74630]: No targets found.
Oct 26 03:46:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:46:09 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:46:09 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8169a4f8-fe3d-4955-a07d-b31468fa4cee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b803210e-eb83-415d-8eb8-d18b30ce5b7a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)
Oct 26 03:46:09 user nova-compute[74630]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 (non-flash)
Oct 26 03:46:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)
Oct 26 03:46:09 user nova-compute[74630]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 (non-flash)
Oct 26 03:46:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c0fcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[204a9a1d-b0a4-4a49-ac77-20009a310664]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca5d18c-d698-468d-9709-05071d585d83]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a860639-1e99-4bb6-a67f-6cc75c694dc1]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee731e4-d6b0-41ba-9606-9a944c2d3462]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8decfff-8c73-4cdf-a6de-760fdee92983]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea07431-0ece-4207-9836-cbc42b3b02cd]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260]
Oct 26 03:46:09 user nova-compute[74630]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260] successful.
Oct 26 03:46:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b300bc63-db48-4166-9ed4-4206d297943a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] <== disconnect_volume: return (290ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Start _get_guest_xml network_info=[{"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DGthFsok', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '374e50f7-3158-4514-a033-24dba936ecc5', 'attached_at': '', 'detached_at': '', 'volume_id': '19b29f4c-d9a5-436b-90c5-a6a3708e3da8', 'serial': '19b29f4c-d9a5-436b-90c5-a6a3708e3da8'}, 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '33437453-b8f7-409c-bc3a-d31e12411f49', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.objects.instance [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'numa_topology' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.objects.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Object Instance<374e50f7-3158-4514-a033-24dba936ecc5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:46:09 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:46:09 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.objects.instance [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'vcpu_model' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.objects.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Object Instance<374e50f7-3158-4514-a033-24dba936ecc5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DGthFsok', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:46:09 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:46:09 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:46:09 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae14718-ea56-4763-ab66-175672cc430c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:46:09 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f849d2-a4c5-41aa-beca-a0f954e2cf1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8] added
Oct 26 03:46:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27f12e9-1a5c-47bc-bf06-dc85ab8631b0]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dbfeed-1ca5-4452-ad03-bea9f55a9228]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DGthFsok {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DGthFsok" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e24dc39-f575-4764-94e7-41ef5cb8acb2]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DGthFsok'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53904e7-f3dc-45fa-bee7-6be80ee896a6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09d6b84-1ee1-476b-b918-98ff840f6d5c]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 (non-flash)
Oct 26 03:46:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 (non-flash)
Oct 26 03:46:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f959cb-20ed-49be-84c8-f0ac60dfa136]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260]
Oct 26 03:46:09 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260] successful.
Oct 26 03:46:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3688d9-ac5f-4839-a9e4-0a59054add1d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccf2ac5-6f09-4f5a-960a-e9aedf8123d9]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 (non-flash)
Oct 26 03:46:09 user nova-compute[74630]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)
Oct 26 03:46:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 (non-flash)
Oct 26 03:46:09 user nova-compute[74630]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)
Oct 26 03:46:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[44032a32-68f6-4b4e-90f8-6e05f4320cd8]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:46:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DGthFsok', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:46:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:46:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23431623939323132', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:46:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431623939323132', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:46:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1259939742',display_name='tempest-AttachVolumeTestJSON-server-1259939742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1259939742',id=38,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7EEO3GuKn+8kaEXSCwjJz8D30OIv6uEvszdV2tRdyXKLs86UHQIA++ZVypTxQLfMuMGfMKD5aQHpdWbHtpzsnVd6ppNb9G1YnsHZ9J9cAEGP3hhxc9zL5ZdfAWkgTL4A==',key_name='tempest-keypair-1586338171',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:42:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2671ecf470da4c5093899caa0e5b8313',ramdisk_id='',reservation_id='r-myp0eptt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2036216451',owner_user_name='tempest-AttachVolumeTestJSON-2036216451-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adadef6a5a8437b8ee3931cbeff5467',uuid=374e50f7-3158-4514-a033-24dba936ecc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:46:10 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converting VIF {"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:46:10 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:46:10 user nova-compute[74630]: DEBUG nova.objects.instance [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'pci_devices' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:46:10 user nova-compute[74630]: DEBUG nova.objects.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Object Instance<374e50f7-3158-4514-a033-24dba936ecc5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:46:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:46:10 user nova-compute[74630]:   <uuid>374e50f7-3158-4514-a033-24dba936ecc5</uuid>
Oct 26 03:46:10 user nova-compute[74630]:   <name>instance-00000026</name>
Oct 26 03:46:10 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:46:10 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:46:10 user nova-compute[74630]:   <metadata>
Oct 26 03:46:10 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:46:10 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:46:10 user nova-compute[74630]:       <nova:name>tempest-AttachVolumeTestJSON-server-1259939742</nova:name>
Oct 26 03:46:10 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:46:09</nova:creationTime>
Oct 26 03:46:10 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:46:10 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:46:10 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:46:10 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:46:10 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:46:10 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:46:10 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:46:10 user nova-compute[74630]:       <nova:owner>
Oct 26 03:46:10 user nova-compute[74630]:         <nova:user uuid="2adadef6a5a8437b8ee3931cbeff5467">tempest-AttachVolumeTestJSON-2036216451-project-member</nova:user>
Oct 26 03:46:10 user nova-compute[74630]:         <nova:project uuid="2671ecf470da4c5093899caa0e5b8313">tempest-AttachVolumeTestJSON-2036216451</nova:project>
Oct 26 03:46:10 user nova-compute[74630]:       </nova:owner>
Oct 26 03:46:10 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:46:10 user nova-compute[74630]:       <nova:ports>
Oct 26 03:46:10 user nova-compute[74630]:         <nova:port uuid="9e37d096-7f88-44a3-829f-e02f76065b09">
Oct 26 03:46:10 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 03:46:10 user nova-compute[74630]:         </nova:port>
Oct 26 03:46:10 user nova-compute[74630]:       </nova:ports>
Oct 26 03:46:10 user nova-compute[74630]:     </nova:instance>
Oct 26 03:46:10 user nova-compute[74630]:   </metadata>
Oct 26 03:46:10 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:46:10 user nova-compute[74630]:     <system>
Oct 26 03:46:10 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:46:10 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:46:10 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:46:10 user nova-compute[74630]:       <entry name="serial">374e50f7-3158-4514-a033-24dba936ecc5</entry>
Oct 26 03:46:10 user nova-compute[74630]:       <entry name="uuid">374e50f7-3158-4514-a033-24dba936ecc5</entry>
Oct 26 03:46:10 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:46:10 user nova-compute[74630]:     </system>
Oct 26 03:46:10 user nova-compute[74630]:   </sysinfo>
Oct 26 03:46:10 user nova-compute[74630]:   <os>
Oct 26 03:46:10 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:46:10 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:46:10 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:46:10 user nova-compute[74630]:   </os>
Oct 26 03:46:10 user nova-compute[74630]:   <features>
Oct 26 03:46:10 user nova-compute[74630]:     <acpi/>
Oct 26 03:46:10 user nova-compute[74630]:     <apic/>
Oct 26 03:46:10 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:46:10 user nova-compute[74630]:   </features>
Oct 26 03:46:10 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:46:10 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:46:10 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:46:10 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:46:10 user nova-compute[74630]:   </clock>
Oct 26 03:46:10 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:46:10 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:46:10 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:46:10 user nova-compute[74630]:   </cpu>
Oct 26 03:46:10 user nova-compute[74630]:   <devices>
Oct 26 03:46:10 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:46:10 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:46:10 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk"/>
Oct 26 03:46:10 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:46:10 user nova-compute[74630]:     </disk>
Oct 26 03:46:10 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:46:10 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:46:10 user nova-compute[74630]:       <source dev="/dev/sdb"/>
Oct 26 03:46:10 user nova-compute[74630]:       <target dev="vdb" bus="virtio"/>
Oct 26 03:46:10 user nova-compute[74630]:       <serial>19b29f4c-d9a5-436b-90c5-a6a3708e3da8</serial>
Oct 26 03:46:10 user nova-compute[74630]:     </disk>
Oct 26 03:46:10 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:46:10 user nova-compute[74630]:       <mac address="fa:16:3e:95:80:23"/>
Oct 26 03:46:10 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:46:10 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:46:10 user nova-compute[74630]:       <target dev="tap9e37d096-7f"/>
Oct 26 03:46:10 user nova-compute[74630]:     </interface>
Oct 26 03:46:10 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:46:10 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/console.log" append="off"/>
Oct 26 03:46:10 user nova-compute[74630]:     </serial>
Oct 26 03:46:10 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:46:10 user nova-compute[74630]:     <video>
Oct 26 03:46:10 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:46:10 user nova-compute[74630]:     </video>
Oct 26 03:46:10 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:46:10 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:46:10 user nova-compute[74630]:     </rng>
Oct 26 03:46:10 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:46:10 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:46:10 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:46:10 user nova-compute[74630]:     </memballoon>
Oct 26 03:46:10 user nova-compute[74630]:   </devices>
Oct 26 03:46:10 user nova-compute[74630]: </domain>
Oct 26 03:46:10 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:46:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG nova.objects.instance [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'trusted_certs' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG nova.objects.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Object Instance<374e50f7-3158-4514-a033-24dba936ecc5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Checking if we can resize image /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Cannot resize image /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG nova.objects.instance [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'migration_context' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG nova.objects.base [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Object Instance<374e50f7-3158-4514-a033-24dba936ecc5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1259939742',display_name='tempest-AttachVolumeTestJSON-server-1259939742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1259939742',id=38,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7EEO3GuKn+8kaEXSCwjJz8D30OIv6uEvszdV2tRdyXKLs86UHQIA++ZVypTxQLfMuMGfMKD5aQHpdWbHtpzsnVd6ppNb9G1YnsHZ9J9cAEGP3hhxc9zL5ZdfAWkgTL4A==',key_name='tempest-keypair-1586338171',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:42:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2671ecf470da4c5093899caa0e5b8313',ramdisk_id='',reservation_id='r-myp0eptt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2036216451',owner_user_name='tempest-AttachVolumeTestJSON-2036216451-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adadef6a5a8437b8ee3931cbeff5467',uuid=374e50f7-3158-4514-a033-24dba936ecc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converting VIF {"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG os_vif [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '523365ec-4501-5a9c-8f66-df07c8d5957c', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e37d096-7f, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e37d096-7f, col_values=(('qos', UUID('39f3dde0-318f-4a30-97f4-a3e05c1b7d9d')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e37d096-7f, col_values=(('external_ids', {'iface-id': '9e37d096-7f88-44a3-829f-e02f76065b09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:80:23', 'vm-uuid': '374e50f7-3158-4514-a033-24dba936ecc5'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:46:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:11 user nova-compute[74630]: INFO os_vif [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f')
Oct 26 03:46:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-8501f5ae-eff4-4292-81f0-a6ad179361ef req-09a071ea-6128-4f4f-97a0-4eb005a5e015 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:46:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8501f5ae-eff4-4292-81f0-a6ad179361ef req-09a071ea-6128-4f4f-97a0-4eb005a5e015 service nova] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8501f5ae-eff4-4292-81f0-a6ad179361ef req-09a071ea-6128-4f4f-97a0-4eb005a5e015 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8501f5ae-eff4-4292-81f0-a6ad179361ef req-09a071ea-6128-4f4f-97a0-4eb005a5e015 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:13 user nova-compute[74630]: DEBUG nova.compute.manager [req-8501f5ae-eff4-4292-81f0-a6ad179361ef req-09a071ea-6128-4f4f-97a0-4eb005a5e015 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] No waiting events found dispatching network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:46:13 user nova-compute[74630]: WARNING nova.compute.manager [req-8501f5ae-eff4-4292-81f0-a6ad179361ef req-09a071ea-6128-4f4f-97a0-4eb005a5e015 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received unexpected event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 for instance with vm_state stopped and task_state powering-on.
Oct 26 03:46:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:46:15 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Instance rebooted successfully.
Oct 26 03:46:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-66e0efde-b172-4bff-ad38-9145aa1ea0e6 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:46:15 user nova-compute[74630]: DEBUG nova.compute.manager [req-3514695c-18d5-4574-9bbe-652869b33b02 req-0f36be95-34d1-482f-a476-e4806e03feeb service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:46:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3514695c-18d5-4574-9bbe-652869b33b02 req-0f36be95-34d1-482f-a476-e4806e03feeb service nova] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3514695c-18d5-4574-9bbe-652869b33b02 req-0f36be95-34d1-482f-a476-e4806e03feeb service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3514695c-18d5-4574-9bbe-652869b33b02 req-0f36be95-34d1-482f-a476-e4806e03feeb service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:15 user nova-compute[74630]: DEBUG nova.compute.manager [req-3514695c-18d5-4574-9bbe-652869b33b02 req-0f36be95-34d1-482f-a476-e4806e03feeb service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] No waiting events found dispatching network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:46:15 user nova-compute[74630]: WARNING nova.compute.manager [req-3514695c-18d5-4574-9bbe-652869b33b02 req-0f36be95-34d1-482f-a476-e4806e03feeb service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received unexpected event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 for instance with vm_state active and task_state None.
Oct 26 03:46:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "6f24bc2f-0ebe-4396-8092-e47359e487f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:17 user nova-compute[74630]: INFO nova.compute.manager [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Terminating instance
Oct 26 03:46:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:46:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-8548e822-1af4-4d02-8df9-21030d1e3f64 req-3ece06a6-d2f9-40e8-8122-962df7b74e6e service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received event network-vif-unplugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8548e822-1af4-4d02-8df9-21030d1e3f64 req-3ece06a6-d2f9-40e8-8122-962df7b74e6e service nova] Acquiring lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8548e822-1af4-4d02-8df9-21030d1e3f64 req-3ece06a6-d2f9-40e8-8122-962df7b74e6e service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8548e822-1af4-4d02-8df9-21030d1e3f64 req-3ece06a6-d2f9-40e8-8122-962df7b74e6e service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-8548e822-1af4-4d02-8df9-21030d1e3f64 req-3ece06a6-d2f9-40e8-8122-962df7b74e6e service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] No waiting events found dispatching network-vif-unplugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-8548e822-1af4-4d02-8df9-21030d1e3f64 req-3ece06a6-d2f9-40e8-8122-962df7b74e6e service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received event network-vif-unplugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Instance destroyed successfully.
Oct 26 03:46:18 user nova-compute[74630]: DEBUG nova.objects.instance [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lazy-loading 'resources' on Instance uuid 6f24bc2f-0ebe-4396-8092-e47359e487f7 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T03:40:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1079081659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1079081659',id=36,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4pnXjePQKongg0073ePUq3elKsrVvcE0c6puyFMqhhc7dNiVqwmLETRyyKnopMZJ324XyvbebT/3iS0ew2/xmsVpLHHUPRLKIWUHbyzzDJsFfQClV/n9RroLJy7l6mcA==',key_name='tempest-keypair-1872227064',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f44335320f77434999514ed6824a2e23',ramdisk_id='',reservation_id='r-7ajka82n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1268856411',owner_user_name='tempest-AttachVolumeShelveTestJSON-1268856411-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:44:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89f51acc12a54e7bbd38e975f2d7632e',uuid=6f24bc2f-0ebe-4396-8092-e47359e487f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converting VIF {"id": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "address": "fa:16:3e:51:b4:36", "network": {"id": "10217d32-89fa-4f4a-a225-19f959e3abeb", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2032414377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f44335320f77434999514ed6824a2e23", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589b5294-80", "ovs_interfaceid": "589b5294-80b4-4245-88b8-ea2a3b0a2560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=589b5294-80b4-4245-88b8-ea2a3b0a2560,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589b5294-80') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG os_vif [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=589b5294-80b4-4245-88b8-ea2a3b0a2560,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589b5294-80') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap589b5294-80, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed859440-dab1-4e48-a3ad-4a655580ccb5) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:46:18 user nova-compute[74630]: INFO os_vif [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:b4:36,bridge_name='br-int',has_traffic_filtering=True,id=589b5294-80b4-4245-88b8-ea2a3b0a2560,network=Network(10217d32-89fa-4f4a-a225-19f959e3abeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589b5294-80')
Oct 26 03:46:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Deleting instance files /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7_del
Oct 26 03:46:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Deletion of /opt/stack/data/nova/instances/6f24bc2f-0ebe-4396-8092-e47359e487f7_del complete
Oct 26 03:46:18 user nova-compute[74630]: INFO nova.compute.manager [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 26 03:46:18 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:46:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:46:20 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Took 1.26 seconds to deallocate network for instance.
Oct 26 03:46:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-6807dea9-5013-49fe-9bb8-107fdf134011 req-a34e7000-c899-4de3-88c0-31c0606f9030 service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received event network-vif-deleted-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-8200d199-980d-47a8-b5d9-9d016034fdec req-1058a0b1-3513-4651-bf57-3051a32179db service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received event network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8200d199-980d-47a8-b5d9-9d016034fdec req-1058a0b1-3513-4651-bf57-3051a32179db service nova] Acquiring lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8200d199-980d-47a8-b5d9-9d016034fdec req-1058a0b1-3513-4651-bf57-3051a32179db service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8200d199-980d-47a8-b5d9-9d016034fdec req-1058a0b1-3513-4651-bf57-3051a32179db service nova] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-8200d199-980d-47a8-b5d9-9d016034fdec req-1058a0b1-3513-4651-bf57-3051a32179db service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] No waiting events found dispatching network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:46:20 user nova-compute[74630]: WARNING nova.compute.manager [req-8200d199-980d-47a8-b5d9-9d016034fdec req-1058a0b1-3513-4651-bf57-3051a32179db service nova] [instance: 6f24bc2f-0ebe-4396-8092-e47359e487f7] Received unexpected event network-vif-plugged-589b5294-80b4-4245-88b8-ea2a3b0a2560 for instance with vm_state active and task_state deleting.
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:20 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 49227d67-dec4-4ee9-aa7b-8e82eef5f65f is timed out.
Oct 26 03:46:20 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Successfully detached device vdb from instance 49227d67-dec4-4ee9-aa7b-8e82eef5f65f from the live domain config.
Oct 26 03:46:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWZrlPAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:46:20 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cb45cd-f467-4e7d-909f-75943ac3bf8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:46:20 user nova-compute[74630]: No targets found.
Oct 26 03:46:20 user nova-compute[74630]: iSNS:
Oct 26 03:46:20 user nova-compute[74630]: No targets found.
Oct 26 03:46:20 user nova-compute[74630]: STATIC:
Oct 26 03:46:20 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8
Oct 26 03:46:20 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:46:20 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:46:20 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503
Oct 26 03:46:20 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:46:20 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:46:20 user nova-compute[74630]: FIRMWARE:
Oct 26 03:46:20 user nova-compute[74630]: No targets found.
Oct 26 03:46:20 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:46:20 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:46:20 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[94350752-5133-48a6-b113-a544779fa7dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0111d1-c520-40f8-97aa-04c3352d3f57]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 (non-flash)
Oct 26 03:46:20 user nova-compute[74630]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)
Oct 26 03:46:20 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 (non-flash)
Oct 26 03:46:20 user nova-compute[74630]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)
Oct 26 03:46:20 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3184249750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503'): ({'sdc'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Removing single pathed devices sdc {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f9a76b-3c28-46a7-8304-b5ec743ca7ff]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a205c0-ada4-4de4-96a1-258654580dc0]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Flushing IO for device /dev/sdc {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[660d53f3-71c6-4e97-8bec-dd3728de12ac]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:20 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Deleted allocations for instance 6f24bc2f-0ebe-4396-8092-e47359e487f7
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9846ac-1ccf-4c38-8f2a-9aebc96a9b39]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a720697-77b5-4224-81ef-36e8f05e866d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4d0f0161-e28f-4e0f-97c1-5feaf3c18e0f tempest-AttachVolumeShelveTestJSON-1268856411 tempest-AttachVolumeShelveTestJSON-1268856411-project-member] Lock "6f24bc2f-0ebe-4396-8092-e47359e487f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.712s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64cfdc3-a7a3-47e7-972c-5780b4c61bd0]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503, portal: 172.16.0.220,3260]
Oct 26 03:46:20 user nova-compute[74630]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503, portal: 172.16.0.220,3260] successful.
Oct 26 03:46:20 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b96ee83-c24d-475d-86c7-e8fdfbccc503 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e54e90-a323-4c71-93a7-1a1865b40d9f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] <== disconnect_volume: return (376ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:46:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:46:21 user nova-compute[74630]: DEBUG nova.objects.instance [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'flavor' on Instance uuid 49227d67-dec4-4ee9-aa7b-8e82eef5f65f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:46:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-f27e8498-a868-433d-a292-1069628fbaff tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.983s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:23 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:46:23 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 03:46:23 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] There are 0 instances to clean {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 03:46:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:46:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:46:29 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:46:33 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:46:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:46:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:46:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:46:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:46:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:46:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:46:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:46:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74630) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 03:46:38 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:46:38 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:46:38 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:46:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-49227d67-dec4-4ee9-aa7b-8e82eef5f65f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:46:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-49227d67-dec4-4ee9-aa7b-8e82eef5f65f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:46:38 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:46:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:38 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Updating instance_info_cache with network_info: [{"id": "eb39c336-c6f1-44df-8ead-7a1499131787", "address": "fa:16:3e:5c:1f:6b", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb39c336-c6", "ovs_interfaceid": "eb39c336-c6f1-44df-8ead-7a1499131787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:46:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-49227d67-dec4-4ee9-aa7b-8e82eef5f65f" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:46:38 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:46:38 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:46:39 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:46:40 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:46:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:40 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:46:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:40 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:46:41 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:46:41 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:46:41 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8760MB free_disk=25.07128143310547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:46:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:41 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 374e50f7-3158-4514-a033-24dba936ecc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:46:41 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 49227d67-dec4-4ee9-aa7b-8e82eef5f65f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:46:41 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:46:41 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:46:41 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:46:41 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:46:41 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:46:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:44 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:46:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:45 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:46:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:46:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:49 user nova-compute[74630]: INFO nova.compute.manager [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Terminating instance
Oct 26 03:46:49 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-718e15bc-3e42-4e3c-b6e3-d457f855a6c7 req-6c49e1ea-9b39-446c-ad2f-35c423ac0701 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Received event network-vif-unplugged-eb39c336-c6f1-44df-8ead-7a1499131787 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-718e15bc-3e42-4e3c-b6e3-d457f855a6c7 req-6c49e1ea-9b39-446c-ad2f-35c423ac0701 service nova] Acquiring lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-718e15bc-3e42-4e3c-b6e3-d457f855a6c7 req-6c49e1ea-9b39-446c-ad2f-35c423ac0701 service nova] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-718e15bc-3e42-4e3c-b6e3-d457f855a6c7 req-6c49e1ea-9b39-446c-ad2f-35c423ac0701 service nova] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-718e15bc-3e42-4e3c-b6e3-d457f855a6c7 req-6c49e1ea-9b39-446c-ad2f-35c423ac0701 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] No waiting events found dispatching network-vif-unplugged-eb39c336-c6f1-44df-8ead-7a1499131787 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-718e15bc-3e42-4e3c-b6e3-d457f855a6c7 req-6c49e1ea-9b39-446c-ad2f-35c423ac0701 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Received event network-vif-unplugged-eb39c336-c6f1-44df-8ead-7a1499131787 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:50 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Instance destroyed successfully.
Oct 26 03:46:50 user nova-compute[74630]: DEBUG nova.objects.instance [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lazy-loading 'resources' on Instance uuid 49227d67-dec4-4ee9-aa7b-8e82eef5f65f {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-338213653',display_name='tempest-AttachVolumeNegativeTest-server-338213653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-338213653',id=39,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBb9pFBB70saaq0sRLYF+6o89FzYRcHrXVkiA8yGjDNwqwrtFtiV9XygSVcqZ+z/fIZNgCW5+WgoONvqGCPLsSuI1FcnR2QOqHJsLtjiCwvoAWxNCKORj7Bt2cdBk7OHxw==',key_name='tempest-keypair-450160054',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:43:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ebfc20893da40c1b25be2444441f0c3',ramdisk_id='',reservation_id='r-rr7a9pw7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2146381855',owner_user_name='tempest-AttachVolumeNegativeTest-2146381855-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:43:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc35b87a18e44b3392d122e392a0b8fb',uuid=49227d67-dec4-4ee9-aa7b-8e82eef5f65f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb39c336-c6f1-44df-8ead-7a1499131787", "address": "fa:16:3e:5c:1f:6b", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb39c336-c6", "ovs_interfaceid": "eb39c336-c6f1-44df-8ead-7a1499131787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converting VIF {"id": "eb39c336-c6f1-44df-8ead-7a1499131787", "address": "fa:16:3e:5c:1f:6b", "network": {"id": "a7090c84-d34f-4605-b54a-f0520d1f8baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1336657833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ebfc20893da40c1b25be2444441f0c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb39c336-c6", "ovs_interfaceid": "eb39c336-c6f1-44df-8ead-7a1499131787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:1f:6b,bridge_name='br-int',has_traffic_filtering=True,id=eb39c336-c6f1-44df-8ead-7a1499131787,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb39c336-c6') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG os_vif [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:1f:6b,bridge_name='br-int',has_traffic_filtering=True,id=eb39c336-c6f1-44df-8ead-7a1499131787,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb39c336-c6') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb39c336-c6, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d1eb0e6-8b45-4adf-b9cd-9359cf409ffc) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:46:50 user nova-compute[74630]: INFO os_vif [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:1f:6b,bridge_name='br-int',has_traffic_filtering=True,id=eb39c336-c6f1-44df-8ead-7a1499131787,network=Network(a7090c84-d34f-4605-b54a-f0520d1f8baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb39c336-c6')
Oct 26 03:46:50 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Deleting instance files /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f_del
Oct 26 03:46:50 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Deletion of /opt/stack/data/nova/instances/49227d67-dec4-4ee9-aa7b-8e82eef5f65f_del complete
Oct 26 03:46:50 user nova-compute[74630]: INFO nova.compute.manager [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 26 03:46:50 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:46:50 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:46:51 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:46:51 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Took 0.98 seconds to deallocate network for instance.
Oct 26 03:46:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-8ad688f8-5357-4ee6-ae80-13db60708590 req-bed10001-7ecc-4721-9a3b-bf4dd423c765 service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Received event network-vif-deleted-eb39c336-c6f1-44df-8ead-7a1499131787 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:46:51 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:46:52 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:46:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:52 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Deleted allocations for instance 49227d67-dec4-4ee9-aa7b-8e82eef5f65f
Oct 26 03:46:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d5fba624-4d66-4895-b4e9-23681642ffc6 tempest-AttachVolumeNegativeTest-2146381855 tempest-AttachVolumeNegativeTest-2146381855-project-member] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.183s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-bf147911-2f3a-4fd7-9271-5f4a2077907c req-72c1e42b-d7bd-4402-836f-9a5cf1ecab4e service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Received event network-vif-plugged-eb39c336-c6f1-44df-8ead-7a1499131787 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:46:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bf147911-2f3a-4fd7-9271-5f4a2077907c req-72c1e42b-d7bd-4402-836f-9a5cf1ecab4e service nova] Acquiring lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bf147911-2f3a-4fd7-9271-5f4a2077907c req-72c1e42b-d7bd-4402-836f-9a5cf1ecab4e service nova] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bf147911-2f3a-4fd7-9271-5f4a2077907c req-72c1e42b-d7bd-4402-836f-9a5cf1ecab4e service nova] Lock "49227d67-dec4-4ee9-aa7b-8e82eef5f65f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-bf147911-2f3a-4fd7-9271-5f4a2077907c req-72c1e42b-d7bd-4402-836f-9a5cf1ecab4e service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] No waiting events found dispatching network-vif-plugged-eb39c336-c6f1-44df-8ead-7a1499131787 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:46:52 user nova-compute[74630]: WARNING nova.compute.manager [req-bf147911-2f3a-4fd7-9271-5f4a2077907c req-72c1e42b-d7bd-4402-836f-9a5cf1ecab4e service nova] [instance: 49227d67-dec4-4ee9-aa7b-8e82eef5f65f] Received unexpected event network-vif-plugged-eb39c336-c6f1-44df-8ead-7a1499131787 for instance with vm_state deleted and task_state None.
Oct 26 03:46:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "a8bd5662-6925-4007-a791-52e8a60e82c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:46:54 user nova-compute[74630]: INFO nova.compute.claims [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Claim successful on node user
Oct 26 03:46:54 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Refreshing inventories for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Updating ProviderTree inventory for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Updating inventory in ProviderTree for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Refreshing aggregate associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, aggregates: None {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Refreshing trait associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, traits: HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG nova.compute.manager [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG nova.compute.manager [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG nova.network.neutron [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:46:54 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:46:54 user nova-compute[74630]: DEBUG nova.compute.manager [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG nova.policy [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5489febd6fe4bbdb5eb7ff82cf11873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac8dcda91df4de894e45692b2ad24a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG nova.compute.manager [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:46:54 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Creating image(s)
Oct 26 03:46:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "/opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "/opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.171s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.172s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Successfully created port: 67d2f91c-6922-4b28-87da-3c8909206f08 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk 1073741824" returned: 0 in 0.049s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Cannot resize image /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Ensure instance console log exists: /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Successfully updated port: 67d2f91c-6922-4b28-87da-3c8909206f08 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "refresh_cache-a8bd5662-6925-4007-a791-52e8a60e82c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquired lock "refresh_cache-a8bd5662-6925-4007-a791-52e8a60e82c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-7436845c-25ca-4e30-91c6-1eab61afde2e req-a4e90474-229b-4795-b23a-ae7087b25000 service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Received event network-changed-67d2f91c-6922-4b28-87da-3c8909206f08 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-7436845c-25ca-4e30-91c6-1eab61afde2e req-a4e90474-229b-4795-b23a-ae7087b25000 service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Refreshing instance network info cache due to event network-changed-67d2f91c-6922-4b28-87da-3c8909206f08. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7436845c-25ca-4e30-91c6-1eab61afde2e req-a4e90474-229b-4795-b23a-ae7087b25000 service nova] Acquiring lock "refresh_cache-a8bd5662-6925-4007-a791-52e8a60e82c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:46:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Updating instance_info_cache with network_info: [{"id": "67d2f91c-6922-4b28-87da-3c8909206f08", "address": "fa:16:3e:e8:38:ac", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d2f91c-69", "ovs_interfaceid": "67d2f91c-6922-4b28-87da-3c8909206f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Releasing lock "refresh_cache-a8bd5662-6925-4007-a791-52e8a60e82c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Instance network_info: |[{"id": "67d2f91c-6922-4b28-87da-3c8909206f08", "address": "fa:16:3e:e8:38:ac", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d2f91c-69", "ovs_interfaceid": "67d2f91c-6922-4b28-87da-3c8909206f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7436845c-25ca-4e30-91c6-1eab61afde2e req-a4e90474-229b-4795-b23a-ae7087b25000 service nova] Acquired lock "refresh_cache-a8bd5662-6925-4007-a791-52e8a60e82c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.network.neutron [req-7436845c-25ca-4e30-91c6-1eab61afde2e req-a4e90474-229b-4795-b23a-ae7087b25000 service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Refreshing network info cache for port 67d2f91c-6922-4b28-87da-3c8909206f08 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Start _get_guest_xml network_info=[{"id": "67d2f91c-6922-4b28-87da-3c8909206f08", "address": "fa:16:3e:e8:38:ac", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d2f91c-69", "ovs_interfaceid": "67d2f91c-6922-4b28-87da-3c8909206f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:46:56 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:46:56 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1914419421',display_name='tempest-VolumesActionsTest-instance-1914419421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1914419421',id=40,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac8dcda91df4de894e45692b2ad24a7',ramdisk_id='',reservation_id='r-eonwqwpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-672192502',owner_user_name='tempest-VolumesActionsTest-672192502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:46:55Z,user_data=None,user_id='f5489febd6fe4bbdb5eb7ff82cf11873',uuid=a8bd5662-6925-4007-a791-52e8a60e82c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67d2f91c-6922-4b28-87da-3c8909206f08", "address": "fa:16:3e:e8:38:ac", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d2f91c-69", "ovs_interfaceid": "67d2f91c-6922-4b28-87da-3c8909206f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Converting VIF {"id": "67d2f91c-6922-4b28-87da-3c8909206f08", "address": "fa:16:3e:e8:38:ac", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d2f91c-69", "ovs_interfaceid": "67d2f91c-6922-4b28-87da-3c8909206f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:38:ac,bridge_name='br-int',has_traffic_filtering=True,id=67d2f91c-6922-4b28-87da-3c8909206f08,network=Network(25c4b751-e4df-4653-9cf7-e43a583f48f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d2f91c-69') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.objects.instance [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lazy-loading 'pci_devices' on Instance uuid a8bd5662-6925-4007-a791-52e8a60e82c6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:46:56 user nova-compute[74630]:   <uuid>a8bd5662-6925-4007-a791-52e8a60e82c6</uuid>
Oct 26 03:46:56 user nova-compute[74630]:   <name>instance-00000028</name>
Oct 26 03:46:56 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:46:56 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:46:56 user nova-compute[74630]:   <metadata>
Oct 26 03:46:56 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:46:56 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:46:56 user nova-compute[74630]:       <nova:name>tempest-VolumesActionsTest-instance-1914419421</nova:name>
Oct 26 03:46:56 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:46:56</nova:creationTime>
Oct 26 03:46:56 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:46:56 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:46:56 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:46:56 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:46:56 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:46:56 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:46:56 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:46:56 user nova-compute[74630]:       <nova:owner>
Oct 26 03:46:56 user nova-compute[74630]:         <nova:user uuid="f5489febd6fe4bbdb5eb7ff82cf11873">tempest-VolumesActionsTest-672192502-project-member</nova:user>
Oct 26 03:46:56 user nova-compute[74630]:         <nova:project uuid="2ac8dcda91df4de894e45692b2ad24a7">tempest-VolumesActionsTest-672192502</nova:project>
Oct 26 03:46:56 user nova-compute[74630]:       </nova:owner>
Oct 26 03:46:56 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:46:56 user nova-compute[74630]:       <nova:ports>
Oct 26 03:46:56 user nova-compute[74630]:         <nova:port uuid="67d2f91c-6922-4b28-87da-3c8909206f08">
Oct 26 03:46:56 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 03:46:56 user nova-compute[74630]:         </nova:port>
Oct 26 03:46:56 user nova-compute[74630]:       </nova:ports>
Oct 26 03:46:56 user nova-compute[74630]:     </nova:instance>
Oct 26 03:46:56 user nova-compute[74630]:   </metadata>
Oct 26 03:46:56 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:46:56 user nova-compute[74630]:     <system>
Oct 26 03:46:56 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:46:56 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:46:56 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:46:56 user nova-compute[74630]:       <entry name="serial">a8bd5662-6925-4007-a791-52e8a60e82c6</entry>
Oct 26 03:46:56 user nova-compute[74630]:       <entry name="uuid">a8bd5662-6925-4007-a791-52e8a60e82c6</entry>
Oct 26 03:46:56 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:46:56 user nova-compute[74630]:     </system>
Oct 26 03:46:56 user nova-compute[74630]:   </sysinfo>
Oct 26 03:46:56 user nova-compute[74630]:   <os>
Oct 26 03:46:56 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:46:56 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:46:56 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:46:56 user nova-compute[74630]:   </os>
Oct 26 03:46:56 user nova-compute[74630]:   <features>
Oct 26 03:46:56 user nova-compute[74630]:     <acpi/>
Oct 26 03:46:56 user nova-compute[74630]:     <apic/>
Oct 26 03:46:56 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:46:56 user nova-compute[74630]:   </features>
Oct 26 03:46:56 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:46:56 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:46:56 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:46:56 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:46:56 user nova-compute[74630]:   </clock>
Oct 26 03:46:56 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:46:56 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:46:56 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:46:56 user nova-compute[74630]:   </cpu>
Oct 26 03:46:56 user nova-compute[74630]:   <devices>
Oct 26 03:46:56 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:46:56 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:46:56 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk"/>
Oct 26 03:46:56 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:46:56 user nova-compute[74630]:     </disk>
Oct 26 03:46:56 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:46:56 user nova-compute[74630]:       <mac address="fa:16:3e:e8:38:ac"/>
Oct 26 03:46:56 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:46:56 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:46:56 user nova-compute[74630]:       <target dev="tap67d2f91c-69"/>
Oct 26 03:46:56 user nova-compute[74630]:     </interface>
Oct 26 03:46:56 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:46:56 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/console.log" append="off"/>
Oct 26 03:46:56 user nova-compute[74630]:     </serial>
Oct 26 03:46:56 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:46:56 user nova-compute[74630]:     <video>
Oct 26 03:46:56 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:46:56 user nova-compute[74630]:     </video>
Oct 26 03:46:56 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:46:56 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:46:56 user nova-compute[74630]:     </rng>
Oct 26 03:46:56 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:46:56 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:46:56 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:46:56 user nova-compute[74630]:     </memballoon>
Oct 26 03:46:56 user nova-compute[74630]:   </devices>
Oct 26 03:46:56 user nova-compute[74630]: </domain>
Oct 26 03:46:56 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1914419421',display_name='tempest-VolumesActionsTest-instance-1914419421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1914419421',id=40,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac8dcda91df4de894e45692b2ad24a7',ramdisk_id='',reservation_id='r-eonwqwpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-672192502',owner_user_name='tempest-VolumesActionsTest-672192502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:46:55Z,user_data=None,user_id='f5489febd6fe4bbdb5eb7ff82cf11873',uuid=a8bd5662-6925-4007-a791-52e8a60e82c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67d2f91c-6922-4b28-87da-3c8909206f08", "address": "fa:16:3e:e8:38:ac", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d2f91c-69", "ovs_interfaceid": "67d2f91c-6922-4b28-87da-3c8909206f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Converting VIF {"id": "67d2f91c-6922-4b28-87da-3c8909206f08", "address": "fa:16:3e:e8:38:ac", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d2f91c-69", "ovs_interfaceid": "67d2f91c-6922-4b28-87da-3c8909206f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:38:ac,bridge_name='br-int',has_traffic_filtering=True,id=67d2f91c-6922-4b28-87da-3c8909206f08,network=Network(25c4b751-e4df-4653-9cf7-e43a583f48f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d2f91c-69') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG os_vif [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:38:ac,bridge_name='br-int',has_traffic_filtering=True,id=67d2f91c-6922-4b28-87da-3c8909206f08,network=Network(25c4b751-e4df-4653-9cf7-e43a583f48f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d2f91c-69') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2aaaf277-f82c-55be-84ed-5c9669f4a282', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67d2f91c-69, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67d2f91c-69, col_values=(('qos', UUID('0270ad28-60ab-493c-89e5-090d4c06ade6')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67d2f91c-69, col_values=(('external_ids', {'iface-id': '67d2f91c-6922-4b28-87da-3c8909206f08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:38:ac', 'vm-uuid': 'a8bd5662-6925-4007-a791-52e8a60e82c6'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:56 user nova-compute[74630]: INFO os_vif [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:38:ac,bridge_name='br-int',has_traffic_filtering=True,id=67d2f91c-6922-4b28-87da-3c8909206f08,network=Network(25c4b751-e4df-4653-9cf7-e43a583f48f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d2f91c-69')
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] No VIF found with MAC fa:16:3e:e8:38:ac, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.network.neutron [req-7436845c-25ca-4e30-91c6-1eab61afde2e req-a4e90474-229b-4795-b23a-ae7087b25000 service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Updated VIF entry in instance network info cache for port 67d2f91c-6922-4b28-87da-3c8909206f08. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG nova.network.neutron [req-7436845c-25ca-4e30-91c6-1eab61afde2e req-a4e90474-229b-4795-b23a-ae7087b25000 service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Updating instance_info_cache with network_info: [{"id": "67d2f91c-6922-4b28-87da-3c8909206f08", "address": "fa:16:3e:e8:38:ac", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d2f91c-69", "ovs_interfaceid": "67d2f91c-6922-4b28-87da-3c8909206f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:46:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7436845c-25ca-4e30-91c6-1eab61afde2e req-a4e90474-229b-4795-b23a-ae7087b25000 service nova] Releasing lock "refresh_cache-a8bd5662-6925-4007-a791-52e8a60e82c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:46:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:57 user nova-compute[74630]: DEBUG nova.compute.manager [req-7af610e0-f213-4036-ae9e-474118ec42e0 req-1eb6a6c4-c45a-43ac-a701-85980cad20d0 service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Received event network-vif-plugged-67d2f91c-6922-4b28-87da-3c8909206f08 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:46:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7af610e0-f213-4036-ae9e-474118ec42e0 req-1eb6a6c4-c45a-43ac-a701-85980cad20d0 service nova] Acquiring lock "a8bd5662-6925-4007-a791-52e8a60e82c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7af610e0-f213-4036-ae9e-474118ec42e0 req-1eb6a6c4-c45a-43ac-a701-85980cad20d0 service nova] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7af610e0-f213-4036-ae9e-474118ec42e0 req-1eb6a6c4-c45a-43ac-a701-85980cad20d0 service nova] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:57 user nova-compute[74630]: DEBUG nova.compute.manager [req-7af610e0-f213-4036-ae9e-474118ec42e0 req-1eb6a6c4-c45a-43ac-a701-85980cad20d0 service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] No waiting events found dispatching network-vif-plugged-67d2f91c-6922-4b28-87da-3c8909206f08 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:46:57 user nova-compute[74630]: WARNING nova.compute.manager [req-7af610e0-f213-4036-ae9e-474118ec42e0 req-1eb6a6c4-c45a-43ac-a701-85980cad20d0 service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Received unexpected event network-vif-plugged-67d2f91c-6922-4b28-87da-3c8909206f08 for instance with vm_state building and task_state spawning.
Oct 26 03:46:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:46:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:46:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:46:59 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Instance spawned successfully.
Oct 26 03:46:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:46:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:46:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:46:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:46:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:46:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:46:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:46:59 user nova-compute[74630]: DEBUG nova.compute.manager [req-6befb7e5-8d45-4f29-8507-5f025b6c637c req-cafe31f7-7f5d-4e26-96fb-35643647fe97 service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Received event network-vif-plugged-67d2f91c-6922-4b28-87da-3c8909206f08 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:46:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6befb7e5-8d45-4f29-8507-5f025b6c637c req-cafe31f7-7f5d-4e26-96fb-35643647fe97 service nova] Acquiring lock "a8bd5662-6925-4007-a791-52e8a60e82c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:46:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6befb7e5-8d45-4f29-8507-5f025b6c637c req-cafe31f7-7f5d-4e26-96fb-35643647fe97 service nova] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:46:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6befb7e5-8d45-4f29-8507-5f025b6c637c req-cafe31f7-7f5d-4e26-96fb-35643647fe97 service nova] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:46:59 user nova-compute[74630]: DEBUG nova.compute.manager [req-6befb7e5-8d45-4f29-8507-5f025b6c637c req-cafe31f7-7f5d-4e26-96fb-35643647fe97 service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] No waiting events found dispatching network-vif-plugged-67d2f91c-6922-4b28-87da-3c8909206f08 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:46:59 user nova-compute[74630]: WARNING nova.compute.manager [req-6befb7e5-8d45-4f29-8507-5f025b6c637c req-cafe31f7-7f5d-4e26-96fb-35643647fe97 service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Received unexpected event network-vif-plugged-67d2f91c-6922-4b28-87da-3c8909206f08 for instance with vm_state building and task_state spawning.
Oct 26 03:46:59 user nova-compute[74630]: INFO nova.compute.manager [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Took 5.07 seconds to spawn the instance on the hypervisor.
Oct 26 03:46:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:46:59 user nova-compute[74630]: INFO nova.compute.manager [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Took 5.75 seconds to build instance.
Oct 26 03:46:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fd15b700-b8a6-4c2a-a950-1b401918e8af tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.851s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:47:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:12 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:47:12 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:47:12 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid a8bd5662-6925-4007-a791-52e8a60e82c6 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:47:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:47:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "374e50f7-3158-4514-a033-24dba936ecc5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:47:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "a8bd5662-6925-4007-a791-52e8a60e82c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:47:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:47:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "374e50f7-3158-4514-a033-24dba936ecc5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:47:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:47:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:47:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:35 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:47:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:38 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:47:38 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:47:38 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 03:47:39 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:47:39 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:47:39 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:47:40 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:47:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:42 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:47:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:47:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:47:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:47:42 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:47:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:47:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:47:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:47:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:47:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:47:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:47:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:47:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:47:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:47:43 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:47:43 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:47:43 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8754MB free_disk=25.06021499633789GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:47:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:47:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:47:43 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 374e50f7-3158-4514-a033-24dba936ecc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:47:43 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance a8bd5662-6925-4007-a791-52e8a60e82c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:47:43 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:47:43 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:47:43 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:47:43 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:47:43 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:47:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:47:44 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:47:46 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:47:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:47:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:47:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:47:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:47:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:47:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:47:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:47:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:47:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:47:59 user nova-compute[74630]: INFO nova.compute.manager [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Detaching volume 19b29f4c-d9a5-436b-90c5-a6a3708e3da8
Oct 26 03:47:59 user nova-compute[74630]: INFO nova.virt.block_device [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Attempting to driver detach volume 19b29f4c-d9a5-436b-90c5-a6a3708e3da8 from mountpoint /dev/vdb
Oct 26 03:47:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Attempting to detach device vdb from instance 374e50f7-3158-4514-a033-24dba936ecc5 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:47:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:47:59 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:47:59 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 03:47:59 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:47:59 user nova-compute[74630]:   <serial>19b29f4c-d9a5-436b-90c5-a6a3708e3da8</serial>
Oct 26 03:47:59 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 03:47:59 user nova-compute[74630]: </disk>
Oct 26 03:47:59 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:47:59 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Successfully detached device vdb from instance 374e50f7-3158-4514-a033-24dba936ecc5 from the persistent domain config.
Oct 26 03:47:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 374e50f7-3158-4514-a033-24dba936ecc5 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:47:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:47:59 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:47:59 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 03:47:59 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:47:59 user nova-compute[74630]:   <serial>19b29f4c-d9a5-436b-90c5-a6a3708e3da8</serial>
Oct 26 03:47:59 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 03:47:59 user nova-compute[74630]: </disk>
Oct 26 03:47:59 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:48:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:48:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:48:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:48:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:48:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:48:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:20 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 374e50f7-3158-4514-a033-24dba936ecc5 is timed out.
Oct 26 03:48:20 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Successfully detached device vdb from instance 374e50f7-3158-4514-a033-24dba936ecc5 from the live domain config.
Oct 26 03:48:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DGthFsok', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:48:20 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8951211-5c50-4088-b712-01a2c0692b41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:48:20 user nova-compute[74630]: No targets found.
Oct 26 03:48:20 user nova-compute[74630]: iSNS:
Oct 26 03:48:20 user nova-compute[74630]: No targets found.
Oct 26 03:48:20 user nova-compute[74630]: STATIC:
Oct 26 03:48:20 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8
Oct 26 03:48:20 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:48:20 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:48:20 user nova-compute[74630]: FIRMWARE:
Oct 26 03:48:20 user nova-compute[74630]: No targets found.
Oct 26 03:48:20 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:48:20 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:48:20 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b79bb38-d27b-46d1-9b78-7dff89a56f6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc78619-a435-48a2-beb8-53c1b5da8704]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)
Oct 26 03:48:20 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 (non-flash)
Oct 26 03:48:20 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c0ff1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3b460f-0f87-4232-9fa7-8d90a2e0f4ff]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f00cbf-7983-43f8-8167-ba7237dd6f55]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aac5bc-d303-443c-9f4d-6ee2db9bb3da]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[673a3518-4b28-4557-b56d-803d8091780a]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7456978-f736-4766-9ebc-c564c244958e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba18cd6c-8da6-471e-a618-eb4e8df6f2c5]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260]
Oct 26 03:48:20 user nova-compute[74630]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8, portal: 172.16.0.220,3260] successful.
Oct 26 03:48:20 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19b29f4c-d9a5-436b-90c5-a6a3708e3da8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ed64fa-3a25-48ec-bc97-338004d382fd]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] <== disconnect_volume: return (293ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:48:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:48:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:48:21 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'flavor' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:48:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b7d89035-36b4-4136-8f1f-8f396ae99099 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.753s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:48:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3a76c28-8498-4db2-a30b-01213b5e309a tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:48:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3a76c28-8498-4db2-a30b-01213b5e309a tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:48:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d3a76c28-8498-4db2-a30b-01213b5e309a tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:48:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d3a76c28-8498-4db2-a30b-01213b5e309a tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74630) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 26 03:48:22 user nova-compute[74630]: DEBUG nova.objects.instance [None req-d3a76c28-8498-4db2-a30b-01213b5e309a tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'flavor' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:48:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-6ea50ab7-60c5-418f-8a42-67cb08e3bf1e req-4e727009-f00a-4440-8757-80ca199f60a1 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-vif-unplugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:48:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6ea50ab7-60c5-418f-8a42-67cb08e3bf1e req-4e727009-f00a-4440-8757-80ca199f60a1 service nova] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:48:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6ea50ab7-60c5-418f-8a42-67cb08e3bf1e req-4e727009-f00a-4440-8757-80ca199f60a1 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:48:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6ea50ab7-60c5-418f-8a42-67cb08e3bf1e req-4e727009-f00a-4440-8757-80ca199f60a1 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:48:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-6ea50ab7-60c5-418f-8a42-67cb08e3bf1e req-4e727009-f00a-4440-8757-80ca199f60a1 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] No waiting events found dispatching network-vif-unplugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:48:22 user nova-compute[74630]: WARNING nova.compute.manager [req-6ea50ab7-60c5-418f-8a42-67cb08e3bf1e req-4e727009-f00a-4440-8757-80ca199f60a1 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received unexpected event network-vif-unplugged-9e37d096-7f88-44a3-829f-e02f76065b09 for instance with vm_state active and task_state powering-off.
Oct 26 03:48:23 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Instance destroyed successfully.
Oct 26 03:48:23 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d3a76c28-8498-4db2-a30b-01213b5e309a tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:48:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3a76c28-8498-4db2-a30b-01213b5e309a tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.881s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:48:24 user nova-compute[74630]: DEBUG nova.compute.manager [req-acaa7a59-2082-4ed0-bc53-1d3827be5db7 req-472d9e8f-baa1-4439-bbe4-8c4650115a7e service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:48:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-acaa7a59-2082-4ed0-bc53-1d3827be5db7 req-472d9e8f-baa1-4439-bbe4-8c4650115a7e service nova] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:48:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-acaa7a59-2082-4ed0-bc53-1d3827be5db7 req-472d9e8f-baa1-4439-bbe4-8c4650115a7e service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:48:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-acaa7a59-2082-4ed0-bc53-1d3827be5db7 req-472d9e8f-baa1-4439-bbe4-8c4650115a7e service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:48:24 user nova-compute[74630]: DEBUG nova.compute.manager [req-acaa7a59-2082-4ed0-bc53-1d3827be5db7 req-472d9e8f-baa1-4439-bbe4-8c4650115a7e service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] No waiting events found dispatching network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:48:24 user nova-compute[74630]: WARNING nova.compute.manager [req-acaa7a59-2082-4ed0-bc53-1d3827be5db7 req-472d9e8f-baa1-4439-bbe4-8c4650115a7e service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received unexpected event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 for instance with vm_state stopped and task_state None.
Oct 26 03:48:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:29 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:48:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:48:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:48:39 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:48:39 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:48:39 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:48:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:48:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:48:39 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:48:39 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:48:39 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updating instance_info_cache with network_info: [{"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:48:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:48:39 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:48:39 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:48:40 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:48:40 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:48:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:48:42 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:48:43 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:48:43 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:48:43 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:48:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:48:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:48:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:48:43 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:48:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:48:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:48:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:48:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:48:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:48:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:48:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:48:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:48:44 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:48:44 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:48:44 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8855MB free_disk=25.056835174560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 374e50f7-3158-4514-a033-24dba936ecc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance a8bd5662-6925-4007-a791-52e8a60e82c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "a8bd5662-6925-4007-a791-52e8a60e82c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "a8bd5662-6925-4007-a791-52e8a60e82c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:48:44 user nova-compute[74630]: INFO nova.compute.manager [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Terminating instance
Oct 26 03:48:44 user nova-compute[74630]: DEBUG nova.compute.manager [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-7a248b3d-ec14-4f08-9428-d4145ddc89f8 req-fc1ce10c-e38e-4345-bafc-dd2898356921 service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Received event network-vif-unplugged-67d2f91c-6922-4b28-87da-3c8909206f08 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7a248b3d-ec14-4f08-9428-d4145ddc89f8 req-fc1ce10c-e38e-4345-bafc-dd2898356921 service nova] Acquiring lock "a8bd5662-6925-4007-a791-52e8a60e82c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7a248b3d-ec14-4f08-9428-d4145ddc89f8 req-fc1ce10c-e38e-4345-bafc-dd2898356921 service nova] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7a248b3d-ec14-4f08-9428-d4145ddc89f8 req-fc1ce10c-e38e-4345-bafc-dd2898356921 service nova] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-7a248b3d-ec14-4f08-9428-d4145ddc89f8 req-fc1ce10c-e38e-4345-bafc-dd2898356921 service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] No waiting events found dispatching network-vif-unplugged-67d2f91c-6922-4b28-87da-3c8909206f08 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:48:44 user nova-compute[74630]: DEBUG nova.compute.manager [req-7a248b3d-ec14-4f08-9428-d4145ddc89f8 req-fc1ce10c-e38e-4345-bafc-dd2898356921 service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Received event network-vif-unplugged-67d2f91c-6922-4b28-87da-3c8909206f08 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:48:45 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Instance destroyed successfully.
Oct 26 03:48:45 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lazy-loading 'resources' on Instance uuid a8bd5662-6925-4007-a791-52e8a60e82c6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1914419421',display_name='tempest-VolumesActionsTest-instance-1914419421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1914419421',id=40,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ac8dcda91df4de894e45692b2ad24a7',ramdisk_id='',reservation_id='r-eonwqwpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-672192502',owner_user_name='tempest-VolumesActionsTest-672192502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:47:00Z,user_data=None,user_id='f5489febd6fe4bbdb5eb7ff82cf11873',uuid=a8bd5662-6925-4007-a791-52e8a60e82c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67d2f91c-6922-4b28-87da-3c8909206f08", "address": "fa:16:3e:e8:38:ac", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d2f91c-69", "ovs_interfaceid": "67d2f91c-6922-4b28-87da-3c8909206f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Converting VIF {"id": "67d2f91c-6922-4b28-87da-3c8909206f08", "address": "fa:16:3e:e8:38:ac", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d2f91c-69", "ovs_interfaceid": "67d2f91c-6922-4b28-87da-3c8909206f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:38:ac,bridge_name='br-int',has_traffic_filtering=True,id=67d2f91c-6922-4b28-87da-3c8909206f08,network=Network(25c4b751-e4df-4653-9cf7-e43a583f48f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d2f91c-69') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG os_vif [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:38:ac,bridge_name='br-int',has_traffic_filtering=True,id=67d2f91c-6922-4b28-87da-3c8909206f08,network=Network(25c4b751-e4df-4653-9cf7-e43a583f48f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d2f91c-69') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67d2f91c-69, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0270ad28-60ab-493c-89e5-090d4c06ade6) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:45 user nova-compute[74630]: INFO os_vif [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:38:ac,bridge_name='br-int',has_traffic_filtering=True,id=67d2f91c-6922-4b28-87da-3c8909206f08,network=Network(25c4b751-e4df-4653-9cf7-e43a583f48f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d2f91c-69')
Oct 26 03:48:45 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Deleting instance files /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6_del
Oct 26 03:48:45 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Deletion of /opt/stack/data/nova/instances/a8bd5662-6925-4007-a791-52e8a60e82c6_del complete
Oct 26 03:48:45 user nova-compute[74630]: INFO nova.compute.manager [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 26 03:48:45 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:48:45 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Took 0.46 seconds to deallocate network for instance.
Oct 26 03:48:45 user nova-compute[74630]: DEBUG nova.compute.manager [req-55d9738b-6ff0-4b28-a40b-49b36d544665 req-ad97ad05-248a-40df-b4b0-8cde045bb584 service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Received event network-vif-deleted-67d2f91c-6922-4b28-87da-3c8909206f08 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:48:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:48:46 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:48:46 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:48:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:48:46 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Deleted allocations for instance a8bd5662-6925-4007-a791-52e8a60e82c6
Oct 26 03:48:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ac716021-b1bd-45a7-8e07-3330a4f14879 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.698s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:48:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-b86de106-a059-4210-99b1-90f4a9d053f8 req-e260f6fb-35b4-4c8b-a4d1-8a6b4a3492ac service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Received event network-vif-plugged-67d2f91c-6922-4b28-87da-3c8909206f08 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:48:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b86de106-a059-4210-99b1-90f4a9d053f8 req-e260f6fb-35b4-4c8b-a4d1-8a6b4a3492ac service nova] Acquiring lock "a8bd5662-6925-4007-a791-52e8a60e82c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:48:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b86de106-a059-4210-99b1-90f4a9d053f8 req-e260f6fb-35b4-4c8b-a4d1-8a6b4a3492ac service nova] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:48:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b86de106-a059-4210-99b1-90f4a9d053f8 req-e260f6fb-35b4-4c8b-a4d1-8a6b4a3492ac service nova] Lock "a8bd5662-6925-4007-a791-52e8a60e82c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:48:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-b86de106-a059-4210-99b1-90f4a9d053f8 req-e260f6fb-35b4-4c8b-a4d1-8a6b4a3492ac service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] No waiting events found dispatching network-vif-plugged-67d2f91c-6922-4b28-87da-3c8909206f08 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:48:47 user nova-compute[74630]: WARNING nova.compute.manager [req-b86de106-a059-4210-99b1-90f4a9d053f8 req-e260f6fb-35b4-4c8b-a4d1-8a6b4a3492ac service nova] [instance: a8bd5662-6925-4007-a791-52e8a60e82c6] Received unexpected event network-vif-plugged-67d2f91c-6922-4b28-87da-3c8909206f08 for instance with vm_state deleted and task_state None.
Oct 26 03:48:47 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:48:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:48:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:49:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:49:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:49:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:49:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:29 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:49:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "9e12c562-a000-4e1e-846d-1b2a4192743b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:49:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:49:30 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:49:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:49:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:49:30 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:49:30 user nova-compute[74630]: INFO nova.compute.claims [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Claim successful on node user
Oct 26 03:49:30 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:49:30 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:49:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:49:30 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:49:30 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:49:30 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:49:30 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:49:30 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:49:30 user nova-compute[74630]: DEBUG nova.policy [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b3bd794500243df86a1e4e89414bea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbe37117ca24935b46795e7f7479af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:49:30 user nova-compute[74630]: INFO nova.virt.block_device [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Booting with volume snapshot 1e386e38-ae5a-4ac6-abf5-bc508182f18a at /dev/vda
Oct 26 03:49:31 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Successfully created port: 1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Successfully updated port: 1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "refresh_cache-9e12c562-a000-4e1e-846d-1b2a4192743b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquired lock "refresh_cache-9e12c562-a000-4e1e-846d-1b2a4192743b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG nova.compute.manager [req-9330c9d3-c462-4307-9af4-00362faf2931 req-decbbdc6-2ef4-4797-87bf-9799ae0bb84f service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received event network-changed-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG nova.compute.manager [req-9330c9d3-c462-4307-9af4-00362faf2931 req-decbbdc6-2ef4-4797-87bf-9799ae0bb84f service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Refreshing instance network info cache due to event network-changed-1959ced9-69e6-4bbb-8263-8368bdc14f61. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9330c9d3-c462-4307-9af4-00362faf2931 req-decbbdc6-2ef4-4797-87bf-9799ae0bb84f service nova] Acquiring lock "refresh_cache-9e12c562-a000-4e1e-846d-1b2a4192743b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Updating instance_info_cache with network_info: [{"id": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "address": "fa:16:3e:70:81:6b", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1959ced9-69", "ovs_interfaceid": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Releasing lock "refresh_cache-9e12c562-a000-4e1e-846d-1b2a4192743b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Instance network_info: |[{"id": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "address": "fa:16:3e:70:81:6b", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1959ced9-69", "ovs_interfaceid": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9330c9d3-c462-4307-9af4-00362faf2931 req-decbbdc6-2ef4-4797-87bf-9799ae0bb84f service nova] Acquired lock "refresh_cache-9e12c562-a000-4e1e-846d-1b2a4192743b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG nova.network.neutron [req-9330c9d3-c462-4307-9af4-00362faf2931 req-decbbdc6-2ef4-4797-87bf-9799ae0bb84f service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Refreshing network info cache for port 1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG nova.network.neutron [req-9330c9d3-c462-4307-9af4-00362faf2931 req-decbbdc6-2ef4-4797-87bf-9799ae0bb84f service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Updated VIF entry in instance network info cache for port 1959ced9-69e6-4bbb-8263-8368bdc14f61. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG nova.network.neutron [req-9330c9d3-c462-4307-9af4-00362faf2931 req-decbbdc6-2ef4-4797-87bf-9799ae0bb84f service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Updating instance_info_cache with network_info: [{"id": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "address": "fa:16:3e:70:81:6b", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1959ced9-69", "ovs_interfaceid": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:49:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9330c9d3-c462-4307-9af4-00362faf2931 req-decbbdc6-2ef4-4797-87bf-9799ae0bb84f service nova] Releasing lock "refresh_cache-9e12c562-a000-4e1e-846d-1b2a4192743b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:49:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:49:36 user nova-compute[74630]: INFO nova.compute.claims [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Claim successful on node user
Oct 26 03:49:36 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:49:36 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:49:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG os_brick.utils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fb815c-95a0-4a98-a532-0b4d1a2cf649]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3f7985-2ea2-40c8-98e1-cabe362f9f0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG nova.policy [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5489febd6fe4bbdb5eb7ff82cf11873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac8dcda91df4de894e45692b2ad24a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d54a140-6d57-414f-8343-00ef0690c328]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b27c3f-1017-4685-a5ac-66e5f87917bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:49:36 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Creating image(s)
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "/opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "/opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:49:36 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c87478-1c58-47ed-8a32-1523f123f0dd]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG os_brick.utils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Updating existing volume attachment record: b99daf0f-c01c-4d68-ab78-d4bb1549afe8 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:49:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.191s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.184s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG nova.network.neutron [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Successfully created port: b8b31bdf-dfa6-4883-98f2-355dd14075bd {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk 1073741824" returned: 0 in 0.052s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.173s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Cannot resize image /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Ensure instance console log exists: /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG nova.network.neutron [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Successfully updated port: b8b31bdf-dfa6-4883-98f2-355dd14075bd {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "refresh_cache-fbc5b6fe-6293-4823-907d-f7f26a8096fa" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquired lock "refresh_cache-fbc5b6fe-6293-4823-907d-f7f26a8096fa" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG nova.network.neutron [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-ff919dbc-70cb-4b3a-af21-cc93ba3ac51c req-c4e8a621-672e-476e-94ac-975a1ad201b8 service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Received event network-changed-b8b31bdf-dfa6-4883-98f2-355dd14075bd {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-ff919dbc-70cb-4b3a-af21-cc93ba3ac51c req-c4e8a621-672e-476e-94ac-975a1ad201b8 service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Refreshing instance network info cache due to event network-changed-b8b31bdf-dfa6-4883-98f2-355dd14075bd. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:49:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ff919dbc-70cb-4b3a-af21-cc93ba3ac51c req-c4e8a621-672e-476e-94ac-975a1ad201b8 service nova] Acquiring lock "refresh_cache-fbc5b6fe-6293-4823-907d-f7f26a8096fa" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.network.neutron [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.network.neutron [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Updating instance_info_cache with network_info: [{"id": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "address": "fa:16:3e:3a:cf:f0", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b31bdf-df", "ovs_interfaceid": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Releasing lock "refresh_cache-fbc5b6fe-6293-4823-907d-f7f26a8096fa" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.compute.manager [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Instance network_info: |[{"id": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "address": "fa:16:3e:3a:cf:f0", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b31bdf-df", "ovs_interfaceid": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ff919dbc-70cb-4b3a-af21-cc93ba3ac51c req-c4e8a621-672e-476e-94ac-975a1ad201b8 service nova] Acquired lock "refresh_cache-fbc5b6fe-6293-4823-907d-f7f26a8096fa" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.network.neutron [req-ff919dbc-70cb-4b3a-af21-cc93ba3ac51c req-c4e8a621-672e-476e-94ac-975a1ad201b8 service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Refreshing network info cache for port b8b31bdf-dfa6-4883-98f2-355dd14075bd {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Start _get_guest_xml network_info=[{"id": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "address": "fa:16:3e:3a:cf:f0", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b31bdf-df", "ovs_interfaceid": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:49:38 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:49:38 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-959893326',display_name='tempest-VolumesActionsTest-instance-959893326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-959893326',id=42,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac8dcda91df4de894e45692b2ad24a7',ramdisk_id='',reservation_id='r-em56j7sm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-672192502',owner_user_name='tempest-VolumesActionsTest-672192502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:49:37Z,user_data=None,user_id='f5489febd6fe4bbdb5eb7ff82cf11873',uuid=fbc5b6fe-6293-4823-907d-f7f26a8096fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "address": "fa:16:3e:3a:cf:f0", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b31bdf-df", "ovs_interfaceid": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Converting VIF {"id": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "address": "fa:16:3e:3a:cf:f0", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b31bdf-df", "ovs_interfaceid": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cf:f0,bridge_name='br-int',has_traffic_filtering=True,id=b8b31bdf-dfa6-4883-98f2-355dd14075bd,network=Network(25c4b751-e4df-4653-9cf7-e43a583f48f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8b31bdf-df') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.objects.instance [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lazy-loading 'pci_devices' on Instance uuid fbc5b6fe-6293-4823-907d-f7f26a8096fa {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:49:38 user nova-compute[74630]:   <uuid>fbc5b6fe-6293-4823-907d-f7f26a8096fa</uuid>
Oct 26 03:49:38 user nova-compute[74630]:   <name>instance-0000002a</name>
Oct 26 03:49:38 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:49:38 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:49:38 user nova-compute[74630]:   <metadata>
Oct 26 03:49:38 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:49:38 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:49:38 user nova-compute[74630]:       <nova:name>tempest-VolumesActionsTest-instance-959893326</nova:name>
Oct 26 03:49:38 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:49:38</nova:creationTime>
Oct 26 03:49:38 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:49:38 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:49:38 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:49:38 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:49:38 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:49:38 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:49:38 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:49:38 user nova-compute[74630]:       <nova:owner>
Oct 26 03:49:38 user nova-compute[74630]:         <nova:user uuid="f5489febd6fe4bbdb5eb7ff82cf11873">tempest-VolumesActionsTest-672192502-project-member</nova:user>
Oct 26 03:49:38 user nova-compute[74630]:         <nova:project uuid="2ac8dcda91df4de894e45692b2ad24a7">tempest-VolumesActionsTest-672192502</nova:project>
Oct 26 03:49:38 user nova-compute[74630]:       </nova:owner>
Oct 26 03:49:38 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:49:38 user nova-compute[74630]:       <nova:ports>
Oct 26 03:49:38 user nova-compute[74630]:         <nova:port uuid="b8b31bdf-dfa6-4883-98f2-355dd14075bd">
Oct 26 03:49:38 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 03:49:38 user nova-compute[74630]:         </nova:port>
Oct 26 03:49:38 user nova-compute[74630]:       </nova:ports>
Oct 26 03:49:38 user nova-compute[74630]:     </nova:instance>
Oct 26 03:49:38 user nova-compute[74630]:   </metadata>
Oct 26 03:49:38 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:49:38 user nova-compute[74630]:     <system>
Oct 26 03:49:38 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:49:38 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:49:38 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:49:38 user nova-compute[74630]:       <entry name="serial">fbc5b6fe-6293-4823-907d-f7f26a8096fa</entry>
Oct 26 03:49:38 user nova-compute[74630]:       <entry name="uuid">fbc5b6fe-6293-4823-907d-f7f26a8096fa</entry>
Oct 26 03:49:38 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:49:38 user nova-compute[74630]:     </system>
Oct 26 03:49:38 user nova-compute[74630]:   </sysinfo>
Oct 26 03:49:38 user nova-compute[74630]:   <os>
Oct 26 03:49:38 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:49:38 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:49:38 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:49:38 user nova-compute[74630]:   </os>
Oct 26 03:49:38 user nova-compute[74630]:   <features>
Oct 26 03:49:38 user nova-compute[74630]:     <acpi/>
Oct 26 03:49:38 user nova-compute[74630]:     <apic/>
Oct 26 03:49:38 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:49:38 user nova-compute[74630]:   </features>
Oct 26 03:49:38 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:49:38 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:49:38 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:49:38 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:49:38 user nova-compute[74630]:   </clock>
Oct 26 03:49:38 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:49:38 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:49:38 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:49:38 user nova-compute[74630]:   </cpu>
Oct 26 03:49:38 user nova-compute[74630]:   <devices>
Oct 26 03:49:38 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:49:38 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:49:38 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk"/>
Oct 26 03:49:38 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:49:38 user nova-compute[74630]:     </disk>
Oct 26 03:49:38 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:49:38 user nova-compute[74630]:       <mac address="fa:16:3e:3a:cf:f0"/>
Oct 26 03:49:38 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:49:38 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:49:38 user nova-compute[74630]:       <target dev="tapb8b31bdf-df"/>
Oct 26 03:49:38 user nova-compute[74630]:     </interface>
Oct 26 03:49:38 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:49:38 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/console.log" append="off"/>
Oct 26 03:49:38 user nova-compute[74630]:     </serial>
Oct 26 03:49:38 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:49:38 user nova-compute[74630]:     <video>
Oct 26 03:49:38 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:49:38 user nova-compute[74630]:     </video>
Oct 26 03:49:38 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:49:38 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:49:38 user nova-compute[74630]:     </rng>
Oct 26 03:49:38 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:49:38 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:49:38 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:49:38 user nova-compute[74630]:     </memballoon>
Oct 26 03:49:38 user nova-compute[74630]:   </devices>
Oct 26 03:49:38 user nova-compute[74630]: </domain>
Oct 26 03:49:38 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-959893326',display_name='tempest-VolumesActionsTest-instance-959893326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-959893326',id=42,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ac8dcda91df4de894e45692b2ad24a7',ramdisk_id='',reservation_id='r-em56j7sm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-672192502',owner_user_name='tempest-VolumesActionsTest-672192502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:49:37Z,user_data=None,user_id='f5489febd6fe4bbdb5eb7ff82cf11873',uuid=fbc5b6fe-6293-4823-907d-f7f26a8096fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "address": "fa:16:3e:3a:cf:f0", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b31bdf-df", "ovs_interfaceid": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Converting VIF {"id": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "address": "fa:16:3e:3a:cf:f0", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b31bdf-df", "ovs_interfaceid": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cf:f0,bridge_name='br-int',has_traffic_filtering=True,id=b8b31bdf-dfa6-4883-98f2-355dd14075bd,network=Network(25c4b751-e4df-4653-9cf7-e43a583f48f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8b31bdf-df') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG os_vif [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cf:f0,bridge_name='br-int',has_traffic_filtering=True,id=b8b31bdf-dfa6-4883-98f2-355dd14075bd,network=Network(25c4b751-e4df-4653-9cf7-e43a583f48f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8b31bdf-df') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f6ed1e4-c900-5348-9778-8667ed5bb430', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8b31bdf-df, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8b31bdf-df, col_values=(('qos', UUID('c6a5a47c-9d94-4f25-8146-1acd10e2093e')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8b31bdf-df, col_values=(('external_ids', {'iface-id': 'b8b31bdf-dfa6-4883-98f2-355dd14075bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:cf:f0', 'vm-uuid': 'fbc5b6fe-6293-4823-907d-f7f26a8096fa'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:38 user nova-compute[74630]: INFO os_vif [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cf:f0,bridge_name='br-int',has_traffic_filtering=True,id=b8b31bdf-dfa6-4883-98f2-355dd14075bd,network=Network(25c4b751-e4df-4653-9cf7-e43a583f48f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8b31bdf-df')
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] No VIF found with MAC fa:16:3e:3a:cf:f0, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.network.neutron [req-ff919dbc-70cb-4b3a-af21-cc93ba3ac51c req-c4e8a621-672e-476e-94ac-975a1ad201b8 service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Updated VIF entry in instance network info cache for port b8b31bdf-dfa6-4883-98f2-355dd14075bd. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG nova.network.neutron [req-ff919dbc-70cb-4b3a-af21-cc93ba3ac51c req-c4e8a621-672e-476e-94ac-975a1ad201b8 service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Updating instance_info_cache with network_info: [{"id": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "address": "fa:16:3e:3a:cf:f0", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b31bdf-df", "ovs_interfaceid": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:49:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ff919dbc-70cb-4b3a-af21-cc93ba3ac51c req-c4e8a621-672e-476e-94ac-975a1ad201b8 service nova] Releasing lock "refresh_cache-fbc5b6fe-6293-4823-907d-f7f26a8096fa" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:49:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-4fb8ae44-c390-419e-a74e-68480f5a122c req-8d8d5fe6-a615-4848-adc5-c4bcf6b5fe2d service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Received event network-vif-plugged-b8b31bdf-dfa6-4883-98f2-355dd14075bd {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:49:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4fb8ae44-c390-419e-a74e-68480f5a122c req-8d8d5fe6-a615-4848-adc5-c4bcf6b5fe2d service nova] Acquiring lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:49:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4fb8ae44-c390-419e-a74e-68480f5a122c req-8d8d5fe6-a615-4848-adc5-c4bcf6b5fe2d service nova] Lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:49:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4fb8ae44-c390-419e-a74e-68480f5a122c req-8d8d5fe6-a615-4848-adc5-c4bcf6b5fe2d service nova] Lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:49:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-4fb8ae44-c390-419e-a74e-68480f5a122c req-8d8d5fe6-a615-4848-adc5-c4bcf6b5fe2d service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] No waiting events found dispatching network-vif-plugged-b8b31bdf-dfa6-4883-98f2-355dd14075bd {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:49:40 user nova-compute[74630]: WARNING nova.compute.manager [req-4fb8ae44-c390-419e-a74e-68480f5a122c req-8d8d5fe6-a615-4848-adc5-c4bcf6b5fe2d service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Received unexpected event network-vif-plugged-b8b31bdf-dfa6-4883-98f2-355dd14075bd for instance with vm_state building and task_state spawning.
Oct 26 03:49:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:41 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:49:41 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:49:41 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 03:49:41 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:49:42 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:49:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:49:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:49:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:49:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Instance spawned successfully.
Oct 26 03:49:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:49:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:49:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:49:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:49:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:49:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:49:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:49:42 user nova-compute[74630]: INFO nova.compute.manager [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Took 5.51 seconds to spawn the instance on the hypervisor.
Oct 26 03:49:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:49:42 user nova-compute[74630]: INFO nova.compute.manager [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Took 6.15 seconds to build instance.
Oct 26 03:49:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-a365952b-84e0-458e-8143-3c6b256ea7de req-e41506d1-c307-4b41-b17f-5d56338e410a service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Received event network-vif-plugged-b8b31bdf-dfa6-4883-98f2-355dd14075bd {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:49:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a365952b-84e0-458e-8143-3c6b256ea7de req-e41506d1-c307-4b41-b17f-5d56338e410a service nova] Acquiring lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:49:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a365952b-84e0-458e-8143-3c6b256ea7de req-e41506d1-c307-4b41-b17f-5d56338e410a service nova] Lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:49:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a365952b-84e0-458e-8143-3c6b256ea7de req-e41506d1-c307-4b41-b17f-5d56338e410a service nova] Lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:49:42 user nova-compute[74630]: DEBUG nova.compute.manager [req-a365952b-84e0-458e-8143-3c6b256ea7de req-e41506d1-c307-4b41-b17f-5d56338e410a service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] No waiting events found dispatching network-vif-plugged-b8b31bdf-dfa6-4883-98f2-355dd14075bd {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:49:42 user nova-compute[74630]: WARNING nova.compute.manager [req-a365952b-84e0-458e-8143-3c6b256ea7de req-e41506d1-c307-4b41-b17f-5d56338e410a service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Received unexpected event network-vif-plugged-b8b31bdf-dfa6-4883-98f2-355dd14075bd for instance with vm_state active and task_state None.
Oct 26 03:49:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-77008375-66c7-4c96-9d62-4e6dee348fb4 tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.253s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:49:43 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:49:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:44 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:49:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:49:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:49:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:49:44 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:49:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:45 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:49:45 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:49:45 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8932MB free_disk=25.072463989257812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:49:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:49:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:49:45 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 374e50f7-3158-4514-a033-24dba936ecc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:49:45 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 9e12c562-a000-4e1e-846d-1b2a4192743b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:49:45 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fbc5b6fe-6293-4823-907d-f7f26a8096fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:49:45 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:49:45 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:49:45 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:49:45 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:49:45 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:49:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:49:46 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:49:46 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:49:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:49:55 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Creating image(s)
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Ensure instance console log exists: /opt/stack/data/nova/instances/9e12c562-a000-4e1e-846d-1b2a4192743b/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Start _get_guest_xml network_info=[{"id": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "address": "fa:16:3e:70:81:6b", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1959ced9-69", "ovs_interfaceid": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jaEcAbSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e12c562-a000-4e1e-846d-1b2a4192743b', 'attached_at': '', 'detached_at': '', 'volume_id': '7be61a4c-46d1-42b6-a075-fc951bc8d20d', 'serial': '7be61a4c-46d1-42b6-a075-fc951bc8d20d'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': 'b99daf0f-c01c-4d68-ab78-d4bb1549afe8', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:49:55 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:49:55 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jaEcAbSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:49:55 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:49:55 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:49:55 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da2c19d-fae1-455a-a343-8696e18aa9ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:49:55 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[256a62b4-1cad-4baf-842e-b779771de763]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d] added
Oct 26 03:49:55 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f9b9c9-c975-4a3b-94e9-0247c8ff1f51]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a1c8b0-104f-43e9-9edc-42b328a2c6a6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jaEcAbSi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jaEcAbSi" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[124734c4-5811-4019-b0cd-1df16f938092]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jaEcAbSi'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98d3d8d-5f7e-4387-a2ac-dcdf30c92730]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[586d85c5-732d-4dc5-864d-b0da7b44ca27]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 03:49:55 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 03:49:55 user nova-compute[74630]:  {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:49:55 user nova-compute[74630]: WARNING os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 03:49:55 user nova-compute[74630]: 
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38931a3-14cb-46db-aa4c-42257406ea0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d, portal: 172.16.0.220,3260]
Oct 26 03:49:55 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d, portal: 172.16.0.220,3260] successful.
Oct 26 03:49:55 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[137caecc-c556-4090-a8fb-44280342e352]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[661207be-901b-460d-adf8-5ec1f37da796]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d (non-flash)
Oct 26 03:49:55 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d (non-flash)
Oct 26 03:49:55 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8f0bea-976c-4ed2-b9ad-cdcbffae46c2]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:49:55 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jaEcAbSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26466326366626262', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466326366626262', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-440692275',display_name='tempest-TestVolumeBootPattern-server-440692275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-440692275',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-q2gtey07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:49:31Z,user_data=None,user_id='3b3bd794500243df86a1e4e89414bea0',uuid=9e12c562-a000-4e1e-846d-1b2a4192743b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "address": "fa:16:3e:70:81:6b", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1959ced9-69", "ovs_interfaceid": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "address": "fa:16:3e:70:81:6b", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1959ced9-69", "ovs_interfaceid": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:81:6b,bridge_name='br-int',has_traffic_filtering=True,id=1959ced9-69e6-4bbb-8263-8368bdc14f61,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1959ced9-69') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e12c562-a000-4e1e-846d-1b2a4192743b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:49:56 user nova-compute[74630]:   <uuid>9e12c562-a000-4e1e-846d-1b2a4192743b</uuid>
Oct 26 03:49:56 user nova-compute[74630]:   <name>instance-00000029</name>
Oct 26 03:49:56 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:49:56 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:49:56 user nova-compute[74630]:   <metadata>
Oct 26 03:49:56 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:49:56 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:49:56 user nova-compute[74630]:       <nova:name>tempest-TestVolumeBootPattern-server-440692275</nova:name>
Oct 26 03:49:56 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:49:55</nova:creationTime>
Oct 26 03:49:56 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:49:56 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:49:56 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:49:56 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:49:56 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:49:56 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:49:56 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:49:56 user nova-compute[74630]:       <nova:owner>
Oct 26 03:49:56 user nova-compute[74630]:         <nova:user uuid="3b3bd794500243df86a1e4e89414bea0">tempest-TestVolumeBootPattern-1203294393-project-member</nova:user>
Oct 26 03:49:56 user nova-compute[74630]:         <nova:project uuid="4dbe37117ca24935b46795e7f7479af9">tempest-TestVolumeBootPattern-1203294393</nova:project>
Oct 26 03:49:56 user nova-compute[74630]:       </nova:owner>
Oct 26 03:49:56 user nova-compute[74630]:       <nova:ports>
Oct 26 03:49:56 user nova-compute[74630]:         <nova:port uuid="1959ced9-69e6-4bbb-8263-8368bdc14f61">
Oct 26 03:49:56 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 03:49:56 user nova-compute[74630]:         </nova:port>
Oct 26 03:49:56 user nova-compute[74630]:       </nova:ports>
Oct 26 03:49:56 user nova-compute[74630]:     </nova:instance>
Oct 26 03:49:56 user nova-compute[74630]:   </metadata>
Oct 26 03:49:56 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:49:56 user nova-compute[74630]:     <system>
Oct 26 03:49:56 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:49:56 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:49:56 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:49:56 user nova-compute[74630]:       <entry name="serial">9e12c562-a000-4e1e-846d-1b2a4192743b</entry>
Oct 26 03:49:56 user nova-compute[74630]:       <entry name="uuid">9e12c562-a000-4e1e-846d-1b2a4192743b</entry>
Oct 26 03:49:56 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:49:56 user nova-compute[74630]:     </system>
Oct 26 03:49:56 user nova-compute[74630]:   </sysinfo>
Oct 26 03:49:56 user nova-compute[74630]:   <os>
Oct 26 03:49:56 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:49:56 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:49:56 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:49:56 user nova-compute[74630]:   </os>
Oct 26 03:49:56 user nova-compute[74630]:   <features>
Oct 26 03:49:56 user nova-compute[74630]:     <acpi/>
Oct 26 03:49:56 user nova-compute[74630]:     <apic/>
Oct 26 03:49:56 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:49:56 user nova-compute[74630]:   </features>
Oct 26 03:49:56 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:49:56 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:49:56 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:49:56 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:49:56 user nova-compute[74630]:   </clock>
Oct 26 03:49:56 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:49:56 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:49:56 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:49:56 user nova-compute[74630]:   </cpu>
Oct 26 03:49:56 user nova-compute[74630]:   <devices>
Oct 26 03:49:56 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:49:56 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:49:56 user nova-compute[74630]:       <source dev="/dev/sdb"/>
Oct 26 03:49:56 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:49:56 user nova-compute[74630]:       <serial>7be61a4c-46d1-42b6-a075-fc951bc8d20d</serial>
Oct 26 03:49:56 user nova-compute[74630]:     </disk>
Oct 26 03:49:56 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:49:56 user nova-compute[74630]:       <mac address="fa:16:3e:70:81:6b"/>
Oct 26 03:49:56 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:49:56 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:49:56 user nova-compute[74630]:       <target dev="tap1959ced9-69"/>
Oct 26 03:49:56 user nova-compute[74630]:     </interface>
Oct 26 03:49:56 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:49:56 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/9e12c562-a000-4e1e-846d-1b2a4192743b/console.log" append="off"/>
Oct 26 03:49:56 user nova-compute[74630]:     </serial>
Oct 26 03:49:56 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:49:56 user nova-compute[74630]:     <video>
Oct 26 03:49:56 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:49:56 user nova-compute[74630]:     </video>
Oct 26 03:49:56 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:49:56 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:49:56 user nova-compute[74630]:     </rng>
Oct 26 03:49:56 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:49:56 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:49:56 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:49:56 user nova-compute[74630]:     </memballoon>
Oct 26 03:49:56 user nova-compute[74630]:   </devices>
Oct 26 03:49:56 user nova-compute[74630]: </domain>
Oct 26 03:49:56 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-440692275',display_name='tempest-TestVolumeBootPattern-server-440692275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-440692275',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-q2gtey07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:49:31Z,user_data=None,user_id='3b3bd794500243df86a1e4e89414bea0',uuid=9e12c562-a000-4e1e-846d-1b2a4192743b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "address": "fa:16:3e:70:81:6b", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1959ced9-69", "ovs_interfaceid": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "address": "fa:16:3e:70:81:6b", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1959ced9-69", "ovs_interfaceid": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:81:6b,bridge_name='br-int',has_traffic_filtering=True,id=1959ced9-69e6-4bbb-8263-8368bdc14f61,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1959ced9-69') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG os_vif [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:81:6b,bridge_name='br-int',has_traffic_filtering=True,id=1959ced9-69e6-4bbb-8263-8368bdc14f61,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1959ced9-69') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1c82247-ad0b-5b07-8228-da19ceeb0f7a', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1959ced9-69, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1959ced9-69, col_values=(('qos', UUID('1398b3ff-6a03-44d0-b5a1-cb6fa4761a80')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1959ced9-69, col_values=(('external_ids', {'iface-id': '1959ced9-69e6-4bbb-8263-8368bdc14f61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:81:6b', 'vm-uuid': '9e12c562-a000-4e1e-846d-1b2a4192743b'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:49:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:56 user nova-compute[74630]: INFO os_vif [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:81:6b,bridge_name='br-int',has_traffic_filtering=True,id=1959ced9-69e6-4bbb-8263-8368bdc14f61,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1959ced9-69')
Oct 26 03:49:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:49:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] No VIF found with MAC fa:16:3e:70:81:6b, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:49:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-62416802-2e40-4f18-825a-87645b70f09e req-ffee0d70-1d8c-4c57-93ef-884b57078722 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received event network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:49:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-62416802-2e40-4f18-825a-87645b70f09e req-ffee0d70-1d8c-4c57-93ef-884b57078722 service nova] Acquiring lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:49:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-62416802-2e40-4f18-825a-87645b70f09e req-ffee0d70-1d8c-4c57-93ef-884b57078722 service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:49:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-62416802-2e40-4f18-825a-87645b70f09e req-ffee0d70-1d8c-4c57-93ef-884b57078722 service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:49:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-62416802-2e40-4f18-825a-87645b70f09e req-ffee0d70-1d8c-4c57-93ef-884b57078722 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] No waiting events found dispatching network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:49:58 user nova-compute[74630]: WARNING nova.compute.manager [req-62416802-2e40-4f18-825a-87645b70f09e req-ffee0d70-1d8c-4c57-93ef-884b57078722 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received unexpected event network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 for instance with vm_state building and task_state spawning.
Oct 26 03:49:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:49:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:50:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:50:00 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Instance spawned successfully.
Oct 26 03:50:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:50:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:50:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:50:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:50:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:50:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:50:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:50:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-461640ac-0f77-4e81-b604-a6a7e66c2ae1 req-9721fc76-36de-4cb1-9c24-990d64c195c7 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received event network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:50:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-461640ac-0f77-4e81-b604-a6a7e66c2ae1 req-9721fc76-36de-4cb1-9c24-990d64c195c7 service nova] Acquiring lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:50:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-461640ac-0f77-4e81-b604-a6a7e66c2ae1 req-9721fc76-36de-4cb1-9c24-990d64c195c7 service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:50:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-461640ac-0f77-4e81-b604-a6a7e66c2ae1 req-9721fc76-36de-4cb1-9c24-990d64c195c7 service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:50:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-461640ac-0f77-4e81-b604-a6a7e66c2ae1 req-9721fc76-36de-4cb1-9c24-990d64c195c7 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] No waiting events found dispatching network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:50:00 user nova-compute[74630]: WARNING nova.compute.manager [req-461640ac-0f77-4e81-b604-a6a7e66c2ae1 req-9721fc76-36de-4cb1-9c24-990d64c195c7 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received unexpected event network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 for instance with vm_state building and task_state spawning.
Oct 26 03:50:00 user nova-compute[74630]: INFO nova.compute.manager [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Took 5.04 seconds to spawn the instance on the hypervisor.
Oct 26 03:50:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:50:00 user nova-compute[74630]: INFO nova.compute.manager [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Took 30.11 seconds to build instance.
Oct 26 03:50:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b5dbb6c9-de3c-4803-b54f-d47859e492df tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.210s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:50:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'flavor' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquired lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.network.neutron [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'info_cache' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.objects.base [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Object Instance<374e50f7-3158-4514-a033-24dba936ecc5> lazy-loaded attributes: flavor,info_cache {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.network.neutron [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updating instance_info_cache with network_info: [{"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Releasing lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:50:13 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Instance destroyed successfully.
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'resources' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.objects.base [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Object Instance<374e50f7-3158-4514-a033-24dba936ecc5> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1259939742',display_name='tempest-AttachVolumeTestJSON-server-1259939742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1259939742',id=38,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7EEO3GuKn+8kaEXSCwjJz8D30OIv6uEvszdV2tRdyXKLs86UHQIA++ZVypTxQLfMuMGfMKD5aQHpdWbHtpzsnVd6ppNb9G1YnsHZ9J9cAEGP3hhxc9zL5ZdfAWkgTL4A==',key_name='tempest-keypair-1586338171',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:42:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2671ecf470da4c5093899caa0e5b8313',ramdisk_id='',reservation_id='r-myp0eptt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2036216451',owner_user_name='tempest-AttachVolumeTestJSON-2036216451-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adadef6a5a8437b8ee3931cbeff5467',uuid=374e50f7-3158-4514-a033-24dba936ecc5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converting VIF {"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG os_vif [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e37d096-7f, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39f3dde0-318f-4a30-97f4-a3e05c1b7d9d) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:13 user nova-compute[74630]: INFO os_vif [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f')
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Start _get_guest_xml network_info=[{"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'numa_topology' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.objects.base [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Object Instance<374e50f7-3158-4514-a033-24dba936ecc5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:50:13 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:50:13 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'vcpu_model' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.objects.base [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Object Instance<374e50f7-3158-4514-a033-24dba936ecc5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1259939742',display_name='tempest-AttachVolumeTestJSON-server-1259939742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1259939742',id=38,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7EEO3GuKn+8kaEXSCwjJz8D30OIv6uEvszdV2tRdyXKLs86UHQIA++ZVypTxQLfMuMGfMKD5aQHpdWbHtpzsnVd6ppNb9G1YnsHZ9J9cAEGP3hhxc9zL5ZdfAWkgTL4A==',key_name='tempest-keypair-1586338171',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:42:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2671ecf470da4c5093899caa0e5b8313',ramdisk_id='',reservation_id='r-myp0eptt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2036216451',owner_user_name='tempest-AttachVolumeTestJSON-2036216451-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adadef6a5a8437b8ee3931cbeff5467',uuid=374e50f7-3158-4514-a033-24dba936ecc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converting VIF {"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'pci_devices' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.objects.base [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Object Instance<374e50f7-3158-4514-a033-24dba936ecc5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:50:13 user nova-compute[74630]:   <uuid>374e50f7-3158-4514-a033-24dba936ecc5</uuid>
Oct 26 03:50:13 user nova-compute[74630]:   <name>instance-00000026</name>
Oct 26 03:50:13 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:50:13 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:50:13 user nova-compute[74630]:   <metadata>
Oct 26 03:50:13 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:50:13 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:50:13 user nova-compute[74630]:       <nova:name>tempest-AttachVolumeTestJSON-server-1259939742</nova:name>
Oct 26 03:50:13 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:50:13</nova:creationTime>
Oct 26 03:50:13 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:50:13 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:50:13 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:50:13 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:50:13 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:50:13 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:50:13 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:50:13 user nova-compute[74630]:       <nova:owner>
Oct 26 03:50:13 user nova-compute[74630]:         <nova:user uuid="2adadef6a5a8437b8ee3931cbeff5467">tempest-AttachVolumeTestJSON-2036216451-project-member</nova:user>
Oct 26 03:50:13 user nova-compute[74630]:         <nova:project uuid="2671ecf470da4c5093899caa0e5b8313">tempest-AttachVolumeTestJSON-2036216451</nova:project>
Oct 26 03:50:13 user nova-compute[74630]:       </nova:owner>
Oct 26 03:50:13 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:50:13 user nova-compute[74630]:       <nova:ports>
Oct 26 03:50:13 user nova-compute[74630]:         <nova:port uuid="9e37d096-7f88-44a3-829f-e02f76065b09">
Oct 26 03:50:13 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 03:50:13 user nova-compute[74630]:         </nova:port>
Oct 26 03:50:13 user nova-compute[74630]:       </nova:ports>
Oct 26 03:50:13 user nova-compute[74630]:     </nova:instance>
Oct 26 03:50:13 user nova-compute[74630]:   </metadata>
Oct 26 03:50:13 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:50:13 user nova-compute[74630]:     <system>
Oct 26 03:50:13 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:50:13 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:50:13 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:50:13 user nova-compute[74630]:       <entry name="serial">374e50f7-3158-4514-a033-24dba936ecc5</entry>
Oct 26 03:50:13 user nova-compute[74630]:       <entry name="uuid">374e50f7-3158-4514-a033-24dba936ecc5</entry>
Oct 26 03:50:13 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:50:13 user nova-compute[74630]:     </system>
Oct 26 03:50:13 user nova-compute[74630]:   </sysinfo>
Oct 26 03:50:13 user nova-compute[74630]:   <os>
Oct 26 03:50:13 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:50:13 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:50:13 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:50:13 user nova-compute[74630]:   </os>
Oct 26 03:50:13 user nova-compute[74630]:   <features>
Oct 26 03:50:13 user nova-compute[74630]:     <acpi/>
Oct 26 03:50:13 user nova-compute[74630]:     <apic/>
Oct 26 03:50:13 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:50:13 user nova-compute[74630]:   </features>
Oct 26 03:50:13 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:50:13 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:50:13 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:50:13 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:50:13 user nova-compute[74630]:   </clock>
Oct 26 03:50:13 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:50:13 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:50:13 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:50:13 user nova-compute[74630]:   </cpu>
Oct 26 03:50:13 user nova-compute[74630]:   <devices>
Oct 26 03:50:13 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:50:13 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:50:13 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk"/>
Oct 26 03:50:13 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:50:13 user nova-compute[74630]:     </disk>
Oct 26 03:50:13 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:50:13 user nova-compute[74630]:       <mac address="fa:16:3e:95:80:23"/>
Oct 26 03:50:13 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:50:13 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:50:13 user nova-compute[74630]:       <target dev="tap9e37d096-7f"/>
Oct 26 03:50:13 user nova-compute[74630]:     </interface>
Oct 26 03:50:13 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:50:13 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/console.log" append="off"/>
Oct 26 03:50:13 user nova-compute[74630]:     </serial>
Oct 26 03:50:13 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:50:13 user nova-compute[74630]:     <video>
Oct 26 03:50:13 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:50:13 user nova-compute[74630]:     </video>
Oct 26 03:50:13 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:50:13 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:50:13 user nova-compute[74630]:     </rng>
Oct 26 03:50:13 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:50:13 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:50:13 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:50:13 user nova-compute[74630]:     </memballoon>
Oct 26 03:50:13 user nova-compute[74630]:   </devices>
Oct 26 03:50:13 user nova-compute[74630]: </domain>
Oct 26 03:50:13 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:50:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG nova.objects.instance [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'trusted_certs' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG nova.objects.base [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Object Instance<374e50f7-3158-4514-a033-24dba936ecc5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.208s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Checking if we can resize image /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Cannot resize image /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG nova.objects.instance [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'migration_context' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG nova.objects.base [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Object Instance<374e50f7-3158-4514-a033-24dba936ecc5> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1259939742',display_name='tempest-AttachVolumeTestJSON-server-1259939742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1259939742',id=38,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7EEO3GuKn+8kaEXSCwjJz8D30OIv6uEvszdV2tRdyXKLs86UHQIA++ZVypTxQLfMuMGfMKD5aQHpdWbHtpzsnVd6ppNb9G1YnsHZ9J9cAEGP3hhxc9zL5ZdfAWkgTL4A==',key_name='tempest-keypair-1586338171',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:42:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2671ecf470da4c5093899caa0e5b8313',ramdisk_id='',reservation_id='r-myp0eptt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2036216451',owner_user_name='tempest-AttachVolumeTestJSON-2036216451-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adadef6a5a8437b8ee3931cbeff5467',uuid=374e50f7-3158-4514-a033-24dba936ecc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converting VIF {"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG os_vif [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '523365ec-4501-5a9c-8f66-df07c8d5957c', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e37d096-7f, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e37d096-7f, col_values=(('qos', UUID('d0e43971-606a-4dc0-ad2c-4871e2926ee7')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e37d096-7f, col_values=(('external_ids', {'iface-id': '9e37d096-7f88-44a3-829f-e02f76065b09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:80:23', 'vm-uuid': '374e50f7-3158-4514-a033-24dba936ecc5'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:50:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:14 user nova-compute[74630]: INFO os_vif [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f')
Oct 26 03:50:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-34e9d60d-0301-48d7-bbdc-34d1c8597807 req-1e1ac61c-b718-4c69-89f8-3ca57db67b46 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:50:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-34e9d60d-0301-48d7-bbdc-34d1c8597807 req-1e1ac61c-b718-4c69-89f8-3ca57db67b46 service nova] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:50:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-34e9d60d-0301-48d7-bbdc-34d1c8597807 req-1e1ac61c-b718-4c69-89f8-3ca57db67b46 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:50:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-34e9d60d-0301-48d7-bbdc-34d1c8597807 req-1e1ac61c-b718-4c69-89f8-3ca57db67b46 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:50:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-34e9d60d-0301-48d7-bbdc-34d1c8597807 req-1e1ac61c-b718-4c69-89f8-3ca57db67b46 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] No waiting events found dispatching network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:50:16 user nova-compute[74630]: WARNING nova.compute.manager [req-34e9d60d-0301-48d7-bbdc-34d1c8597807 req-1e1ac61c-b718-4c69-89f8-3ca57db67b46 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received unexpected event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 for instance with vm_state stopped and task_state powering-on.
Oct 26 03:50:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:50:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Instance rebooted successfully.
Oct 26 03:50:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-1ede6f83-3716-485d-a649-4feceb021d5e tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:50:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-10355036-a57c-4cb7-a9ee-98ec879e066c req-220d4041-0d08-4ec7-8b7f-6f8db056e387 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:50:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-10355036-a57c-4cb7-a9ee-98ec879e066c req-220d4041-0d08-4ec7-8b7f-6f8db056e387 service nova] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:50:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-10355036-a57c-4cb7-a9ee-98ec879e066c req-220d4041-0d08-4ec7-8b7f-6f8db056e387 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:50:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-10355036-a57c-4cb7-a9ee-98ec879e066c req-220d4041-0d08-4ec7-8b7f-6f8db056e387 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:50:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-10355036-a57c-4cb7-a9ee-98ec879e066c req-220d4041-0d08-4ec7-8b7f-6f8db056e387 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] No waiting events found dispatching network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:50:18 user nova-compute[74630]: WARNING nova.compute.manager [req-10355036-a57c-4cb7-a9ee-98ec879e066c req-220d4041-0d08-4ec7-8b7f-6f8db056e387 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received unexpected event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 for instance with vm_state stopped and task_state powering-on.
Oct 26 03:50:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:30 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:50:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:38 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:50:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:42 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:50:42 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:50:43 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:50:43 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:50:43 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:50:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:50:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:50:43 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:50:43 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:50:43 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updating instance_info_cache with network_info: [{"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:50:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-374e50f7-3158-4514-a033-24dba936ecc5" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:50:43 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:50:43 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:50:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:44 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:50:44 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:50:45 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:50:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:50:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:50:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:50:45 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:50:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:50:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:50:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:50:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:50:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:50:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:50:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:50:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:50:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:50:46 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:50:46 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:50:46 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8540MB free_disk=25.041584014892578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:50:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:50:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:50:46 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 374e50f7-3158-4514-a033-24dba936ecc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:50:46 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 9e12c562-a000-4e1e-846d-1b2a4192743b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:50:46 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance fbc5b6fe-6293-4823-907d-f7f26a8096fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:50:46 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:50:46 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:50:46 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:50:46 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:50:46 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:50:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:50:47 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:50:47 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:50:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:50:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "9e12c562-a000-4e1e-846d-1b2a4192743b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:21 user nova-compute[74630]: INFO nova.compute.manager [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Terminating instance
Oct 26 03:51:21 user nova-compute[74630]: DEBUG nova.compute.manager [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:51:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:21 user nova-compute[74630]: DEBUG nova.compute.manager [req-e5588b51-81f4-4f56-b83d-1e98940ac8be req-ff56b8ce-a937-4569-b8a0-ba58ddf3829a service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received event network-vif-unplugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:51:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e5588b51-81f4-4f56-b83d-1e98940ac8be req-ff56b8ce-a937-4569-b8a0-ba58ddf3829a service nova] Acquiring lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e5588b51-81f4-4f56-b83d-1e98940ac8be req-ff56b8ce-a937-4569-b8a0-ba58ddf3829a service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e5588b51-81f4-4f56-b83d-1e98940ac8be req-ff56b8ce-a937-4569-b8a0-ba58ddf3829a service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:21 user nova-compute[74630]: DEBUG nova.compute.manager [req-e5588b51-81f4-4f56-b83d-1e98940ac8be req-ff56b8ce-a937-4569-b8a0-ba58ddf3829a service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] No waiting events found dispatching network-vif-unplugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:51:21 user nova-compute[74630]: DEBUG nova.compute.manager [req-e5588b51-81f4-4f56-b83d-1e98940ac8be req-ff56b8ce-a937-4569-b8a0-ba58ddf3829a service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received event network-vif-unplugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:22 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Instance destroyed successfully.
Oct 26 03:51:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG nova.objects.instance [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lazy-loading 'resources' on Instance uuid 9e12c562-a000-4e1e-846d-1b2a4192743b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-440692275',display_name='tempest-TestVolumeBootPattern-server-440692275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-440692275',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:50:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-q2gtey07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:50:01Z,user_data=None,user_id='3b3bd794500243df86a1e4e89414bea0',uuid=9e12c562-a000-4e1e-846d-1b2a4192743b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "address": "fa:16:3e:70:81:6b", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1959ced9-69", "ovs_interfaceid": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "address": "fa:16:3e:70:81:6b", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1959ced9-69", "ovs_interfaceid": "1959ced9-69e6-4bbb-8263-8368bdc14f61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:81:6b,bridge_name='br-int',has_traffic_filtering=True,id=1959ced9-69e6-4bbb-8263-8368bdc14f61,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1959ced9-69') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_vif [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:81:6b,bridge_name='br-int',has_traffic_filtering=True,id=1959ced9-69e6-4bbb-8263-8368bdc14f61,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1959ced9-69') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1959ced9-69, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1398b3ff-6a03-44d0-b5a1-cb6fa4761a80) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:51:22 user nova-compute[74630]: INFO os_vif [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:81:6b,bridge_name='br-int',has_traffic_filtering=True,id=1959ced9-69e6-4bbb-8263-8368bdc14f61,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1959ced9-69')
Oct 26 03:51:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jaEcAbSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:51:22 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a5810e-e148-4cb4-b7c3-03bf4437c5bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:51:22 user nova-compute[74630]: No targets found.
Oct 26 03:51:22 user nova-compute[74630]: iSNS:
Oct 26 03:51:22 user nova-compute[74630]: No targets found.
Oct 26 03:51:22 user nova-compute[74630]: STATIC:
Oct 26 03:51:22 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d
Oct 26 03:51:22 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:51:22 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:51:22 user nova-compute[74630]: FIRMWARE:
Oct 26 03:51:22 user nova-compute[74630]: No targets found.
Oct 26 03:51:22 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:51:22 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:51:22 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[735732e7-ce87-4796-ba4b-2301df47fddf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[728070d2-ec81-459d-8798-e2e24484bb2a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d (non-flash)
Oct 26 03:51:22 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d (non-flash)
Oct 26 03:51:22 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3185137ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[69960198-50c6-4161-bf21-8a8fdf4b1c3a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b5ecd1-e0e2-428f-9312-32090a4fb60a]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7edba29-3f76-4a2a-bcde-2e1a699f71b3]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.075s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[929a3dd9-d025-4f2b-9986-752594f3e10b]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26466326366626262', '/dev/disk/by-id/scsi-1SCST_BIObdbe4984-df2cfbbb0deebfa8', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bdbe4984') {{(pid=86251) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f02b3b-40ea-4e3c-a8c5-d7950d0e7e8f]: (4, None) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.110s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c21f60-1b7b-4328-b05c-cfb09beab2bb]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d15c6e-6008-439f-876f-4fa41225c65f]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d, portal: 172.16.0.220,3260]
Oct 26 03:51:22 user nova-compute[74630]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d, portal: 172.16.0.220,3260] successful.
Oct 26 03:51:22 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7be61a4c-46d1-42b6-a075-fc951bc8d20d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[794971f0-3983-4841-a6a6-184cc90e6f38]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.498s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== disconnect_volume: return (499ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:51:22 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Deleting instance files /opt/stack/data/nova/instances/9e12c562-a000-4e1e-846d-1b2a4192743b_del
Oct 26 03:51:22 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Deletion of /opt/stack/data/nova/instances/9e12c562-a000-4e1e-846d-1b2a4192743b_del complete
Oct 26 03:51:22 user nova-compute[74630]: INFO nova.compute.manager [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Took 1.46 seconds to destroy the instance on the hypervisor.
Oct 26 03:51:22 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:51:23 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Took 0.49 seconds to deallocate network for instance.
Oct 26 03:51:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-8fa0434e-b6bf-4059-aca9-b9649536f020 req-b26c5363-dbb2-4644-abc0-ff20f32da13b service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received event network-vif-deleted-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:51:23 user nova-compute[74630]: INFO nova.compute.manager [req-8fa0434e-b6bf-4059-aca9-b9649536f020 req-b26c5363-dbb2-4644-abc0-ff20f32da13b service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Neutron deleted interface 1959ced9-69e6-4bbb-8263-8368bdc14f61; detaching it from the instance and deleting it from the info cache
Oct 26 03:51:23 user nova-compute[74630]: DEBUG nova.network.neutron [req-8fa0434e-b6bf-4059-aca9-b9649536f020 req-b26c5363-dbb2-4644-abc0-ff20f32da13b service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-8fa0434e-b6bf-4059-aca9-b9649536f020 req-b26c5363-dbb2-4644-abc0-ff20f32da13b service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Detach interface failed, port_id=1959ced9-69e6-4bbb-8263-8368bdc14f61, reason: Instance 9e12c562-a000-4e1e-846d-1b2a4192743b could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received event network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] Acquiring lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] No waiting events found dispatching network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:51:23 user nova-compute[74630]: WARNING nova.compute.manager [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received unexpected event network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 for instance with vm_state active and task_state deleting.
Oct 26 03:51:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received event network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] Acquiring lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] No waiting events found dispatching network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:51:23 user nova-compute[74630]: WARNING nova.compute.manager [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received unexpected event network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 for instance with vm_state active and task_state deleting.
Oct 26 03:51:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received event network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] Acquiring lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] No waiting events found dispatching network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:51:23 user nova-compute[74630]: WARNING nova.compute.manager [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received unexpected event network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 for instance with vm_state active and task_state deleting.
Oct 26 03:51:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received event network-vif-unplugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] Acquiring lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] No waiting events found dispatching network-vif-unplugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received event network-vif-unplugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received event network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] Acquiring lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] No waiting events found dispatching network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:51:23 user nova-compute[74630]: WARNING nova.compute.manager [req-f3756515-723b-42c2-99aa-b24d7bf0b8ef req-ace9be57-7612-4378-8ebc-e67442a2db88 service nova] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Received unexpected event network-vif-plugged-1959ced9-69e6-4bbb-8263-8368bdc14f61 for instance with vm_state active and task_state deleting.
Oct 26 03:51:24 user nova-compute[74630]: INFO nova.compute.manager [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Took 0.85 seconds to detach 1 volumes for instance.
Oct 26 03:51:24 user nova-compute[74630]: DEBUG nova.compute.manager [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 9e12c562-a000-4e1e-846d-1b2a4192743b] Deleting volume: 7be61a4c-46d1-42b6-a075-fc951bc8d20d {{(pid=74630) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 03:51:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:24 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:51:24 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:51:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:24 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Deleted allocations for instance 9e12c562-a000-4e1e-846d-1b2a4192743b
Oct 26 03:51:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-cc64789a-9058-4b39-8a9a-8d563c6a657c tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "9e12c562-a000-4e1e-846d-1b2a4192743b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.257s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:26 user nova-compute[74630]: INFO nova.compute.manager [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Terminating instance
Oct 26 03:51:26 user nova-compute[74630]: DEBUG nova.compute.manager [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:51:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] There are 0 instances to clean {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-f6a38928-bd50-461b-a301-0dbe38a45d84 req-8e25d489-286a-410e-8313-8a83768675dd service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Received event network-vif-unplugged-b8b31bdf-dfa6-4883-98f2-355dd14075bd {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f6a38928-bd50-461b-a301-0dbe38a45d84 req-8e25d489-286a-410e-8313-8a83768675dd service nova] Acquiring lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f6a38928-bd50-461b-a301-0dbe38a45d84 req-8e25d489-286a-410e-8313-8a83768675dd service nova] Lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f6a38928-bd50-461b-a301-0dbe38a45d84 req-8e25d489-286a-410e-8313-8a83768675dd service nova] Lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-f6a38928-bd50-461b-a301-0dbe38a45d84 req-8e25d489-286a-410e-8313-8a83768675dd service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] No waiting events found dispatching network-vif-unplugged-b8b31bdf-dfa6-4883-98f2-355dd14075bd {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG nova.compute.manager [req-f6a38928-bd50-461b-a301-0dbe38a45d84 req-8e25d489-286a-410e-8313-8a83768675dd service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Received event network-vif-unplugged-b8b31bdf-dfa6-4883-98f2-355dd14075bd for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:27 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Instance destroyed successfully.
Oct 26 03:51:27 user nova-compute[74630]: DEBUG nova.objects.instance [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lazy-loading 'resources' on Instance uuid fbc5b6fe-6293-4823-907d-f7f26a8096fa {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-959893326',display_name='tempest-VolumesActionsTest-instance-959893326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-959893326',id=42,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ac8dcda91df4de894e45692b2ad24a7',ramdisk_id='',reservation_id='r-em56j7sm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-672192502',owner_user_name='tempest-VolumesActionsTest-672192502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:49:42Z,user_data=None,user_id='f5489febd6fe4bbdb5eb7ff82cf11873',uuid=fbc5b6fe-6293-4823-907d-f7f26a8096fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "address": "fa:16:3e:3a:cf:f0", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b31bdf-df", "ovs_interfaceid": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Converting VIF {"id": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "address": "fa:16:3e:3a:cf:f0", "network": {"id": "25c4b751-e4df-4653-9cf7-e43a583f48f1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2078269656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ac8dcda91df4de894e45692b2ad24a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b31bdf-df", "ovs_interfaceid": "b8b31bdf-dfa6-4883-98f2-355dd14075bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cf:f0,bridge_name='br-int',has_traffic_filtering=True,id=b8b31bdf-dfa6-4883-98f2-355dd14075bd,network=Network(25c4b751-e4df-4653-9cf7-e43a583f48f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8b31bdf-df') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG os_vif [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cf:f0,bridge_name='br-int',has_traffic_filtering=True,id=b8b31bdf-dfa6-4883-98f2-355dd14075bd,network=Network(25c4b751-e4df-4653-9cf7-e43a583f48f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8b31bdf-df') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8b31bdf-df, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6a5a47c-9d94-4f25-8146-1acd10e2093e) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:51:27 user nova-compute[74630]: INFO os_vif [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cf:f0,bridge_name='br-int',has_traffic_filtering=True,id=b8b31bdf-dfa6-4883-98f2-355dd14075bd,network=Network(25c4b751-e4df-4653-9cf7-e43a583f48f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8b31bdf-df')
Oct 26 03:51:27 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Deleting instance files /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa_del
Oct 26 03:51:27 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Deletion of /opt/stack/data/nova/instances/fbc5b6fe-6293-4823-907d-f7f26a8096fa_del complete
Oct 26 03:51:27 user nova-compute[74630]: INFO nova.compute.manager [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 26 03:51:27 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:51:27 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:51:28 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:51:28 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Took 0.38 seconds to deallocate network for instance.
Oct 26 03:51:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-9bf17330-0b13-4c1e-b820-6a1eac9b48d5 req-b99d8a92-d931-4923-97db-5360d0885e8a service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Received event network-vif-deleted-b8b31bdf-dfa6-4883-98f2-355dd14075bd {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:51:28 user nova-compute[74630]: INFO nova.compute.manager [req-9bf17330-0b13-4c1e-b820-6a1eac9b48d5 req-b99d8a92-d931-4923-97db-5360d0885e8a service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Neutron deleted interface b8b31bdf-dfa6-4883-98f2-355dd14075bd; detaching it from the instance and deleting it from the info cache
Oct 26 03:51:28 user nova-compute[74630]: DEBUG nova.network.neutron [req-9bf17330-0b13-4c1e-b820-6a1eac9b48d5 req-b99d8a92-d931-4923-97db-5360d0885e8a service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:51:28 user nova-compute[74630]: DEBUG nova.compute.manager [req-9bf17330-0b13-4c1e-b820-6a1eac9b48d5 req-b99d8a92-d931-4923-97db-5360d0885e8a service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Detach interface failed, port_id=b8b31bdf-dfa6-4883-98f2-355dd14075bd, reason: Instance fbc5b6fe-6293-4823-907d-f7f26a8096fa could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 03:51:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:28 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:51:28 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:51:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:28 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Deleted allocations for instance fbc5b6fe-6293-4823-907d-f7f26a8096fa
Oct 26 03:51:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-106cc571-b97d-4eb1-a839-341805a68b1e tempest-VolumesActionsTest-672192502 tempest-VolumesActionsTest-672192502-project-member] Lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.630s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-95ed9703-682a-430d-9e62-6dfea2cc5ddc req-fb7850d5-b523-4055-be80-89286edceeb4 service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Received event network-vif-plugged-b8b31bdf-dfa6-4883-98f2-355dd14075bd {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:51:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-95ed9703-682a-430d-9e62-6dfea2cc5ddc req-fb7850d5-b523-4055-be80-89286edceeb4 service nova] Acquiring lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-95ed9703-682a-430d-9e62-6dfea2cc5ddc req-fb7850d5-b523-4055-be80-89286edceeb4 service nova] Lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-95ed9703-682a-430d-9e62-6dfea2cc5ddc req-fb7850d5-b523-4055-be80-89286edceeb4 service nova] Lock "fbc5b6fe-6293-4823-907d-f7f26a8096fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-95ed9703-682a-430d-9e62-6dfea2cc5ddc req-fb7850d5-b523-4055-be80-89286edceeb4 service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] No waiting events found dispatching network-vif-plugged-b8b31bdf-dfa6-4883-98f2-355dd14075bd {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:51:29 user nova-compute[74630]: WARNING nova.compute.manager [req-95ed9703-682a-430d-9e62-6dfea2cc5ddc req-fb7850d5-b523-4055-be80-89286edceeb4 service nova] [instance: fbc5b6fe-6293-4823-907d-f7f26a8096fa] Received unexpected event network-vif-plugged-b8b31bdf-dfa6-4883-98f2-355dd14075bd for instance with vm_state deleted and task_state None.
Oct 26 03:51:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:51:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:51:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74630) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 03:51:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:51:40 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:51:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:51:43 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:51:43 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:51:43 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:51:44 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:51:45 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:51:45 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:51:45 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 03:51:46 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:51:47 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:51:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:47 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:51:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:51:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:51:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:51:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:51:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:51:48 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:51:48 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:51:48 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8818MB free_disk=25.067405700683594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:51:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:51:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:51:48 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 374e50f7-3158-4514-a033-24dba936ecc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:51:48 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:51:48 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:51:48 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:51:48 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:51:48 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:51:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:51:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:51:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:51:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:51:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:51:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:51:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:51:54 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:51:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:52:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:52:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:52:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:52:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:52:04 user nova-compute[74630]: INFO nova.compute.manager [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Terminating instance
Oct 26 03:52:04 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:52:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-4d557b2e-8de2-4130-b69d-712cb41e771e req-2b6d36f9-3e06-458a-8946-60a47228a4c1 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-vif-unplugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:52:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4d557b2e-8de2-4130-b69d-712cb41e771e req-2b6d36f9-3e06-458a-8946-60a47228a4c1 service nova] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:52:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4d557b2e-8de2-4130-b69d-712cb41e771e req-2b6d36f9-3e06-458a-8946-60a47228a4c1 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:52:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4d557b2e-8de2-4130-b69d-712cb41e771e req-2b6d36f9-3e06-458a-8946-60a47228a4c1 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:52:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-4d557b2e-8de2-4130-b69d-712cb41e771e req-2b6d36f9-3e06-458a-8946-60a47228a4c1 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] No waiting events found dispatching network-vif-unplugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:52:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-4d557b2e-8de2-4130-b69d-712cb41e771e req-2b6d36f9-3e06-458a-8946-60a47228a4c1 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-vif-unplugged-9e37d096-7f88-44a3-829f-e02f76065b09 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:52:05 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Instance destroyed successfully.
Oct 26 03:52:05 user nova-compute[74630]: DEBUG nova.objects.instance [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'resources' on Instance uuid 374e50f7-3158-4514-a033-24dba936ecc5 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:41:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1259939742',display_name='tempest-AttachVolumeTestJSON-server-1259939742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1259939742',id=38,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7EEO3GuKn+8kaEXSCwjJz8D30OIv6uEvszdV2tRdyXKLs86UHQIA++ZVypTxQLfMuMGfMKD5aQHpdWbHtpzsnVd6ppNb9G1YnsHZ9J9cAEGP3hhxc9zL5ZdfAWkgTL4A==',key_name='tempest-keypair-1586338171',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:42:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2671ecf470da4c5093899caa0e5b8313',ramdisk_id='',reservation_id='r-myp0eptt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2036216451',owner_user_name='tempest-AttachVolumeTestJSON-2036216451-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:50:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adadef6a5a8437b8ee3931cbeff5467',uuid=374e50f7-3158-4514-a033-24dba936ecc5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converting VIF {"id": "9e37d096-7f88-44a3-829f-e02f76065b09", "address": "fa:16:3e:95:80:23", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e37d096-7f", "ovs_interfaceid": "9e37d096-7f88-44a3-829f-e02f76065b09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG os_vif [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e37d096-7f, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0e43971-606a-4dc0-ad2c-4871e2926ee7) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:52:05 user nova-compute[74630]: INFO os_vif [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:80:23,bridge_name='br-int',has_traffic_filtering=True,id=9e37d096-7f88-44a3-829f-e02f76065b09,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e37d096-7f')
Oct 26 03:52:05 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Deleting instance files /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5_del
Oct 26 03:52:05 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Deletion of /opt/stack/data/nova/instances/374e50f7-3158-4514-a033-24dba936ecc5_del complete
Oct 26 03:52:05 user nova-compute[74630]: INFO nova.compute.manager [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Took 0.68 seconds to destroy the instance on the hypervisor.
Oct 26 03:52:05 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:52:05 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Took 0.78 seconds to deallocate network for instance.
Oct 26 03:52:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:52:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-57079fa2-2ca8-4d43-a956-3e0cf177b5c8 req-9d43e7b3-b86a-4e1e-953e-c77808fba99d service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-vif-deleted-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:52:06 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Refreshing inventories for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 03:52:06 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Updating ProviderTree inventory for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 03:52:06 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Updating inventory in ProviderTree for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 03:52:06 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Refreshing aggregate associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, aggregates: None {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 03:52:06 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Refreshing trait associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, traits: HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 03:52:06 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:52:06 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:52:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:52:06 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Deleted allocations for instance 374e50f7-3158-4514-a033-24dba936ecc5
Oct 26 03:52:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4dbfa56f-9b06-4326-b268-5db567b0b9c7 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "374e50f7-3158-4514-a033-24dba936ecc5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.975s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:52:06 user nova-compute[74630]: DEBUG nova.compute.manager [req-345f642f-a0b7-45a3-8762-ecb12196dcb8 req-01800d9d-337a-450d-8a44-050236824db3 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:52:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-345f642f-a0b7-45a3-8762-ecb12196dcb8 req-01800d9d-337a-450d-8a44-050236824db3 service nova] Acquiring lock "374e50f7-3158-4514-a033-24dba936ecc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:52:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-345f642f-a0b7-45a3-8762-ecb12196dcb8 req-01800d9d-337a-450d-8a44-050236824db3 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:52:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-345f642f-a0b7-45a3-8762-ecb12196dcb8 req-01800d9d-337a-450d-8a44-050236824db3 service nova] Lock "374e50f7-3158-4514-a033-24dba936ecc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:52:06 user nova-compute[74630]: DEBUG nova.compute.manager [req-345f642f-a0b7-45a3-8762-ecb12196dcb8 req-01800d9d-337a-450d-8a44-050236824db3 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] No waiting events found dispatching network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:52:06 user nova-compute[74630]: WARNING nova.compute.manager [req-345f642f-a0b7-45a3-8762-ecb12196dcb8 req-01800d9d-337a-450d-8a44-050236824db3 service nova] [instance: 374e50f7-3158-4514-a033-24dba936ecc5] Received unexpected event network-vif-plugged-9e37d096-7f88-44a3-829f-e02f76065b09 for instance with vm_state deleted and task_state None.
Oct 26 03:52:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:52:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:52:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:52:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:52:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:52:33 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:52:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:52:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:52:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:52:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:52:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:52:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:42 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:52:44 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:52:44 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:52:44 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:52:44 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:52:45 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:52:45 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:52:45 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:52:45 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 03:52:45 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:52:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:48 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:52:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:52:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:52:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:52:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:52:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:52:49 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:52:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:49 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:52:49 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:52:49 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8943MB free_disk=24.461772918701172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:52:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:52:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:52:49 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:52:49 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:52:49 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:52:49 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:52:49 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:52:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:52:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:52:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:52:52 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:52:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:52:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:52:52 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:52:52 user nova-compute[74630]: INFO nova.compute.claims [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Claim successful on node user
Oct 26 03:52:53 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG nova.network.neutron [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:52:53 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:52:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:52:53 user nova-compute[74630]: INFO nova.virt.block_device [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Booting with volume c82c3b76-e464-46db-8615-35e5814dc7ac at /dev/vda
Oct 26 03:52:53 user nova-compute[74630]: DEBUG nova.policy [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b3bd794500243df86a1e4e89414bea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbe37117ca24935b46795e7f7479af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG os_brick.utils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ed59f2-f486-44b5-a794-884ee123fdbc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b1fca4-278b-4dc4-9242-e4dbc8999cca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d69d56-d418-4755-a2e2-859602b80b44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9d839f-3cf9-437f-b027-671a65544c06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:52:53 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:52:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3707a9-1c69-461c-b2bc-d0443b026cae]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG os_brick.utils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Updating existing volume attachment record: ff77c42f-16bf-4739-b45f-062f9cba5078 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:52:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:54 user nova-compute[74630]: DEBUG nova.network.neutron [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Successfully created port: 5bfd3672-b1e4-43c9-943f-37333169b430 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:52:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Successfully updated port: 5bfd3672-b1e4-43c9-943f-37333169b430 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:52:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "refresh_cache-dbffcb7f-4576-4250-90a8-cc35f53c1f7b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:52:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquired lock "refresh_cache-dbffcb7f-4576-4250-90a8-cc35f53c1f7b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:52:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:52:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-9da8bd55-2923-4399-9a58-d60abdf0789a req-0ae9367a-4671-416d-ab4f-5633cd1b1b7f service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Received event network-changed-5bfd3672-b1e4-43c9-943f-37333169b430 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:52:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-9da8bd55-2923-4399-9a58-d60abdf0789a req-0ae9367a-4671-416d-ab4f-5633cd1b1b7f service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Refreshing instance network info cache due to event network-changed-5bfd3672-b1e4-43c9-943f-37333169b430. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:52:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9da8bd55-2923-4399-9a58-d60abdf0789a req-0ae9367a-4671-416d-ab4f-5633cd1b1b7f service nova] Acquiring lock "refresh_cache-dbffcb7f-4576-4250-90a8-cc35f53c1f7b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:52:56 user nova-compute[74630]: DEBUG nova.network.neutron [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:52:56 user nova-compute[74630]: DEBUG nova.network.neutron [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Updating instance_info_cache with network_info: [{"id": "5bfd3672-b1e4-43c9-943f-37333169b430", "address": "fa:16:3e:18:5f:ac", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfd3672-b1", "ovs_interfaceid": "5bfd3672-b1e4-43c9-943f-37333169b430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:52:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Releasing lock "refresh_cache-dbffcb7f-4576-4250-90a8-cc35f53c1f7b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:52:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Instance network_info: |[{"id": "5bfd3672-b1e4-43c9-943f-37333169b430", "address": "fa:16:3e:18:5f:ac", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfd3672-b1", "ovs_interfaceid": "5bfd3672-b1e4-43c9-943f-37333169b430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:52:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9da8bd55-2923-4399-9a58-d60abdf0789a req-0ae9367a-4671-416d-ab4f-5633cd1b1b7f service nova] Acquired lock "refresh_cache-dbffcb7f-4576-4250-90a8-cc35f53c1f7b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:52:56 user nova-compute[74630]: DEBUG nova.network.neutron [req-9da8bd55-2923-4399-9a58-d60abdf0789a req-0ae9367a-4671-416d-ab4f-5633cd1b1b7f service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Refreshing network info cache for port 5bfd3672-b1e4-43c9-943f-37333169b430 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:52:57 user nova-compute[74630]: DEBUG nova.network.neutron [req-9da8bd55-2923-4399-9a58-d60abdf0789a req-0ae9367a-4671-416d-ab4f-5633cd1b1b7f service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Updated VIF entry in instance network info cache for port 5bfd3672-b1e4-43c9-943f-37333169b430. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:52:57 user nova-compute[74630]: DEBUG nova.network.neutron [req-9da8bd55-2923-4399-9a58-d60abdf0789a req-0ae9367a-4671-416d-ab4f-5633cd1b1b7f service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Updating instance_info_cache with network_info: [{"id": "5bfd3672-b1e4-43c9-943f-37333169b430", "address": "fa:16:3e:18:5f:ac", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfd3672-b1", "ovs_interfaceid": "5bfd3672-b1e4-43c9-943f-37333169b430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:52:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9da8bd55-2923-4399-9a58-d60abdf0789a req-0ae9367a-4671-416d-ab4f-5633cd1b1b7f service nova] Releasing lock "refresh_cache-dbffcb7f-4576-4250-90a8-cc35f53c1f7b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:52:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:52:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:52:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:52:59 user nova-compute[74630]: INFO nova.compute.claims [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Claim successful on node user
Oct 26 03:52:59 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG nova.network.neutron [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:52:59 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:52:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG nova.policy [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2adadef6a5a8437b8ee3931cbeff5467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2671ecf470da4c5093899caa0e5b8313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:52:59 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Creating image(s)
Oct 26 03:52:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "/opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "/opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "/opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.209s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:52:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.204s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk 1073741824" returned: 0 in 0.068s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Successfully created port: 4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.201s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Cannot resize image /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Ensure instance console log exists: /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Successfully updated port: 4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "refresh_cache-18ccafbd-d620-4c00-8cbe-0e48006238cc" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquired lock "refresh_cache-18ccafbd-d620-4c00-8cbe-0e48006238cc" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-29c59b66-d8f2-408c-85d1-337cbbe5a9da req-f15958b0-3ad3-4379-8faf-c8126ce33490 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received event network-changed-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-29c59b66-d8f2-408c-85d1-337cbbe5a9da req-f15958b0-3ad3-4379-8faf-c8126ce33490 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Refreshing instance network info cache due to event network-changed-4c791217-e407-4a3c-9de2-f4cdccc586ee. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-29c59b66-d8f2-408c-85d1-337cbbe5a9da req-f15958b0-3ad3-4379-8faf-c8126ce33490 service nova] Acquiring lock "refresh_cache-18ccafbd-d620-4c00-8cbe-0e48006238cc" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:53:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.network.neutron [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Updating instance_info_cache with network_info: [{"id": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "address": "fa:16:3e:25:f4:45", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c791217-e4", "ovs_interfaceid": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Releasing lock "refresh_cache-18ccafbd-d620-4c00-8cbe-0e48006238cc" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Instance network_info: |[{"id": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "address": "fa:16:3e:25:f4:45", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c791217-e4", "ovs_interfaceid": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-29c59b66-d8f2-408c-85d1-337cbbe5a9da req-f15958b0-3ad3-4379-8faf-c8126ce33490 service nova] Acquired lock "refresh_cache-18ccafbd-d620-4c00-8cbe-0e48006238cc" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-29c59b66-d8f2-408c-85d1-337cbbe5a9da req-f15958b0-3ad3-4379-8faf-c8126ce33490 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Refreshing network info cache for port 4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Start _get_guest_xml network_info=[{"id": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "address": "fa:16:3e:25:f4:45", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c791217-e4", "ovs_interfaceid": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:53:01 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:53:01 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1893156473',display_name='tempest-AttachVolumeTestJSON-server-1893156473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1893156473',id=44,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfjiYW2ooRRWOw06CRdlmicT4cjTthrlnWGFBa7a3HrT7cn+Ge7If5y1LrS29ClMv/zCHrd3AzXHo3Dgt9CtwzDH7XW+h6si2L3EX2VFPMOVRL56lCrsRe0ELvpyDN+rw==',key_name='tempest-keypair-803405658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2671ecf470da4c5093899caa0e5b8313',ramdisk_id='',reservation_id='r-r0pqmxdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2036216451',owner_user_name='tempest-AttachVolumeTestJSON-2036216451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adadef6a5a8437b8ee3931cbeff5467',uuid=18ccafbd-d620-4c00-8cbe-0e48006238cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "address": "fa:16:3e:25:f4:45", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c791217-e4", "ovs_interfaceid": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converting VIF {"id": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "address": "fa:16:3e:25:f4:45", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c791217-e4", "ovs_interfaceid": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:f4:45,bridge_name='br-int',has_traffic_filtering=True,id=4c791217-e407-4a3c-9de2-f4cdccc586ee,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c791217-e4') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.objects.instance [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'pci_devices' on Instance uuid 18ccafbd-d620-4c00-8cbe-0e48006238cc {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:53:01 user nova-compute[74630]:   <uuid>18ccafbd-d620-4c00-8cbe-0e48006238cc</uuid>
Oct 26 03:53:01 user nova-compute[74630]:   <name>instance-0000002c</name>
Oct 26 03:53:01 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:53:01 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:53:01 user nova-compute[74630]:   <metadata>
Oct 26 03:53:01 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:53:01 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:53:01 user nova-compute[74630]:       <nova:name>tempest-AttachVolumeTestJSON-server-1893156473</nova:name>
Oct 26 03:53:01 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:53:01</nova:creationTime>
Oct 26 03:53:01 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:53:01 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:53:01 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:53:01 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:53:01 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:53:01 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:53:01 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:53:01 user nova-compute[74630]:       <nova:owner>
Oct 26 03:53:01 user nova-compute[74630]:         <nova:user uuid="2adadef6a5a8437b8ee3931cbeff5467">tempest-AttachVolumeTestJSON-2036216451-project-member</nova:user>
Oct 26 03:53:01 user nova-compute[74630]:         <nova:project uuid="2671ecf470da4c5093899caa0e5b8313">tempest-AttachVolumeTestJSON-2036216451</nova:project>
Oct 26 03:53:01 user nova-compute[74630]:       </nova:owner>
Oct 26 03:53:01 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 03:53:01 user nova-compute[74630]:       <nova:ports>
Oct 26 03:53:01 user nova-compute[74630]:         <nova:port uuid="4c791217-e407-4a3c-9de2-f4cdccc586ee">
Oct 26 03:53:01 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 03:53:01 user nova-compute[74630]:         </nova:port>
Oct 26 03:53:01 user nova-compute[74630]:       </nova:ports>
Oct 26 03:53:01 user nova-compute[74630]:     </nova:instance>
Oct 26 03:53:01 user nova-compute[74630]:   </metadata>
Oct 26 03:53:01 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:53:01 user nova-compute[74630]:     <system>
Oct 26 03:53:01 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:53:01 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:53:01 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:53:01 user nova-compute[74630]:       <entry name="serial">18ccafbd-d620-4c00-8cbe-0e48006238cc</entry>
Oct 26 03:53:01 user nova-compute[74630]:       <entry name="uuid">18ccafbd-d620-4c00-8cbe-0e48006238cc</entry>
Oct 26 03:53:01 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:53:01 user nova-compute[74630]:     </system>
Oct 26 03:53:01 user nova-compute[74630]:   </sysinfo>
Oct 26 03:53:01 user nova-compute[74630]:   <os>
Oct 26 03:53:01 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:53:01 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:53:01 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:53:01 user nova-compute[74630]:   </os>
Oct 26 03:53:01 user nova-compute[74630]:   <features>
Oct 26 03:53:01 user nova-compute[74630]:     <acpi/>
Oct 26 03:53:01 user nova-compute[74630]:     <apic/>
Oct 26 03:53:01 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:53:01 user nova-compute[74630]:   </features>
Oct 26 03:53:01 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:53:01 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:53:01 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:53:01 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:53:01 user nova-compute[74630]:   </clock>
Oct 26 03:53:01 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:53:01 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:53:01 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:53:01 user nova-compute[74630]:   </cpu>
Oct 26 03:53:01 user nova-compute[74630]:   <devices>
Oct 26 03:53:01 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:53:01 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:53:01 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk"/>
Oct 26 03:53:01 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:53:01 user nova-compute[74630]:     </disk>
Oct 26 03:53:01 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:53:01 user nova-compute[74630]:       <mac address="fa:16:3e:25:f4:45"/>
Oct 26 03:53:01 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:53:01 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:53:01 user nova-compute[74630]:       <target dev="tap4c791217-e4"/>
Oct 26 03:53:01 user nova-compute[74630]:     </interface>
Oct 26 03:53:01 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:53:01 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/console.log" append="off"/>
Oct 26 03:53:01 user nova-compute[74630]:     </serial>
Oct 26 03:53:01 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:53:01 user nova-compute[74630]:     <video>
Oct 26 03:53:01 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:53:01 user nova-compute[74630]:     </video>
Oct 26 03:53:01 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:53:01 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:53:01 user nova-compute[74630]:     </rng>
Oct 26 03:53:01 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:53:01 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:53:01 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:53:01 user nova-compute[74630]:     </memballoon>
Oct 26 03:53:01 user nova-compute[74630]:   </devices>
Oct 26 03:53:01 user nova-compute[74630]: </domain>
Oct 26 03:53:01 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1893156473',display_name='tempest-AttachVolumeTestJSON-server-1893156473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1893156473',id=44,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfjiYW2ooRRWOw06CRdlmicT4cjTthrlnWGFBa7a3HrT7cn+Ge7If5y1LrS29ClMv/zCHrd3AzXHo3Dgt9CtwzDH7XW+h6si2L3EX2VFPMOVRL56lCrsRe0ELvpyDN+rw==',key_name='tempest-keypair-803405658',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2671ecf470da4c5093899caa0e5b8313',ramdisk_id='',reservation_id='r-r0pqmxdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2036216451',owner_user_name='tempest-AttachVolumeTestJSON-2036216451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adadef6a5a8437b8ee3931cbeff5467',uuid=18ccafbd-d620-4c00-8cbe-0e48006238cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "address": "fa:16:3e:25:f4:45", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c791217-e4", "ovs_interfaceid": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converting VIF {"id": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "address": "fa:16:3e:25:f4:45", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c791217-e4", "ovs_interfaceid": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:f4:45,bridge_name='br-int',has_traffic_filtering=True,id=4c791217-e407-4a3c-9de2-f4cdccc586ee,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c791217-e4') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG os_vif [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:f4:45,bridge_name='br-int',has_traffic_filtering=True,id=4c791217-e407-4a3c-9de2-f4cdccc586ee,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c791217-e4') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2461665b-aef9-5be1-969d-8bdc61c8b685', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c791217-e4, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c791217-e4, col_values=(('qos', UUID('10507887-4964-49f6-9b4d-8bb882899120')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c791217-e4, col_values=(('external_ids', {'iface-id': '4c791217-e407-4a3c-9de2-f4cdccc586ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:f4:45', 'vm-uuid': '18ccafbd-d620-4c00-8cbe-0e48006238cc'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:01 user nova-compute[74630]: INFO os_vif [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:f4:45,bridge_name='br-int',has_traffic_filtering=True,id=4c791217-e407-4a3c-9de2-f4cdccc586ee,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c791217-e4')
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] No VIF found with MAC fa:16:3e:25:f4:45, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:53:01 user nova-compute[74630]: INFO nova.compute.claims [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Claim successful on node user
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-29c59b66-d8f2-408c-85d1-337cbbe5a9da req-f15958b0-3ad3-4379-8faf-c8126ce33490 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Updated VIF entry in instance network info cache for port 4c791217-e407-4a3c-9de2-f4cdccc586ee. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-29c59b66-d8f2-408c-85d1-337cbbe5a9da req-f15958b0-3ad3-4379-8faf-c8126ce33490 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Updating instance_info_cache with network_info: [{"id": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "address": "fa:16:3e:25:f4:45", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c791217-e4", "ovs_interfaceid": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-29c59b66-d8f2-408c-85d1-337cbbe5a9da req-f15958b0-3ad3-4379-8faf-c8126ce33490 service nova] Releasing lock "refresh_cache-18ccafbd-d620-4c00-8cbe-0e48006238cc" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:53:02 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:53:02 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG nova.policy [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '550739bc40d54768ba62e194386d0857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d280a7d3a82455f9929dea5a753861c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:53:02 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Creating image(s)
Oct 26 03:53:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "/opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "/opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "/opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "294e77f7eebd000795cbc3663d4deee47da15673" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "294e77f7eebd000795cbc3663d4deee47da15673" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673.part --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Successfully created port: b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673.part --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG nova.virt.images [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] 0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5 was qcow2, converting to raw {{(pid=74630) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673.part /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673.converted {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673.part /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673.converted" returned: 0 in 0.172s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673.converted --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-a7f59672-1478-46bd-927b-b73888941375 req-9ce96e40-9ce3-42dd-866a-ba0a36ad5fa1 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received event network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a7f59672-1478-46bd-927b-b73888941375 req-9ce96e40-9ce3-42dd-866a-ba0a36ad5fa1 service nova] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a7f59672-1478-46bd-927b-b73888941375 req-9ce96e40-9ce3-42dd-866a-ba0a36ad5fa1 service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a7f59672-1478-46bd-927b-b73888941375 req-9ce96e40-9ce3-42dd-866a-ba0a36ad5fa1 service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-a7f59672-1478-46bd-927b-b73888941375 req-9ce96e40-9ce3-42dd-866a-ba0a36ad5fa1 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] No waiting events found dispatching network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:53:03 user nova-compute[74630]: WARNING nova.compute.manager [req-a7f59672-1478-46bd-927b-b73888941375 req-9ce96e40-9ce3-42dd-866a-ba0a36ad5fa1 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received unexpected event network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee for instance with vm_state building and task_state spawning.
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673.converted --force-share --output=json" returned: 0 in 0.265s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "294e77f7eebd000795cbc3663d4deee47da15673" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.986s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673 --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Successfully updated port: b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673 --force-share --output=json" returned: 0 in 0.200s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "294e77f7eebd000795cbc3663d4deee47da15673" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "294e77f7eebd000795cbc3663d4deee47da15673" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673 --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquired lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-29190200-0d60-4e46-aed2-867342f0929a req-31b15e93-6fa1-438c-ac85-9d5960c6ab3a service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received event network-changed-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG nova.compute.manager [req-29190200-0d60-4e46-aed2-867342f0929a req-31b15e93-6fa1-438c-ac85-9d5960c6ab3a service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Refreshing instance network info cache due to event network-changed-b3a6726e-9121-438a-932f-0b702074e093. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-29190200-0d60-4e46-aed2-867342f0929a req-31b15e93-6fa1-438c-ac85-9d5960c6ab3a service nova] Acquiring lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673 --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673,backing_fmt=raw /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673,backing_fmt=raw /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk 1073741824" returned: 0 in 0.055s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "294e77f7eebd000795cbc3663d4deee47da15673" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673 --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673 --force-share --output=json" returned: 0 in 0.172s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG nova.network.neutron [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updating instance_info_cache with network_info: [{"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Releasing lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Instance network_info: |[{"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-29190200-0d60-4e46-aed2-867342f0929a req-31b15e93-6fa1-438c-ac85-9d5960c6ab3a service nova] Acquired lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG nova.network.neutron [req-29190200-0d60-4e46-aed2-867342f0929a req-31b15e93-6fa1-438c-ac85-9d5960c6ab3a service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Refreshing network info cache for port b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:53:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Cannot resize image /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Ensure instance console log exists: /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Start _get_guest_xml network_info=[{"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:52:59Z,direct_url=<?>,disk_format='qcow2',id=0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5,min_disk=0,min_ram=0,name='tempest-scenario-img--1371271188',owner='3d280a7d3a82455f9929dea5a753861c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:53:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:53:04 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:53:04 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:52:59Z,direct_url=<?>,disk_format='qcow2',id=0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5,min_disk=0,min_ram=0,name='tempest-scenario-img--1371271188',owner='3d280a7d3a82455f9929dea5a753861c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:53:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1826431466',display_name='tempest-TestMinimumBasicScenario-server-1826431466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1826431466',id=45,image_ref='0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9PtsTGh9gB8alIhq2RBBVboT0aSZb4GGsQtL10//ZVj77mrh4abPILIw+2mfKhxGr627QmbI7upZLcQ+fEInO7yLMoi2WxKOylmH37Yw/29cfE3Vi3+dylDH0gGbwKeg==',key_name='tempest-TestMinimumBasicScenario-683470242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d280a7d3a82455f9929dea5a753861c',ramdisk_id='',reservation_id='r-8wfzyv88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1824331495',owner_user_name='tempest-TestMinimumBasicScenario-1824331495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:53:02Z,user_data=None,user_id='550739bc40d54768ba62e194386d0857',uuid=049abd73-381a-41d4-b0f8-134d1e7831c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converting VIF {"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:69:2f,bridge_name='br-int',has_traffic_filtering=True,id=b3a6726e-9121-438a-932f-0b702074e093,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a6726e-91') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.objects.instance [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lazy-loading 'pci_devices' on Instance uuid 049abd73-381a-41d4-b0f8-134d1e7831c6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:53:04 user nova-compute[74630]:   <uuid>049abd73-381a-41d4-b0f8-134d1e7831c6</uuid>
Oct 26 03:53:04 user nova-compute[74630]:   <name>instance-0000002d</name>
Oct 26 03:53:04 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:53:04 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:53:04 user nova-compute[74630]:   <metadata>
Oct 26 03:53:04 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:53:04 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:53:04 user nova-compute[74630]:       <nova:name>tempest-TestMinimumBasicScenario-server-1826431466</nova:name>
Oct 26 03:53:04 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:53:04</nova:creationTime>
Oct 26 03:53:04 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:53:04 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:53:04 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:53:04 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:53:04 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:53:04 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:53:04 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:53:04 user nova-compute[74630]:       <nova:owner>
Oct 26 03:53:04 user nova-compute[74630]:         <nova:user uuid="550739bc40d54768ba62e194386d0857">tempest-TestMinimumBasicScenario-1824331495-project-member</nova:user>
Oct 26 03:53:04 user nova-compute[74630]:         <nova:project uuid="3d280a7d3a82455f9929dea5a753861c">tempest-TestMinimumBasicScenario-1824331495</nova:project>
Oct 26 03:53:04 user nova-compute[74630]:       </nova:owner>
Oct 26 03:53:04 user nova-compute[74630]:       <nova:root type="image" uuid="0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5"/>
Oct 26 03:53:04 user nova-compute[74630]:       <nova:ports>
Oct 26 03:53:04 user nova-compute[74630]:         <nova:port uuid="b3a6726e-9121-438a-932f-0b702074e093">
Oct 26 03:53:04 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 03:53:04 user nova-compute[74630]:         </nova:port>
Oct 26 03:53:04 user nova-compute[74630]:       </nova:ports>
Oct 26 03:53:04 user nova-compute[74630]:     </nova:instance>
Oct 26 03:53:04 user nova-compute[74630]:   </metadata>
Oct 26 03:53:04 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:53:04 user nova-compute[74630]:     <system>
Oct 26 03:53:04 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:53:04 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:53:04 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:53:04 user nova-compute[74630]:       <entry name="serial">049abd73-381a-41d4-b0f8-134d1e7831c6</entry>
Oct 26 03:53:04 user nova-compute[74630]:       <entry name="uuid">049abd73-381a-41d4-b0f8-134d1e7831c6</entry>
Oct 26 03:53:04 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:53:04 user nova-compute[74630]:     </system>
Oct 26 03:53:04 user nova-compute[74630]:   </sysinfo>
Oct 26 03:53:04 user nova-compute[74630]:   <os>
Oct 26 03:53:04 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:53:04 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:53:04 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:53:04 user nova-compute[74630]:   </os>
Oct 26 03:53:04 user nova-compute[74630]:   <features>
Oct 26 03:53:04 user nova-compute[74630]:     <acpi/>
Oct 26 03:53:04 user nova-compute[74630]:     <apic/>
Oct 26 03:53:04 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:53:04 user nova-compute[74630]:   </features>
Oct 26 03:53:04 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:53:04 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:53:04 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:53:04 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:53:04 user nova-compute[74630]:   </clock>
Oct 26 03:53:04 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:53:04 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:53:04 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:53:04 user nova-compute[74630]:   </cpu>
Oct 26 03:53:04 user nova-compute[74630]:   <devices>
Oct 26 03:53:04 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:53:04 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:53:04 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk"/>
Oct 26 03:53:04 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:53:04 user nova-compute[74630]:     </disk>
Oct 26 03:53:04 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:53:04 user nova-compute[74630]:       <mac address="fa:16:3e:3b:69:2f"/>
Oct 26 03:53:04 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:53:04 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:53:04 user nova-compute[74630]:       <target dev="tapb3a6726e-91"/>
Oct 26 03:53:04 user nova-compute[74630]:     </interface>
Oct 26 03:53:04 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:53:04 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/console.log" append="off"/>
Oct 26 03:53:04 user nova-compute[74630]:     </serial>
Oct 26 03:53:04 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:53:04 user nova-compute[74630]:     <video>
Oct 26 03:53:04 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:53:04 user nova-compute[74630]:     </video>
Oct 26 03:53:04 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:53:04 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:53:04 user nova-compute[74630]:     </rng>
Oct 26 03:53:04 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:53:04 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:53:04 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:53:04 user nova-compute[74630]:     </memballoon>
Oct 26 03:53:04 user nova-compute[74630]:   </devices>
Oct 26 03:53:04 user nova-compute[74630]: </domain>
Oct 26 03:53:04 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1826431466',display_name='tempest-TestMinimumBasicScenario-server-1826431466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1826431466',id=45,image_ref='0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9PtsTGh9gB8alIhq2RBBVboT0aSZb4GGsQtL10//ZVj77mrh4abPILIw+2mfKhxGr627QmbI7upZLcQ+fEInO7yLMoi2WxKOylmH37Yw/29cfE3Vi3+dylDH0gGbwKeg==',key_name='tempest-TestMinimumBasicScenario-683470242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d280a7d3a82455f9929dea5a753861c',ramdisk_id='',reservation_id='r-8wfzyv88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1824331495',owner_user_name='tempest-TestMinimumBasicScenario-1824331495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:53:02Z,user_data=None,user_id='550739bc40d54768ba62e194386d0857',uuid=049abd73-381a-41d4-b0f8-134d1e7831c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converting VIF {"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:69:2f,bridge_name='br-int',has_traffic_filtering=True,id=b3a6726e-9121-438a-932f-0b702074e093,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a6726e-91') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG os_vif [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:69:2f,bridge_name='br-int',has_traffic_filtering=True,id=b3a6726e-9121-438a-932f-0b702074e093,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a6726e-91') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28671eaf-5070-5aa7-9047-9a0ba3c5dccd', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3a6726e-91, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3a6726e-91, col_values=(('qos', UUID('a65c17ee-80db-4c3d-9a0e-7612d137badb')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3a6726e-91, col_values=(('external_ids', {'iface-id': 'b3a6726e-9121-438a-932f-0b702074e093', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:69:2f', 'vm-uuid': '049abd73-381a-41d4-b0f8-134d1e7831c6'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:04 user nova-compute[74630]: INFO os_vif [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:69:2f,bridge_name='br-int',has_traffic_filtering=True,id=b3a6726e-9121-438a-932f-0b702074e093,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a6726e-91')
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] No VIF found with MAC fa:16:3e:3b:69:2f, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-29190200-0d60-4e46-aed2-867342f0929a req-31b15e93-6fa1-438c-ac85-9d5960c6ab3a service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updated VIF entry in instance network info cache for port b3a6726e-9121-438a-932f-0b702074e093. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG nova.network.neutron [req-29190200-0d60-4e46-aed2-867342f0929a req-31b15e93-6fa1-438c-ac85-9d5960c6ab3a service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updating instance_info_cache with network_info: [{"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:53:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-29190200-0d60-4e46-aed2-867342f0929a req-31b15e93-6fa1-438c-ac85-9d5960c6ab3a service nova] Releasing lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-9b9ae53c-f42d-4e5e-be48-13e2e48883b0 req-b01080ea-5c33-4f9e-84aa-8ddcd228c992 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received event network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9b9ae53c-f42d-4e5e-be48-13e2e48883b0 req-b01080ea-5c33-4f9e-84aa-8ddcd228c992 service nova] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9b9ae53c-f42d-4e5e-be48-13e2e48883b0 req-b01080ea-5c33-4f9e-84aa-8ddcd228c992 service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9b9ae53c-f42d-4e5e-be48-13e2e48883b0 req-b01080ea-5c33-4f9e-84aa-8ddcd228c992 service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-9b9ae53c-f42d-4e5e-be48-13e2e48883b0 req-b01080ea-5c33-4f9e-84aa-8ddcd228c992 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] No waiting events found dispatching network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:53:05 user nova-compute[74630]: WARNING nova.compute.manager [req-9b9ae53c-f42d-4e5e-be48-13e2e48883b0 req-b01080ea-5c33-4f9e-84aa-8ddcd228c992 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received unexpected event network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee for instance with vm_state building and task_state spawning.
Oct 26 03:53:05 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:53:05 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Instance spawned successfully.
Oct 26 03:53:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:05 user nova-compute[74630]: INFO nova.compute.manager [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Took 5.79 seconds to spawn the instance on the hypervisor.
Oct 26 03:53:05 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:05 user nova-compute[74630]: INFO nova.compute.manager [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Took 6.45 seconds to build instance.
Oct 26 03:53:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d3ba43df-ba43-4350-b4ef-30bd86f80098 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.563s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-7ac918dd-76b3-45a2-a486-552ed92bbcde req-9092e0b6-7ad0-4757-8896-6483da5bd8f4 service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received event network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7ac918dd-76b3-45a2-a486-552ed92bbcde req-9092e0b6-7ad0-4757-8896-6483da5bd8f4 service nova] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7ac918dd-76b3-45a2-a486-552ed92bbcde req-9092e0b6-7ad0-4757-8896-6483da5bd8f4 service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7ac918dd-76b3-45a2-a486-552ed92bbcde req-9092e0b6-7ad0-4757-8896-6483da5bd8f4 service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:05 user nova-compute[74630]: DEBUG nova.compute.manager [req-7ac918dd-76b3-45a2-a486-552ed92bbcde req-9092e0b6-7ad0-4757-8896-6483da5bd8f4 service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] No waiting events found dispatching network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:53:05 user nova-compute[74630]: WARNING nova.compute.manager [req-7ac918dd-76b3-45a2-a486-552ed92bbcde req-9092e0b6-7ad0-4757-8896-6483da5bd8f4 service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received unexpected event network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 for instance with vm_state building and task_state spawning.
Oct 26 03:53:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-8798a129-b3aa-4a91-b7f0-a55aa5e5e369 req-cbc80c3e-98fb-43d8-ac43-212e575b9b16 service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received event network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:53:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8798a129-b3aa-4a91-b7f0-a55aa5e5e369 req-cbc80c3e-98fb-43d8-ac43-212e575b9b16 service nova] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8798a129-b3aa-4a91-b7f0-a55aa5e5e369 req-cbc80c3e-98fb-43d8-ac43-212e575b9b16 service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8798a129-b3aa-4a91-b7f0-a55aa5e5e369 req-cbc80c3e-98fb-43d8-ac43-212e575b9b16 service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:07 user nova-compute[74630]: DEBUG nova.compute.manager [req-8798a129-b3aa-4a91-b7f0-a55aa5e5e369 req-cbc80c3e-98fb-43d8-ac43-212e575b9b16 service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] No waiting events found dispatching network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:53:07 user nova-compute[74630]: WARNING nova.compute.manager [req-8798a129-b3aa-4a91-b7f0-a55aa5e5e369 req-cbc80c3e-98fb-43d8-ac43-212e575b9b16 service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received unexpected event network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 for instance with vm_state building and task_state spawning.
Oct 26 03:53:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:53:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:53:07 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Instance spawned successfully.
Oct 26 03:53:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:53:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:08 user nova-compute[74630]: INFO nova.compute.manager [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Took 5.82 seconds to spawn the instance on the hypervisor.
Oct 26 03:53:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:53:08 user nova-compute[74630]: INFO nova.compute.manager [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Took 6.51 seconds to build instance.
Oct 26 03:53:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4310b03a-5dd1-4f19-a08b-4f7e2f72a611 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.618s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:53:12 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Creating image(s)
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Ensure instance console log exists: /opt/stack/data/nova/instances/dbffcb7f-4576-4250-90a8-cc35f53c1f7b/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Start _get_guest_xml network_info=[{"id": "5bfd3672-b1e4-43c9-943f-37333169b430", "address": "fa:16:3e:18:5f:ac", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfd3672-b1", "ovs_interfaceid": "5bfd3672-b1e4-43c9-943f-37333169b430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryJnlAck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dbffcb7f-4576-4250-90a8-cc35f53c1f7b', 'attached_at': '', 'detached_at': '', 'volume_id': 'c82c3b76-e464-46db-8615-35e5814dc7ac', 'serial': 'c82c3b76-e464-46db-8615-35e5814dc7ac'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': 'ff77c42f-16bf-4739-b45f-062f9cba5078', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:53:12 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:53:12 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryJnlAck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:53:12 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:53:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:53:12 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:53:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:53:12 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:53:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:12 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd0d63d-4b36-4229-8fa4-632debcbd93e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:53:13 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbf046c-fabf-4ffc-8389-6e06eef0e1f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac] added
Oct 26 03:53:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bac84f-2063-466c-bd43-179d1b35db82]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[750e981f-224c-4fd4-b2a9-ca92645e3bdd]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ryJnlAck {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ryJnlAck" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e172f61e-0a59-4cd8-972f-23fe9083439a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ryJnlAck'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a654eaf5-a0f5-4456-b052-cde424b343aa]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a619f05-25ed-43e2-8f75-ebe546b35bca]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 03:53:13 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 03:53:13 user nova-compute[74630]:  {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:53:13 user nova-compute[74630]: WARNING os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 03:53:13 user nova-compute[74630]: 
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[836221df-1624-4cd4-9a9f-f08bb7994def]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac, portal: 172.16.0.220,3260]
Oct 26 03:53:13 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac, portal: 172.16.0.220,3260] successful.
Oct 26 03:53:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[667c253b-df26-4965-aaa0-515a1bb0e9f2]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb7cf88-f05c-4227-826d-8c25b5e00914]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:53:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:53:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e17e0ca-4e96-4c7d-b944-5748ab013e66]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryJnlAck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:53:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23733383034383965', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733383034383965', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1456813116',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1456813116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1456813116',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/IVmu+ou6AKImS9aJb2Ft0KVbP3gB0OaVHt5mmafdPVyf9cptYchOxS6NuE8PB2WxM4HEwmO/OlvgixfNWsQSrKXqYXiW3PRpIGewkVnCkPQ+xM4LpDaUeDyzDEV4ABg==',key_name='tempest-keypair-791550511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-8cx1ed50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:52:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3bd794500243df86a1e4e89414bea0',uuid=dbffcb7f-4576-4250-90a8-cc35f53c1f7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bfd3672-b1e4-43c9-943f-37333169b430", "address": "fa:16:3e:18:5f:ac", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfd3672-b1", "ovs_interfaceid": "5bfd3672-b1e4-43c9-943f-37333169b430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "5bfd3672-b1e4-43c9-943f-37333169b430", "address": "fa:16:3e:18:5f:ac", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfd3672-b1", "ovs_interfaceid": "5bfd3672-b1e4-43c9-943f-37333169b430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:5f:ac,bridge_name='br-int',has_traffic_filtering=True,id=5bfd3672-b1e4-43c9-943f-37333169b430,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfd3672-b1') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG nova.objects.instance [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lazy-loading 'pci_devices' on Instance uuid dbffcb7f-4576-4250-90a8-cc35f53c1f7b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:53:14 user nova-compute[74630]:   <uuid>dbffcb7f-4576-4250-90a8-cc35f53c1f7b</uuid>
Oct 26 03:53:14 user nova-compute[74630]:   <name>instance-0000002b</name>
Oct 26 03:53:14 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:53:14 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:53:14 user nova-compute[74630]:   <metadata>
Oct 26 03:53:14 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:53:14 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:53:14 user nova-compute[74630]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1456813116</nova:name>
Oct 26 03:53:14 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:53:12</nova:creationTime>
Oct 26 03:53:14 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:53:14 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:53:14 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:53:14 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:53:14 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:53:14 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:53:14 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:53:14 user nova-compute[74630]:       <nova:owner>
Oct 26 03:53:14 user nova-compute[74630]:         <nova:user uuid="3b3bd794500243df86a1e4e89414bea0">tempest-TestVolumeBootPattern-1203294393-project-member</nova:user>
Oct 26 03:53:14 user nova-compute[74630]:         <nova:project uuid="4dbe37117ca24935b46795e7f7479af9">tempest-TestVolumeBootPattern-1203294393</nova:project>
Oct 26 03:53:14 user nova-compute[74630]:       </nova:owner>
Oct 26 03:53:14 user nova-compute[74630]:       <nova:ports>
Oct 26 03:53:14 user nova-compute[74630]:         <nova:port uuid="5bfd3672-b1e4-43c9-943f-37333169b430">
Oct 26 03:53:14 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 03:53:14 user nova-compute[74630]:         </nova:port>
Oct 26 03:53:14 user nova-compute[74630]:       </nova:ports>
Oct 26 03:53:14 user nova-compute[74630]:     </nova:instance>
Oct 26 03:53:14 user nova-compute[74630]:   </metadata>
Oct 26 03:53:14 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:53:14 user nova-compute[74630]:     <system>
Oct 26 03:53:14 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:53:14 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:53:14 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:53:14 user nova-compute[74630]:       <entry name="serial">dbffcb7f-4576-4250-90a8-cc35f53c1f7b</entry>
Oct 26 03:53:14 user nova-compute[74630]:       <entry name="uuid">dbffcb7f-4576-4250-90a8-cc35f53c1f7b</entry>
Oct 26 03:53:14 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:53:14 user nova-compute[74630]:     </system>
Oct 26 03:53:14 user nova-compute[74630]:   </sysinfo>
Oct 26 03:53:14 user nova-compute[74630]:   <os>
Oct 26 03:53:14 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:53:14 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:53:14 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:53:14 user nova-compute[74630]:   </os>
Oct 26 03:53:14 user nova-compute[74630]:   <features>
Oct 26 03:53:14 user nova-compute[74630]:     <acpi/>
Oct 26 03:53:14 user nova-compute[74630]:     <apic/>
Oct 26 03:53:14 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:53:14 user nova-compute[74630]:   </features>
Oct 26 03:53:14 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:53:14 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:53:14 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:53:14 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:53:14 user nova-compute[74630]:   </clock>
Oct 26 03:53:14 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:53:14 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:53:14 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:53:14 user nova-compute[74630]:   </cpu>
Oct 26 03:53:14 user nova-compute[74630]:   <devices>
Oct 26 03:53:14 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:53:14 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:53:14 user nova-compute[74630]:       <source dev="/dev/sdb"/>
Oct 26 03:53:14 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:53:14 user nova-compute[74630]:       <serial>c82c3b76-e464-46db-8615-35e5814dc7ac</serial>
Oct 26 03:53:14 user nova-compute[74630]:     </disk>
Oct 26 03:53:14 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:53:14 user nova-compute[74630]:       <mac address="fa:16:3e:18:5f:ac"/>
Oct 26 03:53:14 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:53:14 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:53:14 user nova-compute[74630]:       <target dev="tap5bfd3672-b1"/>
Oct 26 03:53:14 user nova-compute[74630]:     </interface>
Oct 26 03:53:14 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:53:14 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/dbffcb7f-4576-4250-90a8-cc35f53c1f7b/console.log" append="off"/>
Oct 26 03:53:14 user nova-compute[74630]:     </serial>
Oct 26 03:53:14 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:53:14 user nova-compute[74630]:     <video>
Oct 26 03:53:14 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:53:14 user nova-compute[74630]:     </video>
Oct 26 03:53:14 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:53:14 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:53:14 user nova-compute[74630]:     </rng>
Oct 26 03:53:14 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:53:14 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:53:14 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:53:14 user nova-compute[74630]:     </memballoon>
Oct 26 03:53:14 user nova-compute[74630]:   </devices>
Oct 26 03:53:14 user nova-compute[74630]: </domain>
Oct 26 03:53:14 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1456813116',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1456813116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1456813116',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/IVmu+ou6AKImS9aJb2Ft0KVbP3gB0OaVHt5mmafdPVyf9cptYchOxS6NuE8PB2WxM4HEwmO/OlvgixfNWsQSrKXqYXiW3PRpIGewkVnCkPQ+xM4LpDaUeDyzDEV4ABg==',key_name='tempest-keypair-791550511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-8cx1ed50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:52:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3bd794500243df86a1e4e89414bea0',uuid=dbffcb7f-4576-4250-90a8-cc35f53c1f7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bfd3672-b1e4-43c9-943f-37333169b430", "address": "fa:16:3e:18:5f:ac", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfd3672-b1", "ovs_interfaceid": "5bfd3672-b1e4-43c9-943f-37333169b430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "5bfd3672-b1e4-43c9-943f-37333169b430", "address": "fa:16:3e:18:5f:ac", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfd3672-b1", "ovs_interfaceid": "5bfd3672-b1e4-43c9-943f-37333169b430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:5f:ac,bridge_name='br-int',has_traffic_filtering=True,id=5bfd3672-b1e4-43c9-943f-37333169b430,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfd3672-b1') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG os_vif [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:5f:ac,bridge_name='br-int',has_traffic_filtering=True,id=5bfd3672-b1e4-43c9-943f-37333169b430,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfd3672-b1') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '901dfb79-9688-5eea-a4d1-611e213f12a6', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bfd3672-b1, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bfd3672-b1, col_values=(('qos', UUID('bbf70e6f-287c-4c6c-9e07-de269ba617b9')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bfd3672-b1, col_values=(('external_ids', {'iface-id': '5bfd3672-b1e4-43c9-943f-37333169b430', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:5f:ac', 'vm-uuid': 'dbffcb7f-4576-4250-90a8-cc35f53c1f7b'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:14 user nova-compute[74630]: INFO os_vif [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:5f:ac,bridge_name='br-int',has_traffic_filtering=True,id=5bfd3672-b1e4-43c9-943f-37333169b430,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfd3672-b1')
Oct 26 03:53:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:53:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] No VIF found with MAC fa:16:3e:18:5f:ac, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:53:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-0906b024-49df-49d3-8939-e22b7c12baa8 req-1957b5ff-10c5-4875-8faf-8f4bb71cf04d service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Received event network-vif-plugged-5bfd3672-b1e4-43c9-943f-37333169b430 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:53:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0906b024-49df-49d3-8939-e22b7c12baa8 req-1957b5ff-10c5-4875-8faf-8f4bb71cf04d service nova] Acquiring lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0906b024-49df-49d3-8939-e22b7c12baa8 req-1957b5ff-10c5-4875-8faf-8f4bb71cf04d service nova] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0906b024-49df-49d3-8939-e22b7c12baa8 req-1957b5ff-10c5-4875-8faf-8f4bb71cf04d service nova] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-0906b024-49df-49d3-8939-e22b7c12baa8 req-1957b5ff-10c5-4875-8faf-8f4bb71cf04d service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] No waiting events found dispatching network-vif-plugged-5bfd3672-b1e4-43c9-943f-37333169b430 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:53:16 user nova-compute[74630]: WARNING nova.compute.manager [req-0906b024-49df-49d3-8939-e22b7c12baa8 req-1957b5ff-10c5-4875-8faf-8f4bb71cf04d service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Received unexpected event network-vif-plugged-5bfd3672-b1e4-43c9-943f-37333169b430 for instance with vm_state building and task_state spawning.
Oct 26 03:53:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-4f8a2471-9964-44cb-a74f-8c1d568dced1 req-59b43e32-9c70-4698-b70b-b3af6cfc63c8 service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Received event network-vif-plugged-5bfd3672-b1e4-43c9-943f-37333169b430 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:53:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4f8a2471-9964-44cb-a74f-8c1d568dced1 req-59b43e32-9c70-4698-b70b-b3af6cfc63c8 service nova] Acquiring lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4f8a2471-9964-44cb-a74f-8c1d568dced1 req-59b43e32-9c70-4698-b70b-b3af6cfc63c8 service nova] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4f8a2471-9964-44cb-a74f-8c1d568dced1 req-59b43e32-9c70-4698-b70b-b3af6cfc63c8 service nova] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-4f8a2471-9964-44cb-a74f-8c1d568dced1 req-59b43e32-9c70-4698-b70b-b3af6cfc63c8 service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] No waiting events found dispatching network-vif-plugged-5bfd3672-b1e4-43c9-943f-37333169b430 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:53:18 user nova-compute[74630]: WARNING nova.compute.manager [req-4f8a2471-9964-44cb-a74f-8c1d568dced1 req-59b43e32-9c70-4698-b70b-b3af6cfc63c8 service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Received unexpected event network-vif-plugged-5bfd3672-b1e4-43c9-943f-37333169b430 for instance with vm_state building and task_state spawning.
Oct 26 03:53:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:53:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:53:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Instance spawned successfully.
Oct 26 03:53:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:53:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:53:18 user nova-compute[74630]: INFO nova.compute.manager [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Took 5.49 seconds to spawn the instance on the hypervisor.
Oct 26 03:53:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:53:18 user nova-compute[74630]: INFO nova.compute.manager [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Took 25.57 seconds to build instance.
Oct 26 03:53:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7030acb9-0bcd-47e7-b955-347088e44522 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.676s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:33 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:53:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:44 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:53:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:46 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:53:46 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:53:46 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:53:47 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:53:47 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:53:47 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:53:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-dbffcb7f-4576-4250-90a8-cc35f53c1f7b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:53:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-dbffcb7f-4576-4250-90a8-cc35f53c1f7b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:53:47 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:53:47 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid dbffcb7f-4576-4250-90a8-cc35f53c1f7b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:53:47 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Updating instance_info_cache with network_info: [{"id": "5bfd3672-b1e4-43c9-943f-37333169b430", "address": "fa:16:3e:18:5f:ac", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfd3672-b1", "ovs_interfaceid": "5bfd3672-b1e4-43c9-943f-37333169b430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:53:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-dbffcb7f-4576-4250-90a8-cc35f53c1f7b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:53:47 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:53:47 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:53:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:53:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:53:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:53:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:51 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:53:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:53:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:53:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:53:52 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:53:52 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:53:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8453MB free_disk=24.954994201660156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:53:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:53:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:53:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance dbffcb7f-4576-4250-90a8-cc35f53c1f7b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:53:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 18ccafbd-d620-4c00-8cbe-0e48006238cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:53:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 049abd73-381a-41d4-b0f8-134d1e7831c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:53:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:53:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:53:52 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:53:52 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:53:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:53:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:53:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:53:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:53:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:53:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:53:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:53:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:53:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:53:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:53:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:53:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:54:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:54:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:54:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:54:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:54:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:54:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:54:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:54:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:54:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:54:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:54:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:54:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:54:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:54:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:54:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:54:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:54:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:54:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-13be667b-bf1b-4a92-b4de-428ca3271378 req-39eeab7c-4655-48ac-b898-050c4ff1182e service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Received event network-changed-5bfd3672-b1e4-43c9-943f-37333169b430 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:54:43 user nova-compute[74630]: DEBUG nova.compute.manager [req-13be667b-bf1b-4a92-b4de-428ca3271378 req-39eeab7c-4655-48ac-b898-050c4ff1182e service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Refreshing instance network info cache due to event network-changed-5bfd3672-b1e4-43c9-943f-37333169b430. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:54:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-13be667b-bf1b-4a92-b4de-428ca3271378 req-39eeab7c-4655-48ac-b898-050c4ff1182e service nova] Acquiring lock "refresh_cache-dbffcb7f-4576-4250-90a8-cc35f53c1f7b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:54:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-13be667b-bf1b-4a92-b4de-428ca3271378 req-39eeab7c-4655-48ac-b898-050c4ff1182e service nova] Acquired lock "refresh_cache-dbffcb7f-4576-4250-90a8-cc35f53c1f7b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:54:43 user nova-compute[74630]: DEBUG nova.network.neutron [req-13be667b-bf1b-4a92-b4de-428ca3271378 req-39eeab7c-4655-48ac-b898-050c4ff1182e service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Refreshing network info cache for port 5bfd3672-b1e4-43c9-943f-37333169b430 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:54:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:44 user nova-compute[74630]: DEBUG nova.network.neutron [req-13be667b-bf1b-4a92-b4de-428ca3271378 req-39eeab7c-4655-48ac-b898-050c4ff1182e service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Updated VIF entry in instance network info cache for port 5bfd3672-b1e4-43c9-943f-37333169b430. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:54:44 user nova-compute[74630]: DEBUG nova.network.neutron [req-13be667b-bf1b-4a92-b4de-428ca3271378 req-39eeab7c-4655-48ac-b898-050c4ff1182e service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Updating instance_info_cache with network_info: [{"id": "5bfd3672-b1e4-43c9-943f-37333169b430", "address": "fa:16:3e:18:5f:ac", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfd3672-b1", "ovs_interfaceid": "5bfd3672-b1e4-43c9-943f-37333169b430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:54:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-13be667b-bf1b-4a92-b4de-428ca3271378 req-39eeab7c-4655-48ac-b898-050c4ff1182e service nova] Releasing lock "refresh_cache-dbffcb7f-4576-4250-90a8-cc35f53c1f7b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:54:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:45 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:54:46 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:54:47 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:54:47 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:54:47 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:54:47 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:54:48 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:54:48 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:54:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-18ccafbd-d620-4c00-8cbe-0e48006238cc" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:54:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-18ccafbd-d620-4c00-8cbe-0e48006238cc" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:54:48 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:54:48 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Updating instance_info_cache with network_info: [{"id": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "address": "fa:16:3e:25:f4:45", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c791217-e4", "ovs_interfaceid": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:54:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-18ccafbd-d620-4c00-8cbe-0e48006238cc" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:54:48 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:54:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-564aeb44-83ab-4cc3-ac19-03d566867fb7 req-f2c15e85-b3e8-47a0-bc86-a13894577f6c service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received event network-changed-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:54:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-564aeb44-83ab-4cc3-ac19-03d566867fb7 req-f2c15e85-b3e8-47a0-bc86-a13894577f6c service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Refreshing instance network info cache due to event network-changed-4c791217-e407-4a3c-9de2-f4cdccc586ee. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:54:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-564aeb44-83ab-4cc3-ac19-03d566867fb7 req-f2c15e85-b3e8-47a0-bc86-a13894577f6c service nova] Acquiring lock "refresh_cache-18ccafbd-d620-4c00-8cbe-0e48006238cc" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:54:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-564aeb44-83ab-4cc3-ac19-03d566867fb7 req-f2c15e85-b3e8-47a0-bc86-a13894577f6c service nova] Acquired lock "refresh_cache-18ccafbd-d620-4c00-8cbe-0e48006238cc" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:54:50 user nova-compute[74630]: DEBUG nova.network.neutron [req-564aeb44-83ab-4cc3-ac19-03d566867fb7 req-f2c15e85-b3e8-47a0-bc86-a13894577f6c service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Refreshing network info cache for port 4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:54:50 user nova-compute[74630]: DEBUG nova.network.neutron [req-564aeb44-83ab-4cc3-ac19-03d566867fb7 req-f2c15e85-b3e8-47a0-bc86-a13894577f6c service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Updated VIF entry in instance network info cache for port 4c791217-e407-4a3c-9de2-f4cdccc586ee. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:54:50 user nova-compute[74630]: DEBUG nova.network.neutron [req-564aeb44-83ab-4cc3-ac19-03d566867fb7 req-f2c15e85-b3e8-47a0-bc86-a13894577f6c service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Updating instance_info_cache with network_info: [{"id": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "address": "fa:16:3e:25:f4:45", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c791217-e4", "ovs_interfaceid": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:54:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-564aeb44-83ab-4cc3-ac19-03d566867fb7 req-f2c15e85-b3e8-47a0-bc86-a13894577f6c service nova] Releasing lock "refresh_cache-18ccafbd-d620-4c00-8cbe-0e48006238cc" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:54:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:54:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:54:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:54:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:54:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:54:51 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:54:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:54:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:54:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:54:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:54:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:54:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:54:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:54:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:54:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:54:52 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:54:52 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:54:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8709MB free_disk=24.953475952148438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:54:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:54:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:54:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance dbffcb7f-4576-4250-90a8-cc35f53c1f7b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:54:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 18ccafbd-d620-4c00-8cbe-0e48006238cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:54:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 049abd73-381a-41d4-b0f8-134d1e7831c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:54:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:54:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:54:52 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:54:52 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:54:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:54:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:54:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:54 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG nova.objects.instance [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'flavor' on Instance uuid 18ccafbd-d620-4c00-8cbe-0e48006238cc {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:54:56 user nova-compute[74630]: INFO nova.compute.manager [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Attaching volume 6b73cedf-23ef-4a87-9c32-6616335fd512 to /dev/vdb
Oct 26 03:54:56 user nova-compute[74630]: DEBUG os_brick.utils [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f071555c-a7c6-46c2-ad55-0afa99a76bac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef085c3-a012-427f-9d02-b441b457c090]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38111cb-ff7d-4add-8b05-2376e06922a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8ede86-01a5-45d4-84cf-e0fbc8d85426]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:54:56 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[de02f23d-826e-4fe1-82af-ef348a3e2919]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG os_brick.utils [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Updating existing volume attachment record: 0f9662e5-2fea-470a-899e-ecb55a3f2f6e {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:54:56 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:54:56 user nova-compute[74630]: INFO nova.compute.claims [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Claim successful on node user
Oct 26 03:54:57 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:54:57 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:54:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:54:57 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:54:57 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:54:57 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:54:57 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:54:57 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:54:57 user nova-compute[74630]: INFO nova.virt.block_device [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Booting with volume snapshot fcb2f6d9-ac9a-4e6f-b075-db91cc569461 at /dev/vda
Oct 26 03:54:57 user nova-compute[74630]: DEBUG nova.policy [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b3bd794500243df86a1e4e89414bea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbe37117ca24935b46795e7f7479af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Successfully created port: d520bfbe-3f95-4646-9d13-e2f6813c294d {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG nova.objects.instance [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lazy-loading 'flavor' on Instance uuid 049abd73-381a-41d4-b0f8-134d1e7831c6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:54:58 user nova-compute[74630]: INFO nova.compute.manager [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Attaching volume 03f68da1-0968-43d0-b2ad-4266e446cbde to /dev/vdb
Oct 26 03:54:58 user nova-compute[74630]: DEBUG os_brick.utils [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01325ac-0494-4daa-84d1-542e1eebfc81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2477e9e1-623e-49a6-bbe8-57ca34c0b8db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efc93d0-e1da-4a00-8150-bdc908d3ec33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[15223ae3-5b1f-4f30-9be8-be2c4a28759b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:54:58 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc973d7-ee8c-4d92-a079-48495ce422df]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG os_brick.utils [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updating existing volume attachment record: 9f5af766-8931-458d-969f-2eb0ee56e233 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Successfully updated port: d520bfbe-3f95-4646-9d13-e2f6813c294d {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "refresh_cache-f9916c77-4e65-4922-b3a1-1fdc3f7c475e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquired lock "refresh_cache-f9916c77-4e65-4922-b3a1-1fdc3f7c475e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-575829e8-35d8-443e-962d-7763fd8c4527 req-a137fd52-af74-479c-8cb9-303ad8ed39a8 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Received event network-changed-d520bfbe-3f95-4646-9d13-e2f6813c294d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-575829e8-35d8-443e-962d-7763fd8c4527 req-a137fd52-af74-479c-8cb9-303ad8ed39a8 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Refreshing instance network info cache due to event network-changed-d520bfbe-3f95-4646-9d13-e2f6813c294d. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-575829e8-35d8-443e-962d-7763fd8c4527 req-a137fd52-af74-479c-8cb9-303ad8ed39a8 service nova] Acquiring lock "refresh_cache-f9916c77-4e65-4922-b3a1-1fdc3f7c475e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:54:58 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:54:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:59 user nova-compute[74630]: DEBUG nova.network.neutron [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Updating instance_info_cache with network_info: [{"id": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "address": "fa:16:3e:32:41:3a", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd520bfbe-3f", "ovs_interfaceid": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:54:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Releasing lock "refresh_cache-f9916c77-4e65-4922-b3a1-1fdc3f7c475e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:54:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Instance network_info: |[{"id": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "address": "fa:16:3e:32:41:3a", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd520bfbe-3f", "ovs_interfaceid": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:54:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-575829e8-35d8-443e-962d-7763fd8c4527 req-a137fd52-af74-479c-8cb9-303ad8ed39a8 service nova] Acquired lock "refresh_cache-f9916c77-4e65-4922-b3a1-1fdc3f7c475e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:54:59 user nova-compute[74630]: DEBUG nova.network.neutron [req-575829e8-35d8-443e-962d-7763fd8c4527 req-a137fd52-af74-479c-8cb9-303ad8ed39a8 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Refreshing network info cache for port d520bfbe-3f95-4646-9d13-e2f6813c294d {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:54:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:54:59 user nova-compute[74630]: DEBUG nova.network.neutron [req-575829e8-35d8-443e-962d-7763fd8c4527 req-a137fd52-af74-479c-8cb9-303ad8ed39a8 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Updated VIF entry in instance network info cache for port d520bfbe-3f95-4646-9d13-e2f6813c294d. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:54:59 user nova-compute[74630]: DEBUG nova.network.neutron [req-575829e8-35d8-443e-962d-7763fd8c4527 req-a137fd52-af74-479c-8cb9-303ad8ed39a8 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Updating instance_info_cache with network_info: [{"id": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "address": "fa:16:3e:32:41:3a", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd520bfbe-3f", "ovs_interfaceid": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:54:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-575829e8-35d8-443e-962d-7763fd8c4527 req-a137fd52-af74-479c-8cb9-303ad8ed39a8 service nova] Releasing lock "refresh_cache-f9916c77-4e65-4922-b3a1-1fdc3f7c475e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG os_brick.utils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad67cb9-a54f-49bd-a6ef-17c39293d818]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[200df01b-7c80-4f8b-a4c8-4dd715e2a70c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0735af-d749-429f-a74b-ddeea2da594d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[828754ba-d73a-43a7-87ec-738d6f13ab40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:55:03 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:55:03 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[76685849-4e1b-4bb5-af93-c2e3c449a07f]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG os_brick.utils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:55:03 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Updating existing volume attachment record: 7578341e-d920-4cc6-96de-1583d2446c74 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:55:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:55:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:55:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:55:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:55:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smlIhNeg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:55:14 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:55:14 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:55:14 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[53974024-e36d-4a82-ac1d-949164e39965]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:55:14 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c51bd04-81a5-4e6e-a2f5-faf70fdd31ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512] added
Oct 26 03:55:14 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b94b0f0-13eb-4037-a155-9ed27573920a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f11c3d2-aec6-45c4-88bd-7fc329fc4758]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smlIhNeg {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smlIhNeg" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0affac01-a92d-4e92-bf91-db2f784e02bd]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'smlIhNeg'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f9605c-535e-4081-9f7c-71f7f24b2412]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e4e9af-0ec2-4be8-b5e7-f6ac06e3c049]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:14 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:14 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe886b6b-983e-4afa-935c-aa5246ed9c56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512, portal: 172.16.0.220,3260]
Oct 26 03:55:14 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512, portal: 172.16.0.220,3260] successful.
Oct 26 03:55:14 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b442d3-1499-40ed-ac75-dc1250f7b6ff]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87baab6-0ce6-4d4e-a13a-15c05bdf44b4]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:14 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:14 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:14 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:14 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[08862cf6-5d12-45ed-9eab-316c840c64a7]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:55:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smlIhNeg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:55:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:55:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26666316161326134', 'path': '/dev/sdc'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:55:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666316161326134', 'path': '/dev/sdc'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:55:15 user nova-compute[74630]: DEBUG nova.objects.instance [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'flavor' on Instance uuid 18ccafbd-d620-4c00-8cbe-0e48006238cc {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:55:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:55:15 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:55:15 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:55:15 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:55:15 user nova-compute[74630]:   <serial>6b73cedf-23ef-4a87-9c32-6616335fd512</serial>
Oct 26 03:55:15 user nova-compute[74630]: </disk>
Oct 26 03:55:15 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] No VIF found with MAC fa:16:3e:25:f4:45, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-56fde407-24f6-40d6-adc5-0f7cea312aa5 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.247s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muTPnNhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:55:16 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:55:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:55:16 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:55:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:55:16 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:55:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7e21de-6c65-4db6-aa0a-d4c26cbf4852]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:55:16 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f3fbbd-d0c8-46c4-83ec-4847a568c87a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde] added
Oct 26 03:55:16 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[77980932-a8f8-477d-a487-da41d39645ad]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c25227-87fd-4513-b840-45816ac41837]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muTPnNhf {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muTPnNhf" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79a5d65-76d3-4942-bfd3-e60b476fb534]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'muTPnNhf'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d368c960-2e4d-4f28-8988-bbcf91ac2be8]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e536db-e8d0-45ea-a491-5190f82d6fe2]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:17 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:17 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:17 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:17 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0485089-d6f3-47c9-b071-09c1dcf5966c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260]
Oct 26 03:55:17 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260] successful.
Oct 26 03:55:17 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7636df8a-51fc-4859-a83e-aa5dda7dff25]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[64625990-0fcf-4861-98b6-2cec6ffde0c3]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:17 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:17 user nova-compute[74630]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:55:17 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:17 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:17 user nova-compute[74630]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:55:17 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[193b79c0-231f-4086-b55f-b5fd13d91abf]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:55:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muTPnNhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:55:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:55:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26438643765646637', 'path': '/dev/sdd'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:55:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438643765646637', 'path': '/dev/sdd'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:55:18 user nova-compute[74630]: DEBUG nova.objects.instance [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lazy-loading 'flavor' on Instance uuid 049abd73-381a-41d4-b0f8-134d1e7831c6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:55:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:55:18 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:55:18 user nova-compute[74630]:   <source dev="/dev/sdd"/>
Oct 26 03:55:18 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:55:18 user nova-compute[74630]:   <serial>03f68da1-0968-43d0-b2ad-4266e446cbde</serial>
Oct 26 03:55:18 user nova-compute[74630]: </disk>
Oct 26 03:55:18 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:55:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:55:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:55:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] No VIF found with MAC fa:16:3e:3b:69:2f, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:55:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-62e51464-ea20-44c7-bff0-05ed8588f6a0 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.264s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:55:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:55:21 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Creating image(s)
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Ensure instance console log exists: /opt/stack/data/nova/instances/f9916c77-4e65-4922-b3a1-1fdc3f7c475e/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Start _get_guest_xml network_info=[{"id": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "address": "fa:16:3e:32:41:3a", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd520bfbe-3f", "ovs_interfaceid": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-26T03:54:45Z,direct_url=<?>,disk_format='qcow2',id=2af0c345-7181-4a99-930a-7c1779eabd24,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-519144559',owner='4dbe37117ca24935b46795e7f7479af9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-26T03:54:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuzdNstG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f9916c77-4e65-4922-b3a1-1fdc3f7c475e', 'attached_at': '', 'detached_at': '', 'volume_id': '324e6614-0fd0-441c-b09f-8ea83d377e12', 'serial': '324e6614-0fd0-441c-b09f-8ea83d377e12'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': '7578341e-d920-4cc6-96de-1583d2446c74', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:55:21 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:55:21 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-26T03:54:45Z,direct_url=<?>,disk_format='qcow2',id=2af0c345-7181-4a99-930a-7c1779eabd24,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-519144559',owner='4dbe37117ca24935b46795e7f7479af9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-26T03:54:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuzdNstG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:55:21 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:55:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:55:21 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:55:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:55:21 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[391e3a72-98c2-4821-a7f5-d8d846709a3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:55:21 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[836c67a3-a74d-4f8c-8d10-dc89480383e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12] added
Oct 26 03:55:21 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e54c171-0632-4e2f-8c3c-5f202bdf006a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c814fd4a-7ace-4dd4-aa16-70f53b363b05]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:21 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuzdNstG {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuzdNstG" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[506ab56f-b520-4abf-aa9d-4fd7a99d5da7]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LuzdNstG'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb70fae-e224-489b-8cb3-402c2cab93fd]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2427c9e3-75c4-4876-ae2e-525d3acad0e6]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:22 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:22 user nova-compute[74630]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:55:22 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:22 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:22 user nova-compute[74630]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:55:22 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[75289297-a7cc-449d-8599-881f5ac3271c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12, portal: 172.16.0.220,3260]
Oct 26 03:55:22 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12, portal: 172.16.0.220,3260] successful.
Oct 26 03:55:22 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e4a367-232d-480f-98a1-a461e8ddd458]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4add316b-209f-46a5-8cc0-12e6234d5a5c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:22 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:22 user nova-compute[74630]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:55:22 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:55:22 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:22 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:22 user nova-compute[74630]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:55:22 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:55:22 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[232c72c8-9758-4846-a653-092f8ce5eb65]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuzdNstG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'flavor' on Instance uuid 18ccafbd-d620-4c00-8cbe-0e48006238cc {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:55:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:55:22 user nova-compute[74630]: INFO nova.compute.manager [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Attaching volume 90b10f71-5dc9-40b5-ac2f-33fb35847273 to /dev/vdc
Oct 26 03:55:23 user nova-compute[74630]: DEBUG os_brick.utils [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[031518fd-40e0-45bd-8778-7c54d91d1e93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[42db1c88-0e66-46ec-9cb9-582b6033b747]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9d8b5a-4333-48a6-8f95-c3342da65d6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70f5108-44dc-452e-b73d-c08ee8ed1a87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:55:23 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:55:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f84bea3-cc27-42d1-929b-d75a02d15449]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG os_brick.utils [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Updating existing volume attachment record: d331eff7-a06d-4f30-9141-5c3104235142 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26335346134646238', 'path': '/dev/sde'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335346134646238', 'path': '/dev/sde'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:54:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-152729192',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-152729192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-152729192',id=46,image_ref='2af0c345-7181-4a99-930a-7c1779eabd24',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtZD2D+o/pXiyIN+P4MY4FdrkV2AhXDKKVp4WwrlREDJFlLD+MtLTbOey5ObryFIGF3fZ1bM6+p+jumfHADxlL9A9zzqzhW3GBPQkc+NFES7lpqFSrTcd3GV58Ad5hdkg==',key_name='tempest-keypair-1146610389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-ub32s3ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1203294393',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:54:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3bd794500243df86a1e4e89414bea0',uuid=f9916c77-4e65-4922-b3a1-1fdc3f7c475e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "address": "fa:16:3e:32:41:3a", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd520bfbe-3f", "ovs_interfaceid": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "address": "fa:16:3e:32:41:3a", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd520bfbe-3f", "ovs_interfaceid": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:41:3a,bridge_name='br-int',has_traffic_filtering=True,id=d520bfbe-3f95-4646-9d13-e2f6813c294d,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd520bfbe-3f') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lazy-loading 'pci_devices' on Instance uuid f9916c77-4e65-4922-b3a1-1fdc3f7c475e {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:55:23 user nova-compute[74630]:   <uuid>f9916c77-4e65-4922-b3a1-1fdc3f7c475e</uuid>
Oct 26 03:55:23 user nova-compute[74630]:   <name>instance-0000002e</name>
Oct 26 03:55:23 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:55:23 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:55:23 user nova-compute[74630]:   <metadata>
Oct 26 03:55:23 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:55:23 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:55:23 user nova-compute[74630]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-152729192</nova:name>
Oct 26 03:55:23 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:55:21</nova:creationTime>
Oct 26 03:55:23 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:55:23 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:55:23 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:55:23 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:55:23 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:55:23 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:55:23 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:55:23 user nova-compute[74630]:       <nova:owner>
Oct 26 03:55:23 user nova-compute[74630]:         <nova:user uuid="3b3bd794500243df86a1e4e89414bea0">tempest-TestVolumeBootPattern-1203294393-project-member</nova:user>
Oct 26 03:55:23 user nova-compute[74630]:         <nova:project uuid="4dbe37117ca24935b46795e7f7479af9">tempest-TestVolumeBootPattern-1203294393</nova:project>
Oct 26 03:55:23 user nova-compute[74630]:       </nova:owner>
Oct 26 03:55:23 user nova-compute[74630]:       <nova:root type="image" uuid="2af0c345-7181-4a99-930a-7c1779eabd24"/>
Oct 26 03:55:23 user nova-compute[74630]:       <nova:ports>
Oct 26 03:55:23 user nova-compute[74630]:         <nova:port uuid="d520bfbe-3f95-4646-9d13-e2f6813c294d">
Oct 26 03:55:23 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 03:55:23 user nova-compute[74630]:         </nova:port>
Oct 26 03:55:23 user nova-compute[74630]:       </nova:ports>
Oct 26 03:55:23 user nova-compute[74630]:     </nova:instance>
Oct 26 03:55:23 user nova-compute[74630]:   </metadata>
Oct 26 03:55:23 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:55:23 user nova-compute[74630]:     <system>
Oct 26 03:55:23 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:55:23 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:55:23 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:55:23 user nova-compute[74630]:       <entry name="serial">f9916c77-4e65-4922-b3a1-1fdc3f7c475e</entry>
Oct 26 03:55:23 user nova-compute[74630]:       <entry name="uuid">f9916c77-4e65-4922-b3a1-1fdc3f7c475e</entry>
Oct 26 03:55:23 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:55:23 user nova-compute[74630]:     </system>
Oct 26 03:55:23 user nova-compute[74630]:   </sysinfo>
Oct 26 03:55:23 user nova-compute[74630]:   <os>
Oct 26 03:55:23 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:55:23 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:55:23 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:55:23 user nova-compute[74630]:   </os>
Oct 26 03:55:23 user nova-compute[74630]:   <features>
Oct 26 03:55:23 user nova-compute[74630]:     <acpi/>
Oct 26 03:55:23 user nova-compute[74630]:     <apic/>
Oct 26 03:55:23 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:55:23 user nova-compute[74630]:   </features>
Oct 26 03:55:23 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:55:23 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:55:23 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:55:23 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:55:23 user nova-compute[74630]:   </clock>
Oct 26 03:55:23 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:55:23 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:55:23 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:55:23 user nova-compute[74630]:   </cpu>
Oct 26 03:55:23 user nova-compute[74630]:   <devices>
Oct 26 03:55:23 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:55:23 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:55:23 user nova-compute[74630]:       <source dev="/dev/sde"/>
Oct 26 03:55:23 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:55:23 user nova-compute[74630]:       <serial>324e6614-0fd0-441c-b09f-8ea83d377e12</serial>
Oct 26 03:55:23 user nova-compute[74630]:     </disk>
Oct 26 03:55:23 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:55:23 user nova-compute[74630]:       <mac address="fa:16:3e:32:41:3a"/>
Oct 26 03:55:23 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:55:23 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:55:23 user nova-compute[74630]:       <target dev="tapd520bfbe-3f"/>
Oct 26 03:55:23 user nova-compute[74630]:     </interface>
Oct 26 03:55:23 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:55:23 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/f9916c77-4e65-4922-b3a1-1fdc3f7c475e/console.log" append="off"/>
Oct 26 03:55:23 user nova-compute[74630]:     </serial>
Oct 26 03:55:23 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:55:23 user nova-compute[74630]:     <video>
Oct 26 03:55:23 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:55:23 user nova-compute[74630]:     </video>
Oct 26 03:55:23 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:55:23 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:55:23 user nova-compute[74630]:     </rng>
Oct 26 03:55:23 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:55:23 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:55:23 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:55:23 user nova-compute[74630]:     </memballoon>
Oct 26 03:55:23 user nova-compute[74630]:   </devices>
Oct 26 03:55:23 user nova-compute[74630]: </domain>
Oct 26 03:55:23 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:54:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-152729192',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-152729192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-152729192',id=46,image_ref='2af0c345-7181-4a99-930a-7c1779eabd24',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtZD2D+o/pXiyIN+P4MY4FdrkV2AhXDKKVp4WwrlREDJFlLD+MtLTbOey5ObryFIGF3fZ1bM6+p+jumfHADxlL9A9zzqzhW3GBPQkc+NFES7lpqFSrTcd3GV58Ad5hdkg==',key_name='tempest-keypair-1146610389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-ub32s3ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1203294393',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:54:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3bd794500243df86a1e4e89414bea0',uuid=f9916c77-4e65-4922-b3a1-1fdc3f7c475e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "address": "fa:16:3e:32:41:3a", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd520bfbe-3f", "ovs_interfaceid": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "address": "fa:16:3e:32:41:3a", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd520bfbe-3f", "ovs_interfaceid": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:41:3a,bridge_name='br-int',has_traffic_filtering=True,id=d520bfbe-3f95-4646-9d13-e2f6813c294d,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd520bfbe-3f') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG os_vif [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:41:3a,bridge_name='br-int',has_traffic_filtering=True,id=d520bfbe-3f95-4646-9d13-e2f6813c294d,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd520bfbe-3f') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f382afc-fc10-5d08-bf52-705dc3d0ca83', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd520bfbe-3f, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd520bfbe-3f, col_values=(('qos', UUID('4998a2d1-27d3-4596-816a-d13efc2fc00d')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd520bfbe-3f, col_values=(('external_ids', {'iface-id': 'd520bfbe-3f95-4646-9d13-e2f6813c294d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:41:3a', 'vm-uuid': 'f9916c77-4e65-4922-b3a1-1fdc3f7c475e'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:55:23 user nova-compute[74630]: INFO os_vif [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:41:3a,bridge_name='br-int',has_traffic_filtering=True,id=d520bfbe-3f95-4646-9d13-e2f6813c294d,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd520bfbe-3f')
Oct 26 03:55:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:55:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] No VIF found with MAC fa:16:3e:32:41:3a, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:55:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:24 user nova-compute[74630]: DEBUG nova.compute.manager [req-81239ece-ffb8-4a5d-93d5-715f09d9361f req-37a39e67-2ebf-496f-a2ac-02a74e556cc4 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Received event network-vif-plugged-d520bfbe-3f95-4646-9d13-e2f6813c294d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:55:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-81239ece-ffb8-4a5d-93d5-715f09d9361f req-37a39e67-2ebf-496f-a2ac-02a74e556cc4 service nova] Acquiring lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:55:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-81239ece-ffb8-4a5d-93d5-715f09d9361f req-37a39e67-2ebf-496f-a2ac-02a74e556cc4 service nova] Lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:55:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-81239ece-ffb8-4a5d-93d5-715f09d9361f req-37a39e67-2ebf-496f-a2ac-02a74e556cc4 service nova] Lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:55:24 user nova-compute[74630]: DEBUG nova.compute.manager [req-81239ece-ffb8-4a5d-93d5-715f09d9361f req-37a39e67-2ebf-496f-a2ac-02a74e556cc4 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] No waiting events found dispatching network-vif-plugged-d520bfbe-3f95-4646-9d13-e2f6813c294d {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:55:24 user nova-compute[74630]: WARNING nova.compute.manager [req-81239ece-ffb8-4a5d-93d5-715f09d9361f req-37a39e67-2ebf-496f-a2ac-02a74e556cc4 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Received unexpected event network-vif-plugged-d520bfbe-3f95-4646-9d13-e2f6813c294d for instance with vm_state building and task_state spawning.
Oct 26 03:55:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:26 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:55:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:55:26 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Instance spawned successfully.
Oct 26 03:55:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:55:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:55:26 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:55:26 user nova-compute[74630]: INFO nova.compute.manager [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Took 5.00 seconds to spawn the instance on the hypervisor.
Oct 26 03:55:26 user nova-compute[74630]: DEBUG nova.compute.manager [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:55:26 user nova-compute[74630]: DEBUG nova.compute.manager [req-dc0cd86c-850a-4d29-bb35-62c598a8977a req-df1b3476-fb15-485e-a015-a5f5467cae76 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Received event network-vif-plugged-d520bfbe-3f95-4646-9d13-e2f6813c294d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:55:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dc0cd86c-850a-4d29-bb35-62c598a8977a req-df1b3476-fb15-485e-a015-a5f5467cae76 service nova] Acquiring lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:55:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dc0cd86c-850a-4d29-bb35-62c598a8977a req-df1b3476-fb15-485e-a015-a5f5467cae76 service nova] Lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:55:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dc0cd86c-850a-4d29-bb35-62c598a8977a req-df1b3476-fb15-485e-a015-a5f5467cae76 service nova] Lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:55:26 user nova-compute[74630]: DEBUG nova.compute.manager [req-dc0cd86c-850a-4d29-bb35-62c598a8977a req-df1b3476-fb15-485e-a015-a5f5467cae76 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] No waiting events found dispatching network-vif-plugged-d520bfbe-3f95-4646-9d13-e2f6813c294d {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:55:26 user nova-compute[74630]: WARNING nova.compute.manager [req-dc0cd86c-850a-4d29-bb35-62c598a8977a req-df1b3476-fb15-485e-a015-a5f5467cae76 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Received unexpected event network-vif-plugged-d520bfbe-3f95-4646-9d13-e2f6813c294d for instance with vm_state building and task_state spawning.
Oct 26 03:55:26 user nova-compute[74630]: INFO nova.compute.manager [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Took 30.05 seconds to build instance.
Oct 26 03:55:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b26ead38-c218-4b39-a70d-c42a2d8a04f5 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.150s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:55:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-8f948029-7e5c-4cf4-9eab-85ff3de8287b req-fe66c8a2-169d-4d19-a68c-fdf64dc5c34d service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received event network-changed-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:55:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-8f948029-7e5c-4cf4-9eab-85ff3de8287b req-fe66c8a2-169d-4d19-a68c-fdf64dc5c34d service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Refreshing instance network info cache due to event network-changed-b3a6726e-9121-438a-932f-0b702074e093. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:55:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8f948029-7e5c-4cf4-9eab-85ff3de8287b req-fe66c8a2-169d-4d19-a68c-fdf64dc5c34d service nova] Acquiring lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:55:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8f948029-7e5c-4cf4-9eab-85ff3de8287b req-fe66c8a2-169d-4d19-a68c-fdf64dc5c34d service nova] Acquired lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:55:31 user nova-compute[74630]: DEBUG nova.network.neutron [req-8f948029-7e5c-4cf4-9eab-85ff3de8287b req-fe66c8a2-169d-4d19-a68c-fdf64dc5c34d service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Refreshing network info cache for port b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:55:32 user nova-compute[74630]: DEBUG nova.network.neutron [req-8f948029-7e5c-4cf4-9eab-85ff3de8287b req-fe66c8a2-169d-4d19-a68c-fdf64dc5c34d service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updated VIF entry in instance network info cache for port b3a6726e-9121-438a-932f-0b702074e093. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:55:32 user nova-compute[74630]: DEBUG nova.network.neutron [req-8f948029-7e5c-4cf4-9eab-85ff3de8287b req-fe66c8a2-169d-4d19-a68c-fdf64dc5c34d service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updating instance_info_cache with network_info: [{"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:55:32 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8f948029-7e5c-4cf4-9eab-85ff3de8287b req-fe66c8a2-169d-4d19-a68c-fdf64dc5c34d service nova] Releasing lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:55:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-31288539-dfdd-44f9-871a-bd3daa5b87af req-f588c2e2-8d83-4c80-9178-03a271d59e4a service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received event network-changed-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:55:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-31288539-dfdd-44f9-871a-bd3daa5b87af req-f588c2e2-8d83-4c80-9178-03a271d59e4a service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Refreshing instance network info cache due to event network-changed-b3a6726e-9121-438a-932f-0b702074e093. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:55:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-31288539-dfdd-44f9-871a-bd3daa5b87af req-f588c2e2-8d83-4c80-9178-03a271d59e4a service nova] Acquiring lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:55:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-31288539-dfdd-44f9-871a-bd3daa5b87af req-f588c2e2-8d83-4c80-9178-03a271d59e4a service nova] Acquired lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:55:34 user nova-compute[74630]: DEBUG nova.network.neutron [req-31288539-dfdd-44f9-871a-bd3daa5b87af req-f588c2e2-8d83-4c80-9178-03a271d59e4a service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Refreshing network info cache for port b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:55:35 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:55:35 user nova-compute[74630]: DEBUG nova.network.neutron [req-31288539-dfdd-44f9-871a-bd3daa5b87af req-f588c2e2-8d83-4c80-9178-03a271d59e4a service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updated VIF entry in instance network info cache for port b3a6726e-9121-438a-932f-0b702074e093. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:55:35 user nova-compute[74630]: DEBUG nova.network.neutron [req-31288539-dfdd-44f9-871a-bd3daa5b87af req-f588c2e2-8d83-4c80-9178-03a271d59e4a service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updating instance_info_cache with network_info: [{"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:55:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-31288539-dfdd-44f9-871a-bd3daa5b87af req-f588c2e2-8d83-4c80-9178-03a271d59e4a service nova] Releasing lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:55:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVgnQtvs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:55:42 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:55:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:55:42 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:55:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:55:42 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea1f28c-5205-4847-a340-f26d5e7e873e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:55:42 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61ebc2e-a214-4206-a3a6-360adaebf08b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273] added
Oct 26 03:55:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c716f67b-05aa-4e72-803f-d589b239b6a9]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a35773-61ef-4d44-8d34-7f0accbe57ac]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UVgnQtvs {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UVgnQtvs" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[066bd4a1-e494-4af9-bec2-25b4c36e3b3d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UVgnQtvs'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e4c6b7-6c66-4825-8600-2f90e07aaaaa]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afb2cdf-8fc1-4b6c-9204-0437180bcf5d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:43 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:43 user nova-compute[74630]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:55:43 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:55:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:43 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:43 user nova-compute[74630]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:55:43 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:55:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc57dbd2-06ef-4ff8-ba2f-97163c3e1eb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273, portal: 172.16.0.220,3260]
Oct 26 03:55:43 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273, portal: 172.16.0.220,3260] successful.
Oct 26 03:55:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65c639d-6655-49f0-91f5-25355a019caa]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0292a1c-9d3f-4825-b9e8-7e44e31537cf]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:43 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:43 user nova-compute[74630]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:55:43 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:55:43 user nova-compute[74630]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)
Oct 26 03:55:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:43 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:43 user nova-compute[74630]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:55:43 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:55:43 user nova-compute[74630]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)
Oct 26 03:55:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] HCTL ('37', '-', '-', 0) found on session 50 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1c3657-50a0-48d5-ac87-7403ed6a20ed]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Searching for a device in session 50 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVgnQtvs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:55:43 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:55:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23133643762653234', 'path': '/dev/sdf'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:55:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133643762653234', 'path': '/dev/sdf'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:55:44 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'flavor' on Instance uuid 18ccafbd-d620-4c00-8cbe-0e48006238cc {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:55:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 03:55:44 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:55:44 user nova-compute[74630]:   <source dev="/dev/sdf"/>
Oct 26 03:55:44 user nova-compute[74630]:   <target dev="vdc" bus="virtio"/>
Oct 26 03:55:44 user nova-compute[74630]:   <serial>90b10f71-5dc9-40b5-ac2f-33fb35847273</serial>
Oct 26 03:55:44 user nova-compute[74630]: </disk>
Oct 26 03:55:44 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 03:55:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:55:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:55:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:55:44 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] No VIF found with MAC fa:16:3e:25:f4:45, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:55:44 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5bccefad-997e-4cee-9da3-da1c5029780f tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.912s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:55:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:55:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:55:45 user nova-compute[74630]: INFO nova.compute.manager [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Detaching volume 6b73cedf-23ef-4a87-9c32-6616335fd512
Oct 26 03:55:46 user nova-compute[74630]: INFO nova.virt.block_device [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Attempting to driver detach volume 6b73cedf-23ef-4a87-9c32-6616335fd512 from mountpoint /dev/vdb
Oct 26 03:55:46 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Attempting to detach device vdb from instance 18ccafbd-d620-4c00-8cbe-0e48006238cc from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:55:46 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:55:46 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:55:46 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:55:46 user nova-compute[74630]:   <serial>6b73cedf-23ef-4a87-9c32-6616335fd512</serial>
Oct 26 03:55:46 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:55:46 user nova-compute[74630]: </disk>
Oct 26 03:55:46 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:55:46 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Successfully detached device vdb from instance 18ccafbd-d620-4c00-8cbe-0e48006238cc from the persistent domain config.
Oct 26 03:55:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 18ccafbd-d620-4c00-8cbe-0e48006238cc from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:55:46 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:55:46 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 03:55:46 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:55:46 user nova-compute[74630]:   <serial>6b73cedf-23ef-4a87-9c32-6616335fd512</serial>
Oct 26 03:55:46 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 03:55:46 user nova-compute[74630]: </disk>
Oct 26 03:55:46 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:55:46 user nova-compute[74630]: INFO nova.compute.manager [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Rebooting instance
Oct 26 03:55:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquired lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG nova.network.neutron [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 18ccafbd-d620-4c00-8cbe-0e48006238cc {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG nova.network.neutron [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updating instance_info_cache with network_info: [{"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Releasing lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-501bc3a1-3850-4762-8e31-4b9ae73b8073 req-399e2413-afb7-493b-a066-15f52ec5627a service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received event network-vif-unplugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-501bc3a1-3850-4762-8e31-4b9ae73b8073 req-399e2413-afb7-493b-a066-15f52ec5627a service nova] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-501bc3a1-3850-4762-8e31-4b9ae73b8073 req-399e2413-afb7-493b-a066-15f52ec5627a service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-501bc3a1-3850-4762-8e31-4b9ae73b8073 req-399e2413-afb7-493b-a066-15f52ec5627a service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:55:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-501bc3a1-3850-4762-8e31-4b9ae73b8073 req-399e2413-afb7-493b-a066-15f52ec5627a service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] No waiting events found dispatching network-vif-unplugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:55:46 user nova-compute[74630]: WARNING nova.compute.manager [req-501bc3a1-3850-4762-8e31-4b9ae73b8073 req-399e2413-afb7-493b-a066-15f52ec5627a service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received unexpected event network-vif-unplugged-b3a6726e-9121-438a-932f-0b702074e093 for instance with vm_state active and task_state reboot_started_hard.
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:55:47 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Instance destroyed successfully.
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lazy-loading 'resources' on Instance uuid 049abd73-381a-41d4-b0f8-134d1e7831c6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1826431466',display_name='tempest-TestMinimumBasicScenario-server-1826431466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1826431466',id=45,image_ref='0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9PtsTGh9gB8alIhq2RBBVboT0aSZb4GGsQtL10//ZVj77mrh4abPILIw+2mfKhxGr627QmbI7upZLcQ+fEInO7yLMoi2WxKOylmH37Yw/29cfE3Vi3+dylDH0gGbwKeg==',key_name='tempest-TestMinimumBasicScenario-683470242',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:53:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d280a7d3a82455f9929dea5a753861c',ramdisk_id='',reservation_id='r-8wfzyv88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1824331495',owner_user_name='tempest-TestMinimumBasicScenario-1824331495-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:55:47Z,user_data=None,user_id='550739bc40d54768ba62e194386d0857',uuid=049abd73-381a-41d4-b0f8-134d1e7831c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converting VIF {"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:69:2f,bridge_name='br-int',has_traffic_filtering=True,id=b3a6726e-9121-438a-932f-0b702074e093,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a6726e-91') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_vif [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:69:2f,bridge_name='br-int',has_traffic_filtering=True,id=b3a6726e-9121-438a-932f-0b702074e093,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a6726e-91') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3a6726e-91, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a65c17ee-80db-4c3d-9a0e-7612d137badb) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:55:47 user nova-compute[74630]: INFO os_vif [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:69:2f,bridge_name='br-int',has_traffic_filtering=True,id=b3a6726e-9121-438a-932f-0b702074e093,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a6726e-91')
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muTPnNhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:55:47 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffc3eda-940a-4414-8edb-a0b43f31ff6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:55:47 user nova-compute[74630]: No targets found.
Oct 26 03:55:47 user nova-compute[74630]: iSNS:
Oct 26 03:55:47 user nova-compute[74630]: No targets found.
Oct 26 03:55:47 user nova-compute[74630]: STATIC:
Oct 26 03:55:47 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde
Oct 26 03:55:47 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:55:47 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:55:47 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512
Oct 26 03:55:47 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:55:47 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:55:47 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12
Oct 26 03:55:47 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:55:47 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:55:47 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac
Oct 26 03:55:47 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:55:47 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:55:47 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273
Oct 26 03:55:47 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:55:47 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:55:47 user nova-compute[74630]: FIRMWARE:
Oct 26 03:55:47 user nova-compute[74630]: No targets found.
Oct 26 03:55:47 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:55:47 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:55:47 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceecb60-8d6d-4f47-b7f7-2f755099d8ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af824c7-2f83-4b16-9468-316b09bac762]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:47 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:47 user nova-compute[74630]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:55:47 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:55:47 user nova-compute[74630]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)
Oct 26 03:55:47 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:47 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:47 user nova-compute[74630]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:55:47 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:55:47 user nova-compute[74630]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)
Oct 26 03:55:47 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c665090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde'): ({'sdd'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Removing single pathed devices sdd {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[349bc5e7-a7e4-4cba-b1ba-577dedbc9ab2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[344c3e84-9e4c-429e-8b93-f96556af0e13]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Flushing IO for device /dev/sdd {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eb61f9-9cb3-4d01-84ee-50797cef3f2b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[386dd4d4-f99a-4ac3-a1b8-0ed12ef51345]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[524d61de-7ca8-4218-b888-e4260df9ea50]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[be720601-3a1b-46f6-8f6b-1e8639f1f6b1]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260]
Oct 26 03:55:47 user nova-compute[74630]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260] successful.
Oct 26 03:55:47 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca614489-be2a-493a-882e-4e38938c8c00]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] <== disconnect_volume: return (330ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Start _get_guest_xml network_info=[{"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muTPnNhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '049abd73-381a-41d4-b0f8-134d1e7831c6', 'attached_at': '', 'detached_at': '', 'volume_id': '03f68da1-0968-43d0-b2ad-4266e446cbde', 'serial': '03f68da1-0968-43d0-b2ad-4266e446cbde'}, 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '9f5af766-8931-458d-969f-2eb0ee56e233', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:55:47 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:55:47 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lazy-loading 'vcpu_model' on Instance uuid 049abd73-381a-41d4-b0f8-134d1e7831c6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.objects.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Object Instance<049abd73-381a-41d4-b0f8-134d1e7831c6> lazy-loaded attributes: resources,vcpu_model {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muTPnNhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:55:47 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:55:47 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:55:47 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[effc6736-834b-471a-870d-360ea385e7a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:55:47 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bfbbf0-e5d4-4712-bbd3-bffd794cd076]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde] added
Oct 26 03:55:47 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:47 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8768d6c-f9c9-42d2-a00d-7dc0b7c50053]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e282a60d-b5d8-4bfa-9149-536481be7f5a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muTPnNhf {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muTPnNhf" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[334b0445-fa1a-4284-ab51-68eb2ad9fc7f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'muTPnNhf'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6dfb04-e146-4f9f-8485-05f0dd6f58ea]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[833c7a70-df40-45a6-8db1-799271cea196]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:48 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:48 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:55:48 user nova-compute[74630]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)
Oct 26 03:55:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:48 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:48 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:55:48 user nova-compute[74630]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)
Oct 26 03:55:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa4cc85-2e0e-4772-aa55-e86ed1717e3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260]
Oct 26 03:55:48 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260] successful.
Oct 26 03:55:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3e97f6-3aa8-4900-bc2c-f3ef95341818]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f4b013-43b0-4a89-a4bb-3eb930aa0f63]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:48 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:48 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:55:48 user nova-compute[74630]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)
Oct 26 03:55:48 user nova-compute[74630]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:55:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:55:48 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:55:48 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:55:48 user nova-compute[74630]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)
Oct 26 03:55:48 user nova-compute[74630]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:55:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[76970bda-f485-4908-a35f-468ee3849e4f]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-a0259631-cb31-4035-b8cc-25a132cc5913 req-40ffd493-5e9a-41f4-95df-18db5804db7e service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received event network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a0259631-cb31-4035-b8cc-25a132cc5913 req-40ffd493-5e9a-41f4-95df-18db5804db7e service nova] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a0259631-cb31-4035-b8cc-25a132cc5913 req-40ffd493-5e9a-41f4-95df-18db5804db7e service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a0259631-cb31-4035-b8cc-25a132cc5913 req-40ffd493-5e9a-41f4-95df-18db5804db7e service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:55:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-a0259631-cb31-4035-b8cc-25a132cc5913 req-40ffd493-5e9a-41f4-95df-18db5804db7e service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] No waiting events found dispatching network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:55:48 user nova-compute[74630]: WARNING nova.compute.manager [req-a0259631-cb31-4035-b8cc-25a132cc5913 req-40ffd493-5e9a-41f4-95df-18db5804db7e service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received unexpected event network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 for instance with vm_state active and task_state reboot_started_hard.
Oct 26 03:55:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muTPnNhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26438643765646637', 'path': '/dev/sdd'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438643765646637', 'path': '/dev/sdd'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1826431466',display_name='tempest-TestMinimumBasicScenario-server-1826431466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1826431466',id=45,image_ref='0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9PtsTGh9gB8alIhq2RBBVboT0aSZb4GGsQtL10//ZVj77mrh4abPILIw+2mfKhxGr627QmbI7upZLcQ+fEInO7yLMoi2WxKOylmH37Yw/29cfE3Vi3+dylDH0gGbwKeg==',key_name='tempest-TestMinimumBasicScenario-683470242',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:53:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d280a7d3a82455f9929dea5a753861c',ramdisk_id='',reservation_id='r-8wfzyv88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1824331495',owner_user_name='tempest-TestMinimumBasicScenario-1824331495-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:55:47Z,user_data=None,user_id='550739bc40d54768ba62e194386d0857',uuid=049abd73-381a-41d4-b0f8-134d1e7831c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converting VIF {"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:69:2f,bridge_name='br-int',has_traffic_filtering=True,id=b3a6726e-9121-438a-932f-0b702074e093,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a6726e-91') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lazy-loading 'pci_devices' on Instance uuid 049abd73-381a-41d4-b0f8-134d1e7831c6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG nova.objects.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Object Instance<049abd73-381a-41d4-b0f8-134d1e7831c6> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:55:49 user nova-compute[74630]:   <uuid>049abd73-381a-41d4-b0f8-134d1e7831c6</uuid>
Oct 26 03:55:49 user nova-compute[74630]:   <name>instance-0000002d</name>
Oct 26 03:55:49 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:55:49 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:55:49 user nova-compute[74630]:   <metadata>
Oct 26 03:55:49 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:55:49 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:55:49 user nova-compute[74630]:       <nova:name>tempest-TestMinimumBasicScenario-server-1826431466</nova:name>
Oct 26 03:55:49 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:55:47</nova:creationTime>
Oct 26 03:55:49 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:55:49 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:55:49 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:55:49 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:55:49 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:55:49 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:55:49 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:55:49 user nova-compute[74630]:       <nova:owner>
Oct 26 03:55:49 user nova-compute[74630]:         <nova:user uuid="550739bc40d54768ba62e194386d0857">tempest-TestMinimumBasicScenario-1824331495-project-member</nova:user>
Oct 26 03:55:49 user nova-compute[74630]:         <nova:project uuid="3d280a7d3a82455f9929dea5a753861c">tempest-TestMinimumBasicScenario-1824331495</nova:project>
Oct 26 03:55:49 user nova-compute[74630]:       </nova:owner>
Oct 26 03:55:49 user nova-compute[74630]:       <nova:root type="image" uuid="0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5"/>
Oct 26 03:55:49 user nova-compute[74630]:       <nova:ports>
Oct 26 03:55:49 user nova-compute[74630]:         <nova:port uuid="b3a6726e-9121-438a-932f-0b702074e093">
Oct 26 03:55:49 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 03:55:49 user nova-compute[74630]:         </nova:port>
Oct 26 03:55:49 user nova-compute[74630]:       </nova:ports>
Oct 26 03:55:49 user nova-compute[74630]:     </nova:instance>
Oct 26 03:55:49 user nova-compute[74630]:   </metadata>
Oct 26 03:55:49 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:55:49 user nova-compute[74630]:     <system>
Oct 26 03:55:49 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:55:49 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:55:49 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:55:49 user nova-compute[74630]:       <entry name="serial">049abd73-381a-41d4-b0f8-134d1e7831c6</entry>
Oct 26 03:55:49 user nova-compute[74630]:       <entry name="uuid">049abd73-381a-41d4-b0f8-134d1e7831c6</entry>
Oct 26 03:55:49 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:55:49 user nova-compute[74630]:     </system>
Oct 26 03:55:49 user nova-compute[74630]:   </sysinfo>
Oct 26 03:55:49 user nova-compute[74630]:   <os>
Oct 26 03:55:49 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:55:49 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:55:49 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:55:49 user nova-compute[74630]:   </os>
Oct 26 03:55:49 user nova-compute[74630]:   <features>
Oct 26 03:55:49 user nova-compute[74630]:     <acpi/>
Oct 26 03:55:49 user nova-compute[74630]:     <apic/>
Oct 26 03:55:49 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:55:49 user nova-compute[74630]:   </features>
Oct 26 03:55:49 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:55:49 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:55:49 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:55:49 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:55:49 user nova-compute[74630]:   </clock>
Oct 26 03:55:49 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:55:49 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:55:49 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:55:49 user nova-compute[74630]:   </cpu>
Oct 26 03:55:49 user nova-compute[74630]:   <devices>
Oct 26 03:55:49 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:55:49 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:55:49 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk"/>
Oct 26 03:55:49 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:55:49 user nova-compute[74630]:     </disk>
Oct 26 03:55:49 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:55:49 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:55:49 user nova-compute[74630]:       <source dev="/dev/sdd"/>
Oct 26 03:55:49 user nova-compute[74630]:       <target dev="vdb" bus="virtio"/>
Oct 26 03:55:49 user nova-compute[74630]:       <serial>03f68da1-0968-43d0-b2ad-4266e446cbde</serial>
Oct 26 03:55:49 user nova-compute[74630]:     </disk>
Oct 26 03:55:49 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:55:49 user nova-compute[74630]:       <mac address="fa:16:3e:3b:69:2f"/>
Oct 26 03:55:49 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:55:49 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:55:49 user nova-compute[74630]:       <target dev="tapb3a6726e-91"/>
Oct 26 03:55:49 user nova-compute[74630]:     </interface>
Oct 26 03:55:49 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:55:49 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/console.log" append="off"/>
Oct 26 03:55:49 user nova-compute[74630]:     </serial>
Oct 26 03:55:49 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:55:49 user nova-compute[74630]:     <video>
Oct 26 03:55:49 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:55:49 user nova-compute[74630]:     </video>
Oct 26 03:55:49 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:55:49 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:55:49 user nova-compute[74630]:     </rng>
Oct 26 03:55:49 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:55:49 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:55:49 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:55:49 user nova-compute[74630]:     </memballoon>
Oct 26 03:55:49 user nova-compute[74630]:   </devices>
Oct 26 03:55:49 user nova-compute[74630]: </domain>
Oct 26 03:55:49 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updating instance_info_cache with network_info: [{"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lazy-loading 'trusted_certs' on Instance uuid 049abd73-381a-41d4-b0f8-134d1e7831c6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG nova.objects.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Object Instance<049abd73-381a-41d4-b0f8-134d1e7831c6> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673 --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673 --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:55:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Cannot resize image /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lazy-loading 'migration_context' on Instance uuid 049abd73-381a-41d4-b0f8-134d1e7831c6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG nova.objects.base [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Object Instance<049abd73-381a-41d4-b0f8-134d1e7831c6> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1826431466',display_name='tempest-TestMinimumBasicScenario-server-1826431466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1826431466',id=45,image_ref='0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9PtsTGh9gB8alIhq2RBBVboT0aSZb4GGsQtL10//ZVj77mrh4abPILIw+2mfKhxGr627QmbI7upZLcQ+fEInO7yLMoi2WxKOylmH37Yw/29cfE3Vi3+dylDH0gGbwKeg==',key_name='tempest-TestMinimumBasicScenario-683470242',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:53:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='3d280a7d3a82455f9929dea5a753861c',ramdisk_id='',reservation_id='r-8wfzyv88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1824331495',owner_user_name='tempest-TestMinimumBasicScenario-1824331495-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:55:47Z,user_data=None,user_id='550739bc40d54768ba62e194386d0857',uuid=049abd73-381a-41d4-b0f8-134d1e7831c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converting VIF {"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:69:2f,bridge_name='br-int',has_traffic_filtering=True,id=b3a6726e-9121-438a-932f-0b702074e093,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a6726e-91') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG os_vif [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:69:2f,bridge_name='br-int',has_traffic_filtering=True,id=b3a6726e-9121-438a-932f-0b702074e093,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a6726e-91') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28671eaf-5070-5aa7-9047-9a0ba3c5dccd', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3a6726e-91, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3a6726e-91, col_values=(('qos', UUID('e9cfba9c-3bc9-46f7-b61d-36bf49769731')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3a6726e-91, col_values=(('external_ids', {'iface-id': 'b3a6726e-9121-438a-932f-0b702074e093', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:69:2f', 'vm-uuid': '049abd73-381a-41d4-b0f8-134d1e7831c6'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:55:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:50 user nova-compute[74630]: INFO os_vif [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:69:2f,bridge_name='br-int',has_traffic_filtering=True,id=b3a6726e-9121-438a-932f-0b702074e093,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a6726e-91')
Oct 26 03:55:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:55:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:55:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:55:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:55:51 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:55:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-bcf04fd3-76e1-464f-9bd2-3c1e37ffe4d3 req-1b04f1ce-77f7-4db6-9604-7072e2a0a18d service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received event network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:55:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bcf04fd3-76e1-464f-9bd2-3c1e37ffe4d3 req-1b04f1ce-77f7-4db6-9604-7072e2a0a18d service nova] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:55:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bcf04fd3-76e1-464f-9bd2-3c1e37ffe4d3 req-1b04f1ce-77f7-4db6-9604-7072e2a0a18d service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:55:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bcf04fd3-76e1-464f-9bd2-3c1e37ffe4d3 req-1b04f1ce-77f7-4db6-9604-7072e2a0a18d service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:55:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-bcf04fd3-76e1-464f-9bd2-3c1e37ffe4d3 req-1b04f1ce-77f7-4db6-9604-7072e2a0a18d service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] No waiting events found dispatching network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:55:51 user nova-compute[74630]: WARNING nova.compute.manager [req-bcf04fd3-76e1-464f-9bd2-3c1e37ffe4d3 req-1b04f1ce-77f7-4db6-9604-7072e2a0a18d service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received unexpected event network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 for instance with vm_state active and task_state reboot_started_hard.
Oct 26 03:55:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:55:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:55:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:55:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:55:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:55:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:55:53 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:55:53 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:55:53 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8551MB free_disk=24.941978454589844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance dbffcb7f-4576-4250-90a8-cc35f53c1f7b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 18ccafbd-d620-4c00-8cbe-0e48006238cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 049abd73-381a-41d4-b0f8-134d1e7831c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9916c77-4e65-4922-b3a1-1fdc3f7c475e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:55:53 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Instance rebooted successfully.
Oct 26 03:55:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c5569b19-1b81-4b3d-bccc-7422e9224380 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.803s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG nova.compute.manager [req-4d32ee27-6b77-4175-a9ac-006ed8dad978 req-686d410c-70d0-4429-a26d-d25330f08994 service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received event network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4d32ee27-6b77-4175-a9ac-006ed8dad978 req-686d410c-70d0-4429-a26d-d25330f08994 service nova] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4d32ee27-6b77-4175-a9ac-006ed8dad978 req-686d410c-70d0-4429-a26d-d25330f08994 service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4d32ee27-6b77-4175-a9ac-006ed8dad978 req-686d410c-70d0-4429-a26d-d25330f08994 service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:55:53 user nova-compute[74630]: DEBUG nova.compute.manager [req-4d32ee27-6b77-4175-a9ac-006ed8dad978 req-686d410c-70d0-4429-a26d-d25330f08994 service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] No waiting events found dispatching network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:55:53 user nova-compute[74630]: WARNING nova.compute.manager [req-4d32ee27-6b77-4175-a9ac-006ed8dad978 req-686d410c-70d0-4429-a26d-d25330f08994 service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received unexpected event network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 for instance with vm_state active and task_state None.
Oct 26 03:55:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:54 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:55:54 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:55:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:55:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:06 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 18ccafbd-d620-4c00-8cbe-0e48006238cc is timed out.
Oct 26 03:56:06 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Successfully detached device vdb from instance 18ccafbd-d620-4c00-8cbe-0e48006238cc from the live domain config.
Oct 26 03:56:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smlIhNeg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:56:06 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2b5a33-1817-4fa9-9dbf-ec5941c8f919]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:56:06 user nova-compute[74630]: No targets found.
Oct 26 03:56:06 user nova-compute[74630]: iSNS:
Oct 26 03:56:06 user nova-compute[74630]: No targets found.
Oct 26 03:56:06 user nova-compute[74630]: STATIC:
Oct 26 03:56:06 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde
Oct 26 03:56:06 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:56:06 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:56:06 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512
Oct 26 03:56:06 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:56:06 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:56:06 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12
Oct 26 03:56:06 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:56:06 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:56:06 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac
Oct 26 03:56:06 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:56:06 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:56:06 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273
Oct 26 03:56:06 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:56:06 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:56:06 user nova-compute[74630]: FIRMWARE:
Oct 26 03:56:06 user nova-compute[74630]: No targets found.
Oct 26 03:56:06 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:56:06 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:56:06 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb35a8e1-da65-4a2f-98b3-d8bf7f784413]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4239f94a-a273-4b3a-96e0-875ec82fdbf3]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:56:06 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:56:06 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:56:06 user nova-compute[74630]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)
Oct 26 03:56:06 user nova-compute[74630]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:56:06 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:56:06 user nova-compute[74630]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 (non-flash)
Oct 26 03:56:06 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:56:06 user nova-compute[74630]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)
Oct 26 03:56:06 user nova-compute[74630]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:56:06 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c7952d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512'): ({'sdc'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Removing single pathed devices sdc {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[be21baa0-507b-45ed-a4ba-471ff6a5b452]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a20e4b-2ecf-4da3-b7ae-c9306316697c]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Flushing IO for device /dev/sdc {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[645f3c74-1de4-4db0-9ea8-ea0056caaa9b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[99af7f54-ee7f-4b77-b146-b2e032fbb856]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bc5f45-e3ac-452a-9f97-1d3b22d7256a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b03a51-e0a8-4592-9e6f-aee0da760644]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512, portal: 172.16.0.220,3260]
Oct 26 03:56:06 user nova-compute[74630]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512, portal: 172.16.0.220,3260] successful.
Oct 26 03:56:06 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b73cedf-23ef-4a87-9c32-6616335fd512 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ccdb5a-cdfd-4120-900b-64bc35c2e322]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] <== disconnect_volume: return (338ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:56:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Verify base images {{(pid=74630) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Image id 2af0c345-7181-4a99-930a-7c1779eabd24 yields fingerprint 549b24343c2b49b4860a15e4a77e4910d17211cd {{(pid=74630) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74630) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Image id 0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5 yields fingerprint 294e77f7eebd000795cbc3663d4deee47da15673 {{(pid=74630) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 26 03:56:07 user nova-compute[74630]: INFO nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] image 0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5 at (/opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673): checking
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] image 0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5 at (/opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673): image is in use {{(pid=74630) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Image id 8519fea8-ccda-4565-9023-82b90e4bb746 yields fingerprint e83ecc82d871a951e1d88a72177228df7a876c8b {{(pid=74630) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 26 03:56:07 user nova-compute[74630]: INFO nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] image 8519fea8-ccda-4565-9023-82b90e4bb746 at (/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b): checking
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] image 8519fea8-ccda-4565-9023-82b90e4bb746 at (/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b): image is in use {{(pid=74630) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] f9916c77-4e65-4922-b3a1-1fdc3f7c475e is a valid instance name {{(pid=74630) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] 18ccafbd-d620-4c00-8cbe-0e48006238cc is a valid instance name {{(pid=74630) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] 18ccafbd-d620-4c00-8cbe-0e48006238cc has a disk file {{(pid=74630) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 18ccafbd-d620-4c00-8cbe-0e48006238cc is backed by e83ecc82d871a951e1d88a72177228df7a876c8b {{(pid=74630) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] dbffcb7f-4576-4250-90a8-cc35f53c1f7b is a valid instance name {{(pid=74630) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] 049abd73-381a-41d4-b0f8-134d1e7831c6 is a valid instance name {{(pid=74630) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] 049abd73-381a-41d4-b0f8-134d1e7831c6 has a disk file {{(pid=74630) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 049abd73-381a-41d4-b0f8-134d1e7831c6 is backed by 294e77f7eebd000795cbc3663d4deee47da15673 {{(pid=74630) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 26 03:56:07 user nova-compute[74630]: WARNING nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/70c673dbb9add57fbc24d5ffcb5343901ca2b04b
Oct 26 03:56:07 user nova-compute[74630]: WARNING nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e
Oct 26 03:56:07 user nova-compute[74630]: WARNING nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948
Oct 26 03:56:07 user nova-compute[74630]: WARNING nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370
Oct 26 03:56:07 user nova-compute[74630]: WARNING nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a
Oct 26 03:56:07 user nova-compute[74630]: WARNING nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/3ea2c45979032952a410ab812aa96e23e0361a51
Oct 26 03:56:07 user nova-compute[74630]: WARNING nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/1a55ee76dab11daa408798d5c85e1b874548b0a9
Oct 26 03:56:07 user nova-compute[74630]: INFO nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Active base files: /opt/stack/data/nova/instances/_base/294e77f7eebd000795cbc3663d4deee47da15673 /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b
Oct 26 03:56:07 user nova-compute[74630]: INFO nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Removable base files: /opt/stack/data/nova/instances/_base/70c673dbb9add57fbc24d5ffcb5343901ca2b04b /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948 /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370 /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a /opt/stack/data/nova/instances/_base/3ea2c45979032952a410ab812aa96e23e0361a51 /opt/stack/data/nova/instances/_base/1a55ee76dab11daa408798d5c85e1b874548b0a9
Oct 26 03:56:07 user nova-compute[74630]: INFO nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/70c673dbb9add57fbc24d5ffcb5343901ca2b04b
Oct 26 03:56:07 user nova-compute[74630]: INFO nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8b373f3ef722f1eed9bbf28190fadd2b95c81a9e
Oct 26 03:56:07 user nova-compute[74630]: INFO nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f70d438cd5cfda3aae490ed333e79f0a3cce2948
Oct 26 03:56:07 user nova-compute[74630]: INFO nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/82b235b038d79248ea65c9000eac12454434a370
Oct 26 03:56:07 user nova-compute[74630]: INFO nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b351e48480b831190ec7a40c5c4ced9f632f7b8a
Oct 26 03:56:07 user nova-compute[74630]: INFO nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3ea2c45979032952a410ab812aa96e23e0361a51
Oct 26 03:56:07 user nova-compute[74630]: INFO nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1a55ee76dab11daa408798d5c85e1b874548b0a9
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Verification complete {{(pid=74630) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Verify swap images {{(pid=74630) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.virt.libvirt.imagecache [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Verify ephemeral images {{(pid=74630) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG nova.objects.instance [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'flavor' on Instance uuid 18ccafbd-d620-4c00-8cbe-0e48006238cc {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:56:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-4b486493-865c-455f-a390-6ebe51a7b231 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.829s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:08 user nova-compute[74630]: INFO nova.compute.manager [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Detaching volume 90b10f71-5dc9-40b5-ac2f-33fb35847273
Oct 26 03:56:08 user nova-compute[74630]: INFO nova.virt.block_device [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Attempting to driver detach volume 90b10f71-5dc9-40b5-ac2f-33fb35847273 from mountpoint /dev/vdc
Oct 26 03:56:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Attempting to detach device vdc from instance 18ccafbd-d620-4c00-8cbe-0e48006238cc from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:56:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:56:08 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:56:08 user nova-compute[74630]:   <source dev="/dev/sdf"/>
Oct 26 03:56:08 user nova-compute[74630]:   <target dev="vdc" bus="virtio"/>
Oct 26 03:56:08 user nova-compute[74630]:   <serial>90b10f71-5dc9-40b5-ac2f-33fb35847273</serial>
Oct 26 03:56:08 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 03:56:08 user nova-compute[74630]: </disk>
Oct 26 03:56:08 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:56:08 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Successfully detached device vdc from instance 18ccafbd-d620-4c00-8cbe-0e48006238cc from the persistent domain config.
Oct 26 03:56:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 18ccafbd-d620-4c00-8cbe-0e48006238cc from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:56:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:56:08 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:56:08 user nova-compute[74630]:   <source dev="/dev/sdf"/>
Oct 26 03:56:08 user nova-compute[74630]:   <target dev="vdc" bus="virtio"/>
Oct 26 03:56:08 user nova-compute[74630]:   <serial>90b10f71-5dc9-40b5-ac2f-33fb35847273</serial>
Oct 26 03:56:08 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 03:56:08 user nova-compute[74630]: </disk>
Oct 26 03:56:08 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:56:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 18ccafbd-d620-4c00-8cbe-0e48006238cc {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:56:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:29 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 18ccafbd-d620-4c00-8cbe-0e48006238cc is timed out.
Oct 26 03:56:29 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Successfully detached device vdc from instance 18ccafbd-d620-4c00-8cbe-0e48006238cc from the live domain config.
Oct 26 03:56:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVgnQtvs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:56:29 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[582c95dc-5648-4c96-9427-47feefa06aa1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:56:29 user nova-compute[74630]: No targets found.
Oct 26 03:56:29 user nova-compute[74630]: iSNS:
Oct 26 03:56:29 user nova-compute[74630]: No targets found.
Oct 26 03:56:29 user nova-compute[74630]: STATIC:
Oct 26 03:56:29 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde
Oct 26 03:56:29 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:56:29 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:56:29 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12
Oct 26 03:56:29 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:56:29 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:56:29 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac
Oct 26 03:56:29 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:56:29 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:56:29 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273
Oct 26 03:56:29 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:56:29 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:56:29 user nova-compute[74630]: FIRMWARE:
Oct 26 03:56:29 user nova-compute[74630]: No targets found.
Oct 26 03:56:29 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:56:29 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:56:29 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f5c54b-9df0-4fff-9ed0-f99716223fc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c36f80-d038-417a-846d-2b9c3ae6128a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:56:29 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:56:29 user nova-compute[74630]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)
Oct 26 03:56:29 user nova-compute[74630]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:56:29 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:56:29 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:56:29 user nova-compute[74630]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 (non-flash)
Oct 26 03:56:29 user nova-compute[74630]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:56:29 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f315c7205e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273'): ({'sdf'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Removing single pathed devices sdf {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[497d044e-4905-49e7-b12c-f10c824dccbc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec50740-a61f-472f-9127-39d13f29eeb9]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Flushing IO for device /dev/sdf {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[476315de-0c88-453e-9651-bf88c5e6deab]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4390e48-c747-4d75-ac58-2dc2ed5d67bd]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] SCSI volumes sdf have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[385a0de7-8903-4d6a-966c-5054b27b693f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5ded56-1571-462e-9cde-bf80c934a978]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273, portal: 172.16.0.220,3260]
Oct 26 03:56:29 user nova-compute[74630]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273, portal: 172.16.0.220,3260] successful.
Oct 26 03:56:29 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90b10f71-5dc9-40b5-ac2f-33fb35847273 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f1fb2e-5091-40fa-ae49-4cd3888f54b3]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] <== disconnect_volume: return (313ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:56:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:56:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:30 user nova-compute[74630]: DEBUG nova.objects.instance [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'flavor' on Instance uuid 18ccafbd-d620-4c00-8cbe-0e48006238cc {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:56:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-b0ea9c33-aadf-443a-9092-779bbdc49ce1 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.791s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:31 user nova-compute[74630]: INFO nova.compute.manager [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Terminating instance
Oct 26 03:56:31 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:56:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-00f578a7-ba98-4e19-845e-8ee909567124 req-5b947698-4b18-452f-8ccd-51e9a16ed43c service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received event network-vif-unplugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:56:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-00f578a7-ba98-4e19-845e-8ee909567124 req-5b947698-4b18-452f-8ccd-51e9a16ed43c service nova] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-00f578a7-ba98-4e19-845e-8ee909567124 req-5b947698-4b18-452f-8ccd-51e9a16ed43c service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-00f578a7-ba98-4e19-845e-8ee909567124 req-5b947698-4b18-452f-8ccd-51e9a16ed43c service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-00f578a7-ba98-4e19-845e-8ee909567124 req-5b947698-4b18-452f-8ccd-51e9a16ed43c service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] No waiting events found dispatching network-vif-unplugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:56:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-00f578a7-ba98-4e19-845e-8ee909567124 req-5b947698-4b18-452f-8ccd-51e9a16ed43c service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received event network-vif-unplugged-4c791217-e407-4a3c-9de2-f4cdccc586ee for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:32 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Instance destroyed successfully.
Oct 26 03:56:32 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lazy-loading 'resources' on Instance uuid 18ccafbd-d620-4c00-8cbe-0e48006238cc {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:52:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1893156473',display_name='tempest-AttachVolumeTestJSON-server-1893156473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1893156473',id=44,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfjiYW2ooRRWOw06CRdlmicT4cjTthrlnWGFBa7a3HrT7cn+Ge7If5y1LrS29ClMv/zCHrd3AzXHo3Dgt9CtwzDH7XW+h6si2L3EX2VFPMOVRL56lCrsRe0ELvpyDN+rw==',key_name='tempest-keypair-803405658',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:53:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2671ecf470da4c5093899caa0e5b8313',ramdisk_id='',reservation_id='r-r0pqmxdc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2036216451',owner_user_name='tempest-AttachVolumeTestJSON-2036216451-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2adadef6a5a8437b8ee3931cbeff5467',uuid=18ccafbd-d620-4c00-8cbe-0e48006238cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "address": "fa:16:3e:25:f4:45", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c791217-e4", "ovs_interfaceid": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converting VIF {"id": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "address": "fa:16:3e:25:f4:45", "network": {"id": "4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-739550063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2671ecf470da4c5093899caa0e5b8313", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c791217-e4", "ovs_interfaceid": "4c791217-e407-4a3c-9de2-f4cdccc586ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:f4:45,bridge_name='br-int',has_traffic_filtering=True,id=4c791217-e407-4a3c-9de2-f4cdccc586ee,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c791217-e4') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG os_vif [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:f4:45,bridge_name='br-int',has_traffic_filtering=True,id=4c791217-e407-4a3c-9de2-f4cdccc586ee,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c791217-e4') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c791217-e4, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10507887-4964-49f6-9b4d-8bb882899120) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:56:32 user nova-compute[74630]: INFO os_vif [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:f4:45,bridge_name='br-int',has_traffic_filtering=True,id=4c791217-e407-4a3c-9de2-f4cdccc586ee,network=Network(4e7bf0bf-61c0-4aeb-b7eb-a474bae1c4a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c791217-e4')
Oct 26 03:56:32 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Deleting instance files /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc_del
Oct 26 03:56:32 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Deletion of /opt/stack/data/nova/instances/18ccafbd-d620-4c00-8cbe-0e48006238cc_del complete
Oct 26 03:56:32 user nova-compute[74630]: INFO nova.compute.manager [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 26 03:56:32 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:56:32 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:56:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:33 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:33 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:56:33 user nova-compute[74630]: DEBUG nova.compute.manager [req-f37476d5-3abc-440d-99d3-217a720fa3d5 req-6f43a8b0-4a79-4a88-a5f1-347c1c7129fd service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received event network-vif-deleted-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:56:33 user nova-compute[74630]: INFO nova.compute.manager [req-f37476d5-3abc-440d-99d3-217a720fa3d5 req-6f43a8b0-4a79-4a88-a5f1-347c1c7129fd service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Neutron deleted interface 4c791217-e407-4a3c-9de2-f4cdccc586ee; detaching it from the instance and deleting it from the info cache
Oct 26 03:56:33 user nova-compute[74630]: DEBUG nova.network.neutron [req-f37476d5-3abc-440d-99d3-217a720fa3d5 req-6f43a8b0-4a79-4a88-a5f1-347c1c7129fd service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:56:33 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Took 0.85 seconds to deallocate network for instance.
Oct 26 03:56:33 user nova-compute[74630]: DEBUG nova.compute.manager [req-f37476d5-3abc-440d-99d3-217a720fa3d5 req-6f43a8b0-4a79-4a88-a5f1-347c1c7129fd service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Detach interface failed, port_id=4c791217-e407-4a3c-9de2-f4cdccc586ee, reason: Instance 18ccafbd-d620-4c00-8cbe-0e48006238cc could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 03:56:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:33 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:56:33 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:56:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:33 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Deleted allocations for instance 18ccafbd-d620-4c00-8cbe-0e48006238cc
Oct 26 03:56:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5f4a3649-2171-4a00-9119-2fd18b382e50 tempest-AttachVolumeTestJSON-2036216451 tempest-AttachVolumeTestJSON-2036216451-project-member] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.096s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received event network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] No waiting events found dispatching network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:56:34 user nova-compute[74630]: WARNING nova.compute.manager [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received unexpected event network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee for instance with vm_state deleted and task_state None.
Oct 26 03:56:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received event network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] No waiting events found dispatching network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:56:34 user nova-compute[74630]: WARNING nova.compute.manager [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received unexpected event network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee for instance with vm_state deleted and task_state None.
Oct 26 03:56:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received event network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] No waiting events found dispatching network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:56:34 user nova-compute[74630]: WARNING nova.compute.manager [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received unexpected event network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee for instance with vm_state deleted and task_state None.
Oct 26 03:56:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received event network-vif-unplugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] No waiting events found dispatching network-vif-unplugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:56:34 user nova-compute[74630]: WARNING nova.compute.manager [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received unexpected event network-vif-unplugged-4c791217-e407-4a3c-9de2-f4cdccc586ee for instance with vm_state deleted and task_state None.
Oct 26 03:56:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received event network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] Acquiring lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] Lock "18ccafbd-d620-4c00-8cbe-0e48006238cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:34 user nova-compute[74630]: DEBUG nova.compute.manager [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] No waiting events found dispatching network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:56:34 user nova-compute[74630]: WARNING nova.compute.manager [req-dbe611f5-ae36-4b48-a887-5e4310531a1d req-a2c85eaf-7d3c-43f4-ba49-88eba4473551 service nova] [instance: 18ccafbd-d620-4c00-8cbe-0e48006238cc] Received unexpected event network-vif-plugged-4c791217-e407-4a3c-9de2-f4cdccc586ee for instance with vm_state deleted and task_state None.
Oct 26 03:56:35 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:56:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:56:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 03:56:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] There are 0 instances to clean {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 03:56:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:56:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:56:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:56:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:56:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:56:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-8ec31252-10dd-458d-8470-db61ec0f506c req-feeb12db-010d-4477-9a22-4b2b4fab7f3c service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Received event network-changed-d520bfbe-3f95-4646-9d13-e2f6813c294d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:56:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-8ec31252-10dd-458d-8470-db61ec0f506c req-feeb12db-010d-4477-9a22-4b2b4fab7f3c service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Refreshing instance network info cache due to event network-changed-d520bfbe-3f95-4646-9d13-e2f6813c294d. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:56:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8ec31252-10dd-458d-8470-db61ec0f506c req-feeb12db-010d-4477-9a22-4b2b4fab7f3c service nova] Acquiring lock "refresh_cache-f9916c77-4e65-4922-b3a1-1fdc3f7c475e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:56:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8ec31252-10dd-458d-8470-db61ec0f506c req-feeb12db-010d-4477-9a22-4b2b4fab7f3c service nova] Acquired lock "refresh_cache-f9916c77-4e65-4922-b3a1-1fdc3f7c475e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:56:47 user nova-compute[74630]: DEBUG nova.network.neutron [req-8ec31252-10dd-458d-8470-db61ec0f506c req-feeb12db-010d-4477-9a22-4b2b4fab7f3c service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Refreshing network info cache for port d520bfbe-3f95-4646-9d13-e2f6813c294d {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:56:47 user nova-compute[74630]: DEBUG nova.network.neutron [req-8ec31252-10dd-458d-8470-db61ec0f506c req-feeb12db-010d-4477-9a22-4b2b4fab7f3c service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Updated VIF entry in instance network info cache for port d520bfbe-3f95-4646-9d13-e2f6813c294d. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:56:47 user nova-compute[74630]: DEBUG nova.network.neutron [req-8ec31252-10dd-458d-8470-db61ec0f506c req-feeb12db-010d-4477-9a22-4b2b4fab7f3c service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Updating instance_info_cache with network_info: [{"id": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "address": "fa:16:3e:32:41:3a", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd520bfbe-3f", "ovs_interfaceid": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:56:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8ec31252-10dd-458d-8470-db61ec0f506c req-feeb12db-010d-4477-9a22-4b2b4fab7f3c service nova] Releasing lock "refresh_cache-f9916c77-4e65-4922-b3a1-1fdc3f7c475e" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:48 user nova-compute[74630]: INFO nova.compute.manager [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Terminating instance
Oct 26 03:56:48 user nova-compute[74630]: DEBUG nova.compute.manager [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-8d8a2773-1f9a-4047-8d31-ae461e9b3e89 req-99e7f17d-63ce-4acd-a880-54063ae87c29 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Received event network-vif-unplugged-d520bfbe-3f95-4646-9d13-e2f6813c294d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8d8a2773-1f9a-4047-8d31-ae461e9b3e89 req-99e7f17d-63ce-4acd-a880-54063ae87c29 service nova] Acquiring lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8d8a2773-1f9a-4047-8d31-ae461e9b3e89 req-99e7f17d-63ce-4acd-a880-54063ae87c29 service nova] Lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8d8a2773-1f9a-4047-8d31-ae461e9b3e89 req-99e7f17d-63ce-4acd-a880-54063ae87c29 service nova] Lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-8d8a2773-1f9a-4047-8d31-ae461e9b3e89 req-99e7f17d-63ce-4acd-a880-54063ae87c29 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] No waiting events found dispatching network-vif-unplugged-d520bfbe-3f95-4646-9d13-e2f6813c294d {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-8d8a2773-1f9a-4047-8d31-ae461e9b3e89 req-99e7f17d-63ce-4acd-a880-54063ae87c29 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Received event network-vif-unplugged-d520bfbe-3f95-4646-9d13-e2f6813c294d for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:48 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Instance destroyed successfully.
Oct 26 03:56:48 user nova-compute[74630]: DEBUG nova.objects.instance [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lazy-loading 'resources' on Instance uuid f9916c77-4e65-4922-b3a1-1fdc3f7c475e {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:54:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-152729192',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-152729192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-152729192',id=46,image_ref='2af0c345-7181-4a99-930a-7c1779eabd24',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtZD2D+o/pXiyIN+P4MY4FdrkV2AhXDKKVp4WwrlREDJFlLD+MtLTbOey5ObryFIGF3fZ1bM6+p+jumfHADxlL9A9zzqzhW3GBPQkc+NFES7lpqFSrTcd3GV58Ad5hdkg==',key_name='tempest-keypair-1146610389',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:55:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-ub32s3ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1203294393',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:55:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3bd794500243df86a1e4e89414bea0',uuid=f9916c77-4e65-4922-b3a1-1fdc3f7c475e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "address": "fa:16:3e:32:41:3a", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd520bfbe-3f", "ovs_interfaceid": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "address": "fa:16:3e:32:41:3a", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd520bfbe-3f", "ovs_interfaceid": "d520bfbe-3f95-4646-9d13-e2f6813c294d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:41:3a,bridge_name='br-int',has_traffic_filtering=True,id=d520bfbe-3f95-4646-9d13-e2f6813c294d,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd520bfbe-3f') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG os_vif [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:41:3a,bridge_name='br-int',has_traffic_filtering=True,id=d520bfbe-3f95-4646-9d13-e2f6813c294d,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd520bfbe-3f') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd520bfbe-3f, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4998a2d1-27d3-4596-816a-d13efc2fc00d) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:56:48 user nova-compute[74630]: INFO os_vif [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:41:3a,bridge_name='br-int',has_traffic_filtering=True,id=d520bfbe-3f95-4646-9d13-e2f6813c294d,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd520bfbe-3f')
Oct 26 03:56:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuzdNstG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:56:48 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:56:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:56:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f41918e-69c9-4da6-9651-d71a29ecb21c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:56:49 user nova-compute[74630]: No targets found.
Oct 26 03:56:49 user nova-compute[74630]: iSNS:
Oct 26 03:56:49 user nova-compute[74630]: No targets found.
Oct 26 03:56:49 user nova-compute[74630]: STATIC:
Oct 26 03:56:49 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde
Oct 26 03:56:49 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:56:49 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:56:49 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12
Oct 26 03:56:49 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:56:49 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:56:49 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac
Oct 26 03:56:49 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:56:49 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:56:49 user nova-compute[74630]: FIRMWARE:
Oct 26 03:56:49 user nova-compute[74630]: No targets found.
Oct 26 03:56:49 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:56:49 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:56:49 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcca427-f59c-4f68-a6cc-1f51b53bdc46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Skipping network cache update for instance because it is being deleted. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e50aaca-bfc2-4b4b-9a4f-56ff373c2a04]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:56:49 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:56:49 user nova-compute[74630]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:56:49 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:56:49 user nova-compute[74630]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 (non-flash)
Oct 26 03:56:49 user nova-compute[74630]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:56:49 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c1cb760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12'): ({'sde'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Removing single pathed devices sde {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4140a138-f8c8-4e25-b1f6-1504ce02481a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d674f5-f001-4275-9d80-1c91d14c8745]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flushing IO for device /dev/sde {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-dbffcb7f-4576-4250-90a8-cc35f53c1f7b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-dbffcb7f-4576-4250-90a8-cc35f53c1f7b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid dbffcb7f-4576-4250-90a8-cc35f53c1f7b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcadb52d-a974-482b-a108-065a6450c674]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[671e8b9d-e801-4d80-a8db-7b66a82f3608]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] SCSI volumes sde have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIObc4c25d8-c54a4db8ff2794d1', '/dev/disk/by-id/scsi-26335346134646238', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bc4c25d8') {{(pid=86251) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 03:56:49 user nova-compute[74630]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIObc4c25d8-c54a4db8ff2794d1
Oct 26 03:56:49 user nova-compute[74630]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26335346134646238
Oct 26 03:56:49 user nova-compute[74630]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_bc4c25d8
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85ab8f2-010a-4811-9e37-b50d736897bb]: (4, None) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31d8383-29a7-463f-9fd9-1db5e8c3a646]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe61ce1-bdca-4ac0-8ccd-06da7eeae9bb]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12, portal: 172.16.0.220,3260]
Oct 26 03:56:49 user nova-compute[74630]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12, portal: 172.16.0.220,3260] successful.
Oct 26 03:56:49 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:324e6614-0fd0-441c-b09f-8ea83d377e12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c28944d-6b0a-4dde-915d-4b2344e2c42d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== disconnect_volume: return (370ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:56:49 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Deleting instance files /opt/stack/data/nova/instances/f9916c77-4e65-4922-b3a1-1fdc3f7c475e_del
Oct 26 03:56:49 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Deletion of /opt/stack/data/nova/instances/f9916c77-4e65-4922-b3a1-1fdc3f7c475e_del complete
Oct 26 03:56:49 user nova-compute[74630]: INFO nova.compute.manager [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Took 1.35 seconds to destroy the instance on the hypervisor.
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Updating instance_info_cache with network_info: [{"id": "5bfd3672-b1e4-43c9-943f-37333169b430", "address": "fa:16:3e:18:5f:ac", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfd3672-b1", "ovs_interfaceid": "5bfd3672-b1e4-43c9-943f-37333169b430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-dbffcb7f-4576-4250-90a8-cc35f53c1f7b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:56:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:56:50 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:56:50 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Took 0.80 seconds to deallocate network for instance.
Oct 26 03:56:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-9909b4fc-9139-4b03-b510-8758254b5375 req-115da4eb-bf01-4b86-acfa-a0ba2f79aa87 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Received event network-vif-deleted-d520bfbe-3f95-4646-9d13-e2f6813c294d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:56:50 user nova-compute[74630]: INFO nova.compute.manager [req-9909b4fc-9139-4b03-b510-8758254b5375 req-115da4eb-bf01-4b86-acfa-a0ba2f79aa87 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Neutron deleted interface d520bfbe-3f95-4646-9d13-e2f6813c294d; detaching it from the instance and deleting it from the info cache
Oct 26 03:56:50 user nova-compute[74630]: DEBUG nova.network.neutron [req-9909b4fc-9139-4b03-b510-8758254b5375 req-115da4eb-bf01-4b86-acfa-a0ba2f79aa87 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:56:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-9909b4fc-9139-4b03-b510-8758254b5375 req-115da4eb-bf01-4b86-acfa-a0ba2f79aa87 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Detach interface failed, port_id=d520bfbe-3f95-4646-9d13-e2f6813c294d, reason: Instance f9916c77-4e65-4922-b3a1-1fdc3f7c475e could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 03:56:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-8a1aaeac-5d8e-487b-9861-4dc7ad253890 req-d2da3950-2de0-4609-9923-c3fb696c55c6 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Received event network-vif-plugged-d520bfbe-3f95-4646-9d13-e2f6813c294d {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:56:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8a1aaeac-5d8e-487b-9861-4dc7ad253890 req-d2da3950-2de0-4609-9923-c3fb696c55c6 service nova] Acquiring lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8a1aaeac-5d8e-487b-9861-4dc7ad253890 req-d2da3950-2de0-4609-9923-c3fb696c55c6 service nova] Lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8a1aaeac-5d8e-487b-9861-4dc7ad253890 req-d2da3950-2de0-4609-9923-c3fb696c55c6 service nova] Lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:50 user nova-compute[74630]: DEBUG nova.compute.manager [req-8a1aaeac-5d8e-487b-9861-4dc7ad253890 req-d2da3950-2de0-4609-9923-c3fb696c55c6 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] No waiting events found dispatching network-vif-plugged-d520bfbe-3f95-4646-9d13-e2f6813c294d {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:56:50 user nova-compute[74630]: WARNING nova.compute.manager [req-8a1aaeac-5d8e-487b-9861-4dc7ad253890 req-d2da3950-2de0-4609-9923-c3fb696c55c6 service nova] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Received unexpected event network-vif-plugged-d520bfbe-3f95-4646-9d13-e2f6813c294d for instance with vm_state active and task_state deleting.
Oct 26 03:56:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:56:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:56:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74630) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 03:56:51 user nova-compute[74630]: INFO nova.compute.manager [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Took 0.97 seconds to detach 1 volumes for instance.
Oct 26 03:56:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9916c77-4e65-4922-b3a1-1fdc3f7c475e] Deleting volume: 324e6614-0fd0-441c-b09f-8ea83d377e12 {{(pid=74630) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 03:56:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:51 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:56:51 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:56:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:51 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Deleted allocations for instance f9916c77-4e65-4922-b3a1-1fdc3f7c475e
Oct 26 03:56:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-962d5d2c-13f2-45f3-9894-1c5aacbcc60f tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "f9916c77-4e65-4922-b3a1-1fdc3f7c475e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.607s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:52 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:56:52 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:56:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:56:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:56:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:56:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:56:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:56:52 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:56:52 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:56:52 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8728MB free_disk=24.967609405517578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:56:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:56:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:56:53 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance dbffcb7f-4576-4250-90a8-cc35f53c1f7b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:56:53 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 049abd73-381a-41d4-b0f8-134d1e7831c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:56:53 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:56:53 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:56:53 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:56:53 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:56:53 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:56:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:56:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:56:57 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:56:57 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:56:58 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:57:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:57:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:57:14 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid dbffcb7f-4576-4250-90a8-cc35f53c1f7b {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:57:14 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid 049abd73-381a-41d4-b0f8-134d1e7831c6 {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 03:57:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:57:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:57:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:57:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:57:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:57:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:57:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:57:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:57:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:57:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:57:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:57:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:57:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:57:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:57:35 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:57:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-616da946-50c7-4a8f-89f4-22d28444a064 req-93d38e07-0141-4d48-8c77-06ba764a25fb service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received event network-changed-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:57:37 user nova-compute[74630]: DEBUG nova.compute.manager [req-616da946-50c7-4a8f-89f4-22d28444a064 req-93d38e07-0141-4d48-8c77-06ba764a25fb service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Refreshing instance network info cache due to event network-changed-b3a6726e-9121-438a-932f-0b702074e093. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:57:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-616da946-50c7-4a8f-89f4-22d28444a064 req-93d38e07-0141-4d48-8c77-06ba764a25fb service nova] Acquiring lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:57:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-616da946-50c7-4a8f-89f4-22d28444a064 req-93d38e07-0141-4d48-8c77-06ba764a25fb service nova] Acquired lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:57:37 user nova-compute[74630]: DEBUG nova.network.neutron [req-616da946-50c7-4a8f-89f4-22d28444a064 req-93d38e07-0141-4d48-8c77-06ba764a25fb service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Refreshing network info cache for port b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:57:38 user nova-compute[74630]: DEBUG nova.network.neutron [req-616da946-50c7-4a8f-89f4-22d28444a064 req-93d38e07-0141-4d48-8c77-06ba764a25fb service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updated VIF entry in instance network info cache for port b3a6726e-9121-438a-932f-0b702074e093. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:57:38 user nova-compute[74630]: DEBUG nova.network.neutron [req-616da946-50c7-4a8f-89f4-22d28444a064 req-93d38e07-0141-4d48-8c77-06ba764a25fb service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updating instance_info_cache with network_info: [{"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:57:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-616da946-50c7-4a8f-89f4-22d28444a064 req-93d38e07-0141-4d48-8c77-06ba764a25fb service nova] Releasing lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:57:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:39 user nova-compute[74630]: DEBUG nova.compute.manager [req-8752f070-e2e2-41d3-9e7d-bfbdd66f089f req-336568be-5a82-44cc-8f7c-72447ec0d06c service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received event network-changed-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:57:39 user nova-compute[74630]: DEBUG nova.compute.manager [req-8752f070-e2e2-41d3-9e7d-bfbdd66f089f req-336568be-5a82-44cc-8f7c-72447ec0d06c service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Refreshing instance network info cache due to event network-changed-b3a6726e-9121-438a-932f-0b702074e093. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:57:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8752f070-e2e2-41d3-9e7d-bfbdd66f089f req-336568be-5a82-44cc-8f7c-72447ec0d06c service nova] Acquiring lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:57:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8752f070-e2e2-41d3-9e7d-bfbdd66f089f req-336568be-5a82-44cc-8f7c-72447ec0d06c service nova] Acquired lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:57:39 user nova-compute[74630]: DEBUG nova.network.neutron [req-8752f070-e2e2-41d3-9e7d-bfbdd66f089f req-336568be-5a82-44cc-8f7c-72447ec0d06c service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Refreshing network info cache for port b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:57:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:57:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:57:39 user nova-compute[74630]: INFO nova.compute.manager [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Detaching volume 03f68da1-0968-43d0-b2ad-4266e446cbde
Oct 26 03:57:39 user nova-compute[74630]: INFO nova.virt.block_device [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Attempting to driver detach volume 03f68da1-0968-43d0-b2ad-4266e446cbde from mountpoint /dev/vdb
Oct 26 03:57:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Attempting to detach device vdb from instance 049abd73-381a-41d4-b0f8-134d1e7831c6 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 03:57:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:57:39 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:57:39 user nova-compute[74630]:   <source dev="/dev/sdd"/>
Oct 26 03:57:39 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:57:39 user nova-compute[74630]:   <serial>03f68da1-0968-43d0-b2ad-4266e446cbde</serial>
Oct 26 03:57:39 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 03:57:39 user nova-compute[74630]: </disk>
Oct 26 03:57:39 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:57:39 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Successfully detached device vdb from instance 049abd73-381a-41d4-b0f8-134d1e7831c6 from the persistent domain config.
Oct 26 03:57:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 049abd73-381a-41d4-b0f8-134d1e7831c6 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 03:57:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 03:57:39 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:57:39 user nova-compute[74630]:   <source dev="/dev/sdd"/>
Oct 26 03:57:39 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 03:57:39 user nova-compute[74630]:   <serial>03f68da1-0968-43d0-b2ad-4266e446cbde</serial>
Oct 26 03:57:39 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 03:57:39 user nova-compute[74630]: </disk>
Oct 26 03:57:39 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 03:57:39 user nova-compute[74630]: DEBUG nova.network.neutron [req-8752f070-e2e2-41d3-9e7d-bfbdd66f089f req-336568be-5a82-44cc-8f7c-72447ec0d06c service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updated VIF entry in instance network info cache for port b3a6726e-9121-438a-932f-0b702074e093. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:57:39 user nova-compute[74630]: DEBUG nova.network.neutron [req-8752f070-e2e2-41d3-9e7d-bfbdd66f089f req-336568be-5a82-44cc-8f7c-72447ec0d06c service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updating instance_info_cache with network_info: [{"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:57:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-8752f070-e2e2-41d3-9e7d-bfbdd66f089f req-336568be-5a82-44cc-8f7c-72447ec0d06c service nova] Releasing lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:57:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 049abd73-381a-41d4-b0f8-134d1e7831c6 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 03:57:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:57:49 user nova-compute[74630]: INFO nova.compute.manager [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Terminating instance
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-161ee3d8-6fc0-4acb-b2eb-844aa7a54b13 req-9c1d3bbf-95db-42e3-9dff-1a2ecbc47efc service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Received event network-vif-unplugged-5bfd3672-b1e4-43c9-943f-37333169b430 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-161ee3d8-6fc0-4acb-b2eb-844aa7a54b13 req-9c1d3bbf-95db-42e3-9dff-1a2ecbc47efc service nova] Acquiring lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-161ee3d8-6fc0-4acb-b2eb-844aa7a54b13 req-9c1d3bbf-95db-42e3-9dff-1a2ecbc47efc service nova] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-161ee3d8-6fc0-4acb-b2eb-844aa7a54b13 req-9c1d3bbf-95db-42e3-9dff-1a2ecbc47efc service nova] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-161ee3d8-6fc0-4acb-b2eb-844aa7a54b13 req-9c1d3bbf-95db-42e3-9dff-1a2ecbc47efc service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] No waiting events found dispatching network-vif-unplugged-5bfd3672-b1e4-43c9-943f-37333169b430 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-161ee3d8-6fc0-4acb-b2eb-844aa7a54b13 req-9c1d3bbf-95db-42e3-9dff-1a2ecbc47efc service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Received event network-vif-unplugged-5bfd3672-b1e4-43c9-943f-37333169b430 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updating instance_info_cache with network_info: [{"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-049abd73-381a-41d4-b0f8-134d1e7831c6" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:49 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Instance destroyed successfully.
Oct 26 03:57:49 user nova-compute[74630]: DEBUG nova.objects.instance [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lazy-loading 'resources' on Instance uuid dbffcb7f-4576-4250-90a8-cc35f53c1f7b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1456813116',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1456813116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1456813116',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/IVmu+ou6AKImS9aJb2Ft0KVbP3gB0OaVHt5mmafdPVyf9cptYchOxS6NuE8PB2WxM4HEwmO/OlvgixfNWsQSrKXqYXiW3PRpIGewkVnCkPQ+xM4LpDaUeDyzDEV4ABg==',key_name='tempest-keypair-791550511',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:53:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-8cx1ed50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:53:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3bd794500243df86a1e4e89414bea0',uuid=dbffcb7f-4576-4250-90a8-cc35f53c1f7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bfd3672-b1e4-43c9-943f-37333169b430", "address": "fa:16:3e:18:5f:ac", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfd3672-b1", "ovs_interfaceid": "5bfd3672-b1e4-43c9-943f-37333169b430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "5bfd3672-b1e4-43c9-943f-37333169b430", "address": "fa:16:3e:18:5f:ac", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bfd3672-b1", "ovs_interfaceid": "5bfd3672-b1e4-43c9-943f-37333169b430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:5f:ac,bridge_name='br-int',has_traffic_filtering=True,id=5bfd3672-b1e4-43c9-943f-37333169b430,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfd3672-b1') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG os_vif [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:5f:ac,bridge_name='br-int',has_traffic_filtering=True,id=5bfd3672-b1e4-43c9-943f-37333169b430,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfd3672-b1') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bfd3672-b1, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbf70e6f-287c-4c6c-9e07-de269ba617b9) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:57:49 user nova-compute[74630]: INFO os_vif [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:5f:ac,bridge_name='br-int',has_traffic_filtering=True,id=5bfd3672-b1e4-43c9-943f-37333169b430,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bfd3672-b1')
Oct 26 03:57:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ryJnlAck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:57:49 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:57:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[756c88fd-9731-4dd7-bebd-31e84153e4b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:57:49 user nova-compute[74630]: No targets found.
Oct 26 03:57:49 user nova-compute[74630]: iSNS:
Oct 26 03:57:49 user nova-compute[74630]: No targets found.
Oct 26 03:57:49 user nova-compute[74630]: STATIC:
Oct 26 03:57:49 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde
Oct 26 03:57:49 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:57:49 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:57:49 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac
Oct 26 03:57:49 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:57:49 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:57:49 user nova-compute[74630]: FIRMWARE:
Oct 26 03:57:49 user nova-compute[74630]: No targets found.
Oct 26 03:57:49 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:57:49 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:57:49 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bea7ba-d489-44ae-8971-1d104c539261]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf599420-eb22-485b-98c0-ba045633a56d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:57:49 user nova-compute[74630]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:57:49 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:57:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac (non-flash)
Oct 26 03:57:49 user nova-compute[74630]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:57:49 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f315c721fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd5976a-2ab6-4733-87c7-a6f6cd8a4835]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ab6239-d9c3-47a2-b737-df8249870508]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b70bfc-e18d-4a80-ae10-da31b1d2a73b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cec122-10dc-40ff-8d88-24a2629b38d7]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f78b6047', '/dev/disk/by-id/scsi-1SCST_BIOf78b6047-7380489e8f791ad6', '/dev/disk/by-id/scsi-23733383034383965') {{(pid=86251) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a834ef-57c8-4d8b-bab8-5a0ebe21d127]: (4, None) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abe8edb-7d26-4cf2-a6d0-28d693e69e6f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3593e13-b222-48cc-9593-28e99d414b43]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac, portal: 172.16.0.220,3260]
Oct 26 03:57:50 user nova-compute[74630]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac, portal: 172.16.0.220,3260] successful.
Oct 26 03:57:50 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c82c3b76-e464-46db-8615-35e5814dc7ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7297bcec-aa38-49d6-b6b3-d9f3b3926c42]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== disconnect_volume: return (351ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:57:50 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Deleting instance files /opt/stack/data/nova/instances/dbffcb7f-4576-4250-90a8-cc35f53c1f7b_del
Oct 26 03:57:50 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Deletion of /opt/stack/data/nova/instances/dbffcb7f-4576-4250-90a8-cc35f53c1f7b_del complete
Oct 26 03:57:50 user nova-compute[74630]: INFO nova.compute.manager [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Took 1.29 seconds to destroy the instance on the hypervisor.
Oct 26 03:57:50 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:57:50 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:57:51 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:57:51 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Took 0.70 seconds to deallocate network for instance.
Oct 26 03:57:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-2bd261ef-82ba-495f-851f-b844bdea48d2 req-f09a579c-e722-49b0-948b-4d21382a297f service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Received event network-vif-deleted-5bfd3672-b1e4-43c9-943f-37333169b430 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:57:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-9539a9ad-6076-4748-893d-72ad79cb3624 req-77df5937-68b8-4ca9-95c2-3e9233da7966 service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Received event network-vif-plugged-5bfd3672-b1e4-43c9-943f-37333169b430 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:57:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9539a9ad-6076-4748-893d-72ad79cb3624 req-77df5937-68b8-4ca9-95c2-3e9233da7966 service nova] Acquiring lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:57:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9539a9ad-6076-4748-893d-72ad79cb3624 req-77df5937-68b8-4ca9-95c2-3e9233da7966 service nova] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:57:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9539a9ad-6076-4748-893d-72ad79cb3624 req-77df5937-68b8-4ca9-95c2-3e9233da7966 service nova] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:57:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-9539a9ad-6076-4748-893d-72ad79cb3624 req-77df5937-68b8-4ca9-95c2-3e9233da7966 service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] No waiting events found dispatching network-vif-plugged-5bfd3672-b1e4-43c9-943f-37333169b430 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:57:51 user nova-compute[74630]: WARNING nova.compute.manager [req-9539a9ad-6076-4748-893d-72ad79cb3624 req-77df5937-68b8-4ca9-95c2-3e9233da7966 service nova] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Received unexpected event network-vif-plugged-5bfd3672-b1e4-43c9-943f-37333169b430 for instance with vm_state active and task_state deleting.
Oct 26 03:57:52 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:57:52 user nova-compute[74630]: INFO nova.compute.manager [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Took 1.24 seconds to detach 1 volumes for instance.
Oct 26 03:57:52 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: dbffcb7f-4576-4250-90a8-cc35f53c1f7b] Deleting volume: c82c3b76-e464-46db-8615-35e5814dc7ac {{(pid=74630) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 03:57:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:57:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:57:52 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Refreshing inventories for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 03:57:52 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Updating ProviderTree inventory for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 03:57:52 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Updating inventory in ProviderTree for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 03:57:52 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Refreshing aggregate associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, aggregates: None {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 03:57:52 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Refreshing trait associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, traits: HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 03:57:52 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:57:52 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:57:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:57:52 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Deleted allocations for instance dbffcb7f-4576-4250-90a8-cc35f53c1f7b
Oct 26 03:57:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7008b2cd-e309-4a6a-95ae-6934986a39ae tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "dbffcb7f-4576-4250-90a8-cc35f53c1f7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:57:53 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:57:54 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:57:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:57:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:57:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:57:54 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:57:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:54 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:57:54 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:57:54 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8865MB free_disk=24.965999603271484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:57:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:57:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:57:55 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 049abd73-381a-41d4-b0f8-134d1e7831c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:57:55 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:57:55 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:57:55 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:57:55 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:57:55 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:57:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:57:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:57:59 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 049abd73-381a-41d4-b0f8-134d1e7831c6 is timed out.
Oct 26 03:57:59 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Successfully detached device vdb from instance 049abd73-381a-41d4-b0f8-134d1e7831c6 from the live domain config.
Oct 26 03:57:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muTPnNhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:57:59 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:57:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca06ab3-0d34-4026-be43-a4ccd5928da7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 03:57:59 user nova-compute[74630]: No targets found.
Oct 26 03:57:59 user nova-compute[74630]: iSNS:
Oct 26 03:57:59 user nova-compute[74630]: No targets found.
Oct 26 03:57:59 user nova-compute[74630]: STATIC:
Oct 26 03:57:59 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde
Oct 26 03:57:59 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 03:57:59 user nova-compute[74630]:                 Iface Name: default
Oct 26 03:57:59 user nova-compute[74630]: FIRMWARE:
Oct 26 03:57:59 user nova-compute[74630]: No targets found.
Oct 26 03:57:59 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 03:57:59 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 03:57:59 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[08afe63b-5995-4722-8c87-ef8fc9974ffb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d31c82-e3d3-4c67-9b92-5bd4d4707aad]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:57:59 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde (non-flash)
Oct 26 03:57:59 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c32f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde'): ({'sdd'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Removing single pathed devices sdd {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dd1555-539e-4823-a2f6-2213855f81b0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:57:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfc7055-9853-4cd4-a58c-61d0b381aaf3]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Flushing IO for device /dev/sdd {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ebb89f-59b8-4455-89ad-3b1d3526411d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[367aed34-74c3-4b54-b29c-5cc6cbbbe0a4]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e159f3-e9fb-4f1e-9715-3229a2995687]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[90944f22-ea7e-41b7-9d21-aaf42bce5bb2]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260]
Oct 26 03:58:00 user nova-compute[74630]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde, portal: 172.16.0.220,3260] successful.
Oct 26 03:58:00 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f68da1-0968-43d0-b2ad-4266e446cbde -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3417859c-3bed-4736-9a3c-abe8c4497a4f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] <== disconnect_volume: return (281ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:58:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 03:58:01 user nova-compute[74630]: DEBUG nova.objects.instance [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lazy-loading 'flavor' on Instance uuid 049abd73-381a-41d4-b0f8-134d1e7831c6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:58:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2f309a7e-252d-4c24-b942-2db03470fe45 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.931s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:58:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:58:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:58:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:58:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:58:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:58:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:58:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:58:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:58:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:58:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:58:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:58:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:58:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:58:39 user nova-compute[74630]: INFO nova.compute.manager [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Terminating instance
Oct 26 03:58:39 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG nova.compute.manager [req-cbe6516e-d0f0-4b7d-9e36-137c5af92872 req-e9d3bf34-42f2-4790-b9ec-5197c0d07e57 service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received event network-vif-unplugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cbe6516e-d0f0-4b7d-9e36-137c5af92872 req-e9d3bf34-42f2-4790-b9ec-5197c0d07e57 service nova] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cbe6516e-d0f0-4b7d-9e36-137c5af92872 req-e9d3bf34-42f2-4790-b9ec-5197c0d07e57 service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-cbe6516e-d0f0-4b7d-9e36-137c5af92872 req-e9d3bf34-42f2-4790-b9ec-5197c0d07e57 service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG nova.compute.manager [req-cbe6516e-d0f0-4b7d-9e36-137c5af92872 req-e9d3bf34-42f2-4790-b9ec-5197c0d07e57 service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] No waiting events found dispatching network-vif-unplugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG nova.compute.manager [req-cbe6516e-d0f0-4b7d-9e36-137c5af92872 req-e9d3bf34-42f2-4790-b9ec-5197c0d07e57 service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received event network-vif-unplugged-b3a6726e-9121-438a-932f-0b702074e093 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:40 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Instance destroyed successfully.
Oct 26 03:58:40 user nova-compute[74630]: DEBUG nova.objects.instance [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lazy-loading 'resources' on Instance uuid 049abd73-381a-41d4-b0f8-134d1e7831c6 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1826431466',display_name='tempest-TestMinimumBasicScenario-server-1826431466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1826431466',id=45,image_ref='0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9PtsTGh9gB8alIhq2RBBVboT0aSZb4GGsQtL10//ZVj77mrh4abPILIw+2mfKhxGr627QmbI7upZLcQ+fEInO7yLMoi2WxKOylmH37Yw/29cfE3Vi3+dylDH0gGbwKeg==',key_name='tempest-TestMinimumBasicScenario-683470242',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:53:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d280a7d3a82455f9929dea5a753861c',ramdisk_id='',reservation_id='r-8wfzyv88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ac0f755-a8e8-4c79-b13a-5b0ff88d49e5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1824331495',owner_user_name='tempest-TestMinimumBasicScenario-1824331495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:55:54Z,user_data=None,user_id='550739bc40d54768ba62e194386d0857',uuid=049abd73-381a-41d4-b0f8-134d1e7831c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converting VIF {"id": "b3a6726e-9121-438a-932f-0b702074e093", "address": "fa:16:3e:3b:69:2f", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3a6726e-91", "ovs_interfaceid": "b3a6726e-9121-438a-932f-0b702074e093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:69:2f,bridge_name='br-int',has_traffic_filtering=True,id=b3a6726e-9121-438a-932f-0b702074e093,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a6726e-91') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG os_vif [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:69:2f,bridge_name='br-int',has_traffic_filtering=True,id=b3a6726e-9121-438a-932f-0b702074e093,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a6726e-91') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3a6726e-91, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9cfba9c-3bc9-46f7-b61d-36bf49769731) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:40 user nova-compute[74630]: INFO os_vif [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:69:2f,bridge_name='br-int',has_traffic_filtering=True,id=b3a6726e-9121-438a-932f-0b702074e093,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3a6726e-91')
Oct 26 03:58:40 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Deleting instance files /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6_del
Oct 26 03:58:40 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Deletion of /opt/stack/data/nova/instances/049abd73-381a-41d4-b0f8-134d1e7831c6_del complete
Oct 26 03:58:40 user nova-compute[74630]: INFO nova.compute.manager [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 26 03:58:40 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:58:40 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Took 0.47 seconds to deallocate network for instance.
Oct 26 03:58:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-96fa57f4-62f6-4d18-b804-a5ae1b37d949 req-b20f6b79-9d77-4a24-89bb-f014e7c58054 service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received event network-vif-deleted-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:58:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:58:40 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Deleted allocations for instance 049abd73-381a-41d4-b0f8-134d1e7831c6
Oct 26 03:58:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d36d2f03-13f3-4fbf-a9c8-bf39f46a1fc3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.720s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:58:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-de0578b7-f23e-4e89-b39a-55f0492ca8dc req-76fe6e1f-770a-4972-921b-80f972d1432c service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received event network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:58:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-de0578b7-f23e-4e89-b39a-55f0492ca8dc req-76fe6e1f-770a-4972-921b-80f972d1432c service nova] Acquiring lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:58:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-de0578b7-f23e-4e89-b39a-55f0492ca8dc req-76fe6e1f-770a-4972-921b-80f972d1432c service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:58:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-de0578b7-f23e-4e89-b39a-55f0492ca8dc req-76fe6e1f-770a-4972-921b-80f972d1432c service nova] Lock "049abd73-381a-41d4-b0f8-134d1e7831c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:58:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-de0578b7-f23e-4e89-b39a-55f0492ca8dc req-76fe6e1f-770a-4972-921b-80f972d1432c service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] No waiting events found dispatching network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:58:41 user nova-compute[74630]: WARNING nova.compute.manager [req-de0578b7-f23e-4e89-b39a-55f0492ca8dc req-76fe6e1f-770a-4972-921b-80f972d1432c service nova] [instance: 049abd73-381a-41d4-b0f8-134d1e7831c6] Received unexpected event network-vif-plugged-b3a6726e-9121-438a-932f-0b702074e093 for instance with vm_state deleted and task_state None.
Oct 26 03:58:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:58:50 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:58:50 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:58:50 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:58:50 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:58:50 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 03:58:50 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:58:50 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:58:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:58:53 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:58:53 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:58:55 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:58:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:58:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:58:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:58:55 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:58:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:58:55 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:58:55 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:58:55 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=24.98318862915039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:58:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:58:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:58:55 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:58:55 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:58:55 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:58:55 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:58:55 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:58:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:58:59 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:58:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "ab2ecfc0-e231-404f-994a-013c0eef007a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:58:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "ab2ecfc0-e231-404f-994a-013c0eef007a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:58:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:58:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:58:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:58:59 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:58:59 user nova-compute[74630]: INFO nova.compute.claims [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Claim successful on node user
Oct 26 03:59:00 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:59:00 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:59:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG nova.policy [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b3bd794500243df86a1e4e89414bea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbe37117ca24935b46795e7f7479af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:59:00 user nova-compute[74630]: INFO nova.virt.block_device [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Booting with volume 3a3f0821-dbcb-4506-9894-44f41a671fc1 at /dev/vda
Oct 26 03:59:00 user nova-compute[74630]: DEBUG os_brick.utils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1beceb-0677-4f9e-bb1c-78db17b0569c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b758567a-a36b-4a6a-85a9-2434161ed879]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1d7a7c-1b0a-4b96-b5c2-9fe81e2f40c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5a368a-226e-4da3-b051-cc597ac9b513]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 03:59:00 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 03:59:00 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f31d44-16ff-4b19-b84e-da8ac4cbc3cf]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG os_brick.utils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:59:00 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Updating existing volume attachment record: fd795fd3-109d-4c01-8048-07fe4ddab5d4 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 03:59:01 user nova-compute[74630]: DEBUG nova.network.neutron [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Successfully created port: 95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:59:01 user nova-compute[74630]: DEBUG nova.network.neutron [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Successfully updated port: 95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:59:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "refresh_cache-ab2ecfc0-e231-404f-994a-013c0eef007a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:59:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquired lock "refresh_cache-ab2ecfc0-e231-404f-994a-013c0eef007a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:59:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:59:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-c18b5150-bccb-4cdc-afcb-aad4a823b3e3 req-bebfc38d-de0b-4632-a173-d7d922523145 service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Received event network-changed-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:59:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-c18b5150-bccb-4cdc-afcb-aad4a823b3e3 req-bebfc38d-de0b-4632-a173-d7d922523145 service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Refreshing instance network info cache due to event network-changed-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:59:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c18b5150-bccb-4cdc-afcb-aad4a823b3e3 req-bebfc38d-de0b-4632-a173-d7d922523145 service nova] Acquiring lock "refresh_cache-ab2ecfc0-e231-404f-994a-013c0eef007a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:59:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:59:02 user nova-compute[74630]: DEBUG nova.network.neutron [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Updating instance_info_cache with network_info: [{"id": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "address": "fa:16:3e:b7:3f:e8", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d9fe7c-7d", "ovs_interfaceid": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:59:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Releasing lock "refresh_cache-ab2ecfc0-e231-404f-994a-013c0eef007a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:59:02 user nova-compute[74630]: DEBUG nova.compute.manager [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Instance network_info: |[{"id": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "address": "fa:16:3e:b7:3f:e8", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d9fe7c-7d", "ovs_interfaceid": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:59:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c18b5150-bccb-4cdc-afcb-aad4a823b3e3 req-bebfc38d-de0b-4632-a173-d7d922523145 service nova] Acquired lock "refresh_cache-ab2ecfc0-e231-404f-994a-013c0eef007a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:59:02 user nova-compute[74630]: DEBUG nova.network.neutron [req-c18b5150-bccb-4cdc-afcb-aad4a823b3e3 req-bebfc38d-de0b-4632-a173-d7d922523145 service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Refreshing network info cache for port 95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:59:02 user nova-compute[74630]: DEBUG nova.network.neutron [req-c18b5150-bccb-4cdc-afcb-aad4a823b3e3 req-bebfc38d-de0b-4632-a173-d7d922523145 service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Updated VIF entry in instance network info cache for port 95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 03:59:02 user nova-compute[74630]: DEBUG nova.network.neutron [req-c18b5150-bccb-4cdc-afcb-aad4a823b3e3 req-bebfc38d-de0b-4632-a173-d7d922523145 service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Updating instance_info_cache with network_info: [{"id": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "address": "fa:16:3e:b7:3f:e8", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d9fe7c-7d", "ovs_interfaceid": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:59:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c18b5150-bccb-4cdc-afcb-aad4a823b3e3 req-bebfc38d-de0b-4632-a173-d7d922523145 service nova] Releasing lock "refresh_cache-ab2ecfc0-e231-404f-994a-013c0eef007a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:59:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:59:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:59:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:59:17 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Creating image(s)
Oct 26 03:59:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 03:59:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Ensure instance console log exists: /opt/stack/data/nova/instances/ab2ecfc0-e231-404f-994a-013c0eef007a/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:59:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:59:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:59:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:59:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Start _get_guest_xml network_info=[{"id": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "address": "fa:16:3e:b7:3f:e8", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d9fe7c-7d", "ovs_interfaceid": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqetYOCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab2ecfc0-e231-404f-994a-013c0eef007a', 'attached_at': '', 'detached_at': '', 'volume_id': '3a3f0821-dbcb-4506-9894-44f41a671fc1', 'serial': '3a3f0821-dbcb-4506-9894-44f41a671fc1'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'fd795fd3-109d-4c01-8048-07fe4ddab5d4', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:59:18 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:59:18 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqetYOCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 03:59:18 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:59:18 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 03:59:18 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[828b0324-9776-49c8-bda0-a273decb35e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 03:59:18 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1691700d-7279-434c-9455-742e7bc6ac4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1] added
Oct 26 03:59:18 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64bdab9-8120-48e9-8b0a-24487f79a33d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8572b873-0d71-4a47-904b-7f102294e612]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqetYOCx {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqetYOCx" returned: 0 in 0.027s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[700702ac-e5ed-43ba-89dd-0c0ab07b30d5]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HqetYOCx'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[24437234-d808-4b33-b888-7cad023c2bf5]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0d2d34-4b31-4846-b5e2-797c4d5401b0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 03:59:18 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 03:59:18 user nova-compute[74630]:  {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:59:18 user nova-compute[74630]: WARNING os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 03:59:18 user nova-compute[74630]: 
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2f105e-f32a-464f-8ced-f35691c20747]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260]
Oct 26 03:59:18 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260] successful.
Oct 26 03:59:18 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0e7096-87d1-4545-b871-0eb2d20c7b42]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58dbf6d-05db-4595-9135-9fc0b4eb9fff]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 03:59:18 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 03:59:18 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c953ed3c-cda3-40ad-8b77-926ca9384306]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 03:59:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqetYOCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26138353739613934', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138353739613934', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1473460262',display_name='tempest-TestVolumeBootPattern-server-1473460262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1473460262',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/SIDPQ2UP+8pjr/EDeG7jiIvKtw4wxC8wOR9Ppgf68vzwgAsuUEGb0qigXIxPbeQGiuT7fPQKbEvjMZRXhfqo9CTc8iDOme/8ss3+oEiY5W1hrK42wG17Y5enspUZi+A==',key_name='tempest-TestVolumeBootPattern-1850034835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-3124g8gb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:59:00Z,user_data=None,user_id='3b3bd794500243df86a1e4e89414bea0',uuid=ab2ecfc0-e231-404f-994a-013c0eef007a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "address": "fa:16:3e:b7:3f:e8", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d9fe7c-7d", "ovs_interfaceid": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "address": "fa:16:3e:b7:3f:e8", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d9fe7c-7d", "ovs_interfaceid": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:3f:e8,bridge_name='br-int',has_traffic_filtering=True,id=95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d9fe7c-7d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG nova.objects.instance [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lazy-loading 'pci_devices' on Instance uuid ab2ecfc0-e231-404f-994a-013c0eef007a {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:59:19 user nova-compute[74630]:   <uuid>ab2ecfc0-e231-404f-994a-013c0eef007a</uuid>
Oct 26 03:59:19 user nova-compute[74630]:   <name>instance-0000002f</name>
Oct 26 03:59:19 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:59:19 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:59:19 user nova-compute[74630]:   <metadata>
Oct 26 03:59:19 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:59:19 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:59:19 user nova-compute[74630]:       <nova:name>tempest-TestVolumeBootPattern-server-1473460262</nova:name>
Oct 26 03:59:19 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:59:18</nova:creationTime>
Oct 26 03:59:19 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:59:19 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:59:19 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:59:19 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:59:19 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:59:19 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:59:19 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:59:19 user nova-compute[74630]:       <nova:owner>
Oct 26 03:59:19 user nova-compute[74630]:         <nova:user uuid="3b3bd794500243df86a1e4e89414bea0">tempest-TestVolumeBootPattern-1203294393-project-member</nova:user>
Oct 26 03:59:19 user nova-compute[74630]:         <nova:project uuid="4dbe37117ca24935b46795e7f7479af9">tempest-TestVolumeBootPattern-1203294393</nova:project>
Oct 26 03:59:19 user nova-compute[74630]:       </nova:owner>
Oct 26 03:59:19 user nova-compute[74630]:       <nova:ports>
Oct 26 03:59:19 user nova-compute[74630]:         <nova:port uuid="95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac">
Oct 26 03:59:19 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 03:59:19 user nova-compute[74630]:         </nova:port>
Oct 26 03:59:19 user nova-compute[74630]:       </nova:ports>
Oct 26 03:59:19 user nova-compute[74630]:     </nova:instance>
Oct 26 03:59:19 user nova-compute[74630]:   </metadata>
Oct 26 03:59:19 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:59:19 user nova-compute[74630]:     <system>
Oct 26 03:59:19 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:59:19 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:59:19 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:59:19 user nova-compute[74630]:       <entry name="serial">ab2ecfc0-e231-404f-994a-013c0eef007a</entry>
Oct 26 03:59:19 user nova-compute[74630]:       <entry name="uuid">ab2ecfc0-e231-404f-994a-013c0eef007a</entry>
Oct 26 03:59:19 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:59:19 user nova-compute[74630]:     </system>
Oct 26 03:59:19 user nova-compute[74630]:   </sysinfo>
Oct 26 03:59:19 user nova-compute[74630]:   <os>
Oct 26 03:59:19 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:59:19 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:59:19 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:59:19 user nova-compute[74630]:   </os>
Oct 26 03:59:19 user nova-compute[74630]:   <features>
Oct 26 03:59:19 user nova-compute[74630]:     <acpi/>
Oct 26 03:59:19 user nova-compute[74630]:     <apic/>
Oct 26 03:59:19 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:59:19 user nova-compute[74630]:   </features>
Oct 26 03:59:19 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:59:19 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:59:19 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:59:19 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:59:19 user nova-compute[74630]:   </clock>
Oct 26 03:59:19 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:59:19 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:59:19 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:59:19 user nova-compute[74630]:   </cpu>
Oct 26 03:59:19 user nova-compute[74630]:   <devices>
Oct 26 03:59:19 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 03:59:19 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 03:59:19 user nova-compute[74630]:       <source dev="/dev/sdb"/>
Oct 26 03:59:19 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:59:19 user nova-compute[74630]:       <serial>3a3f0821-dbcb-4506-9894-44f41a671fc1</serial>
Oct 26 03:59:19 user nova-compute[74630]:     </disk>
Oct 26 03:59:19 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:59:19 user nova-compute[74630]:       <mac address="fa:16:3e:b7:3f:e8"/>
Oct 26 03:59:19 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:59:19 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:59:19 user nova-compute[74630]:       <target dev="tap95d9fe7c-7d"/>
Oct 26 03:59:19 user nova-compute[74630]:     </interface>
Oct 26 03:59:19 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:59:19 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/ab2ecfc0-e231-404f-994a-013c0eef007a/console.log" append="off"/>
Oct 26 03:59:19 user nova-compute[74630]:     </serial>
Oct 26 03:59:19 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:59:19 user nova-compute[74630]:     <video>
Oct 26 03:59:19 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:59:19 user nova-compute[74630]:     </video>
Oct 26 03:59:19 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:59:19 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:59:19 user nova-compute[74630]:     </rng>
Oct 26 03:59:19 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:59:19 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:59:19 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:59:19 user nova-compute[74630]:     </memballoon>
Oct 26 03:59:19 user nova-compute[74630]:   </devices>
Oct 26 03:59:19 user nova-compute[74630]: </domain>
Oct 26 03:59:19 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1473460262',display_name='tempest-TestVolumeBootPattern-server-1473460262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1473460262',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/SIDPQ2UP+8pjr/EDeG7jiIvKtw4wxC8wOR9Ppgf68vzwgAsuUEGb0qigXIxPbeQGiuT7fPQKbEvjMZRXhfqo9CTc8iDOme/8ss3+oEiY5W1hrK42wG17Y5enspUZi+A==',key_name='tempest-TestVolumeBootPattern-1850034835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-3124g8gb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:59:00Z,user_data=None,user_id='3b3bd794500243df86a1e4e89414bea0',uuid=ab2ecfc0-e231-404f-994a-013c0eef007a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "address": "fa:16:3e:b7:3f:e8", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d9fe7c-7d", "ovs_interfaceid": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "address": "fa:16:3e:b7:3f:e8", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d9fe7c-7d", "ovs_interfaceid": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:3f:e8,bridge_name='br-int',has_traffic_filtering=True,id=95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d9fe7c-7d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG os_vif [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:3f:e8,bridge_name='br-int',has_traffic_filtering=True,id=95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d9fe7c-7d') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd6bf345-c580-5942-bd9c-3f188ca4d33f', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95d9fe7c-7d, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95d9fe7c-7d, col_values=(('qos', UUID('3a134838-0606-4796-9349-d52f4bd25d55')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95d9fe7c-7d, col_values=(('external_ids', {'iface-id': '95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:3f:e8', 'vm-uuid': 'ab2ecfc0-e231-404f-994a-013c0eef007a'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:19 user nova-compute[74630]: INFO os_vif [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:3f:e8,bridge_name='br-int',has_traffic_filtering=True,id=95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d9fe7c-7d')
Oct 26 03:59:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:59:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] No VIF found with MAC fa:16:3e:b7:3f:e8, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:59:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-37069d45-be94-452f-b964-16e430378ed5 req-a8382027-56fd-4e77-af66-11bb3fbd8e95 service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Received event network-vif-plugged-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:59:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-37069d45-be94-452f-b964-16e430378ed5 req-a8382027-56fd-4e77-af66-11bb3fbd8e95 service nova] Acquiring lock "ab2ecfc0-e231-404f-994a-013c0eef007a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:59:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-37069d45-be94-452f-b964-16e430378ed5 req-a8382027-56fd-4e77-af66-11bb3fbd8e95 service nova] Lock "ab2ecfc0-e231-404f-994a-013c0eef007a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:59:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-37069d45-be94-452f-b964-16e430378ed5 req-a8382027-56fd-4e77-af66-11bb3fbd8e95 service nova] Lock "ab2ecfc0-e231-404f-994a-013c0eef007a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:59:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-37069d45-be94-452f-b964-16e430378ed5 req-a8382027-56fd-4e77-af66-11bb3fbd8e95 service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] No waiting events found dispatching network-vif-plugged-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:59:20 user nova-compute[74630]: WARNING nova.compute.manager [req-37069d45-be94-452f-b964-16e430378ed5 req-a8382027-56fd-4e77-af66-11bb3fbd8e95 service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Received unexpected event network-vif-plugged-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac for instance with vm_state building and task_state spawning.
Oct 26 03:59:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:59:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:59:22 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Instance spawned successfully.
Oct 26 03:59:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:59:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:59:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:59:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:59:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:59:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:59:22 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:59:22 user nova-compute[74630]: INFO nova.compute.manager [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Took 4.90 seconds to spawn the instance on the hypervisor.
Oct 26 03:59:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:59:22 user nova-compute[74630]: INFO nova.compute.manager [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Took 23.04 seconds to build instance.
Oct 26 03:59:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-04b315db-6409-4dd6-b0ff-66abc9769017 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "ab2ecfc0-e231-404f-994a-013c0eef007a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.134s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:59:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-3fdb744c-8591-4795-9382-15ecd3d8c6ff req-78e3ea31-945e-46bf-ac67-d41233d1936a service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Received event network-vif-plugged-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:59:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3fdb744c-8591-4795-9382-15ecd3d8c6ff req-78e3ea31-945e-46bf-ac67-d41233d1936a service nova] Acquiring lock "ab2ecfc0-e231-404f-994a-013c0eef007a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:59:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3fdb744c-8591-4795-9382-15ecd3d8c6ff req-78e3ea31-945e-46bf-ac67-d41233d1936a service nova] Lock "ab2ecfc0-e231-404f-994a-013c0eef007a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:59:23 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-3fdb744c-8591-4795-9382-15ecd3d8c6ff req-78e3ea31-945e-46bf-ac67-d41233d1936a service nova] Lock "ab2ecfc0-e231-404f-994a-013c0eef007a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:59:23 user nova-compute[74630]: DEBUG nova.compute.manager [req-3fdb744c-8591-4795-9382-15ecd3d8c6ff req-78e3ea31-945e-46bf-ac67-d41233d1936a service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] No waiting events found dispatching network-vif-plugged-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:59:23 user nova-compute[74630]: WARNING nova.compute.manager [req-3fdb744c-8591-4795-9382-15ecd3d8c6ff req-78e3ea31-945e-46bf-ac67-d41233d1936a service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Received unexpected event network-vif-plugged-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac for instance with vm_state active and task_state None.
Oct 26 03:59:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:59:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 03:59:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:59:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 03:59:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "2276b252-dd39-40d6-b0e0-2068d1c40885" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:59:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:59:33 user nova-compute[74630]: DEBUG nova.compute.manager [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 03:59:34 user nova-compute[74630]: INFO nova.compute.claims [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Claim successful on node user
Oct 26 03:59:34 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.226s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG nova.compute.manager [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG nova.compute.manager [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG nova.network.neutron [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 03:59:34 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 03:59:34 user nova-compute[74630]: DEBUG nova.compute.manager [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG nova.policy [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '550739bc40d54768ba62e194386d0857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d280a7d3a82455f9929dea5a753861c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG nova.compute.manager [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 03:59:34 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Creating image(s)
Oct 26 03:59:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "/opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "/opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "/opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "f1a8b32cb228a113b2be4a275b98948a70ee5b82" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "f1a8b32cb228a113b2be4a275b98948a70ee5b82" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:59:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82.part --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:35 user nova-compute[74630]: DEBUG nova.virt.images [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] 44b6e60b-c7e5-44f0-b839-7648dc0a1514 was qcow2, converting to raw {{(pid=74630) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 03:59:35 user nova-compute[74630]: DEBUG nova.privsep.utils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74630) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 03:59:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82.part /opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82.converted {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82.part /opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82.converted" returned: 0 in 0.348s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82.converted --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:35 user nova-compute[74630]: DEBUG nova.network.neutron [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Successfully created port: 3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 03:59:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "f1a8b32cb228a113b2be4a275b98948a70ee5b82" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.205s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:59:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82 --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82 --force-share --output=json" returned: 0 in 0.194s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "f1a8b32cb228a113b2be4a275b98948a70ee5b82" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:59:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "f1a8b32cb228a113b2be4a275b98948a70ee5b82" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:59:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82 --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82 --force-share --output=json" returned: 0 in 0.224s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82,backing_fmt=raw /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82,backing_fmt=raw /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk 1073741824" returned: 0 in 0.056s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "f1a8b32cb228a113b2be4a275b98948a70ee5b82" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82 --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Successfully updated port: 3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1a8b32cb228a113b2be4a275b98948a70ee5b82 --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG nova.compute.manager [req-947a92b4-3394-45a1-935b-7b509009d020 req-a5fb08f0-7709-4b8f-950b-d0d638dce4c4 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received event network-changed-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG nova.compute.manager [req-947a92b4-3394-45a1-935b-7b509009d020 req-a5fb08f0-7709-4b8f-950b-d0d638dce4c4 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Refreshing instance network info cache due to event network-changed-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-947a92b4-3394-45a1-935b-7b509009d020 req-a5fb08f0-7709-4b8f-950b-d0d638dce4c4 service nova] Acquiring lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-947a92b4-3394-45a1-935b-7b509009d020 req-a5fb08f0-7709-4b8f-950b-d0d638dce4c4 service nova] Acquired lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG nova.network.neutron [req-947a92b4-3394-45a1-935b-7b509009d020 req-a5fb08f0-7709-4b8f-950b-d0d638dce4c4 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Refreshing network info cache for port 3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG nova.network.neutron [req-947a92b4-3394-45a1-935b-7b509009d020 req-a5fb08f0-7709-4b8f-950b-d0d638dce4c4 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Cannot resize image /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Ensure instance console log exists: /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG nova.network.neutron [req-947a92b4-3394-45a1-935b-7b509009d020 req-a5fb08f0-7709-4b8f-950b-d0d638dce4c4 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-947a92b4-3394-45a1-935b-7b509009d020 req-a5fb08f0-7709-4b8f-950b-d0d638dce4c4 service nova] Releasing lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquired lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 03:59:36 user nova-compute[74630]: DEBUG nova.network.neutron [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.network.neutron [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updating instance_info_cache with network_info: [{"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Releasing lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.compute.manager [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Instance network_info: |[{"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Start _get_guest_xml network_info=[{"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:59:31Z,direct_url=<?>,disk_format='qcow2',id=44b6e60b-c7e5-44f0-b839-7648dc0a1514,min_disk=0,min_ram=0,name='tempest-scenario-img--217815936',owner='3d280a7d3a82455f9929dea5a753861c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:59:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '44b6e60b-c7e5-44f0-b839-7648dc0a1514'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 03:59:37 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:59:37 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:59:31Z,direct_url=<?>,disk_format='qcow2',id=44b6e60b-c7e5-44f0-b839-7648dc0a1514,min_disk=0,min_ram=0,name='tempest-scenario-img--217815936',owner='3d280a7d3a82455f9929dea5a753861c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:59:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-195522810',display_name='tempest-TestMinimumBasicScenario-server-195522810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-195522810',id=48,image_ref='44b6e60b-c7e5-44f0-b839-7648dc0a1514',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdvtkgV2VTRoxsaerF2gtNXBg/Ir6n35ETN3ox4hwfE/9TNffT9IzpDvZb+aszYIXUysbBSBR1fHWUyuZL/LooYqBtkZAGtTPM1Qq0VB+zsrwNQ0eCPtS5jgOYDr/o3xg==',key_name='tempest-TestMinimumBasicScenario-271791202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d280a7d3a82455f9929dea5a753861c',ramdisk_id='',reservation_id='r-jgh7teqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='44b6e60b-c7e5-44f0-b839-7648dc0a1514',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1824331495',owner_user_name='tempest-TestMinimumBasicScenario-1824331495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:59:34Z,user_data=None,user_id='550739bc40d54768ba62e194386d0857',uuid=2276b252-dd39-40d6-b0e0-2068d1c40885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converting VIF {"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ce:d1,bridge_name='br-int',has_traffic_filtering=True,id=3fe1b43c-b4a6-4a74-a018-8ed57cc50be4,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe1b43c-b4') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.objects.instance [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lazy-loading 'pci_devices' on Instance uuid 2276b252-dd39-40d6-b0e0-2068d1c40885 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] End _get_guest_xml xml=<domain type="kvm">
Oct 26 03:59:37 user nova-compute[74630]:   <uuid>2276b252-dd39-40d6-b0e0-2068d1c40885</uuid>
Oct 26 03:59:37 user nova-compute[74630]:   <name>instance-00000030</name>
Oct 26 03:59:37 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 03:59:37 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 03:59:37 user nova-compute[74630]:   <metadata>
Oct 26 03:59:37 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 03:59:37 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 03:59:37 user nova-compute[74630]:       <nova:name>tempest-TestMinimumBasicScenario-server-195522810</nova:name>
Oct 26 03:59:37 user nova-compute[74630]:       <nova:creationTime>2023-10-26 03:59:37</nova:creationTime>
Oct 26 03:59:37 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 03:59:37 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 03:59:37 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 03:59:37 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 03:59:37 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 03:59:37 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 03:59:37 user nova-compute[74630]:       </nova:flavor>
Oct 26 03:59:37 user nova-compute[74630]:       <nova:owner>
Oct 26 03:59:37 user nova-compute[74630]:         <nova:user uuid="550739bc40d54768ba62e194386d0857">tempest-TestMinimumBasicScenario-1824331495-project-member</nova:user>
Oct 26 03:59:37 user nova-compute[74630]:         <nova:project uuid="3d280a7d3a82455f9929dea5a753861c">tempest-TestMinimumBasicScenario-1824331495</nova:project>
Oct 26 03:59:37 user nova-compute[74630]:       </nova:owner>
Oct 26 03:59:37 user nova-compute[74630]:       <nova:root type="image" uuid="44b6e60b-c7e5-44f0-b839-7648dc0a1514"/>
Oct 26 03:59:37 user nova-compute[74630]:       <nova:ports>
Oct 26 03:59:37 user nova-compute[74630]:         <nova:port uuid="3fe1b43c-b4a6-4a74-a018-8ed57cc50be4">
Oct 26 03:59:37 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 03:59:37 user nova-compute[74630]:         </nova:port>
Oct 26 03:59:37 user nova-compute[74630]:       </nova:ports>
Oct 26 03:59:37 user nova-compute[74630]:     </nova:instance>
Oct 26 03:59:37 user nova-compute[74630]:   </metadata>
Oct 26 03:59:37 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 03:59:37 user nova-compute[74630]:     <system>
Oct 26 03:59:37 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 03:59:37 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 03:59:37 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 03:59:37 user nova-compute[74630]:       <entry name="serial">2276b252-dd39-40d6-b0e0-2068d1c40885</entry>
Oct 26 03:59:37 user nova-compute[74630]:       <entry name="uuid">2276b252-dd39-40d6-b0e0-2068d1c40885</entry>
Oct 26 03:59:37 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 03:59:37 user nova-compute[74630]:     </system>
Oct 26 03:59:37 user nova-compute[74630]:   </sysinfo>
Oct 26 03:59:37 user nova-compute[74630]:   <os>
Oct 26 03:59:37 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 03:59:37 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 03:59:37 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 03:59:37 user nova-compute[74630]:   </os>
Oct 26 03:59:37 user nova-compute[74630]:   <features>
Oct 26 03:59:37 user nova-compute[74630]:     <acpi/>
Oct 26 03:59:37 user nova-compute[74630]:     <apic/>
Oct 26 03:59:37 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 03:59:37 user nova-compute[74630]:   </features>
Oct 26 03:59:37 user nova-compute[74630]:   <clock offset="utc">
Oct 26 03:59:37 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 03:59:37 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 03:59:37 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 03:59:37 user nova-compute[74630]:   </clock>
Oct 26 03:59:37 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 03:59:37 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 03:59:37 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 03:59:37 user nova-compute[74630]:   </cpu>
Oct 26 03:59:37 user nova-compute[74630]:   <devices>
Oct 26 03:59:37 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 03:59:37 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 03:59:37 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk"/>
Oct 26 03:59:37 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 03:59:37 user nova-compute[74630]:     </disk>
Oct 26 03:59:37 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 03:59:37 user nova-compute[74630]:       <mac address="fa:16:3e:c9:ce:d1"/>
Oct 26 03:59:37 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:59:37 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 03:59:37 user nova-compute[74630]:       <target dev="tap3fe1b43c-b4"/>
Oct 26 03:59:37 user nova-compute[74630]:     </interface>
Oct 26 03:59:37 user nova-compute[74630]:     <serial type="pty">
Oct 26 03:59:37 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/console.log" append="off"/>
Oct 26 03:59:37 user nova-compute[74630]:     </serial>
Oct 26 03:59:37 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 03:59:37 user nova-compute[74630]:     <video>
Oct 26 03:59:37 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 03:59:37 user nova-compute[74630]:     </video>
Oct 26 03:59:37 user nova-compute[74630]:     <rng model="virtio">
Oct 26 03:59:37 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 03:59:37 user nova-compute[74630]:     </rng>
Oct 26 03:59:37 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 03:59:37 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 03:59:37 user nova-compute[74630]:       <stats period="10"/>
Oct 26 03:59:37 user nova-compute[74630]:     </memballoon>
Oct 26 03:59:37 user nova-compute[74630]:   </devices>
Oct 26 03:59:37 user nova-compute[74630]: </domain>
Oct 26 03:59:37 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-195522810',display_name='tempest-TestMinimumBasicScenario-server-195522810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-195522810',id=48,image_ref='44b6e60b-c7e5-44f0-b839-7648dc0a1514',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdvtkgV2VTRoxsaerF2gtNXBg/Ir6n35ETN3ox4hwfE/9TNffT9IzpDvZb+aszYIXUysbBSBR1fHWUyuZL/LooYqBtkZAGtTPM1Qq0VB+zsrwNQ0eCPtS5jgOYDr/o3xg==',key_name='tempest-TestMinimumBasicScenario-271791202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d280a7d3a82455f9929dea5a753861c',ramdisk_id='',reservation_id='r-jgh7teqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='44b6e60b-c7e5-44f0-b839-7648dc0a1514',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1824331495',owner_user_name='tempest-TestMinimumBasicScenario-1824331495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T03:59:34Z,user_data=None,user_id='550739bc40d54768ba62e194386d0857',uuid=2276b252-dd39-40d6-b0e0-2068d1c40885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converting VIF {"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ce:d1,bridge_name='br-int',has_traffic_filtering=True,id=3fe1b43c-b4a6-4a74-a018-8ed57cc50be4,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe1b43c-b4') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG os_vif [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ce:d1,bridge_name='br-int',has_traffic_filtering=True,id=3fe1b43c-b4a6-4a74-a018-8ed57cc50be4,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe1b43c-b4') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91c07758-195b-525a-a762-05bcca9deccb', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fe1b43c-b4, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3fe1b43c-b4, col_values=(('qos', UUID('cd63b1f2-594b-4428-bd46-58701c642228')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3fe1b43c-b4, col_values=(('external_ids', {'iface-id': '3fe1b43c-b4a6-4a74-a018-8ed57cc50be4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:ce:d1', 'vm-uuid': '2276b252-dd39-40d6-b0e0-2068d1c40885'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:37 user nova-compute[74630]: INFO os_vif [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ce:d1,bridge_name='br-int',has_traffic_filtering=True,id=3fe1b43c-b4a6-4a74-a018-8ed57cc50be4,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe1b43c-b4')
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 03:59:37 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] No VIF found with MAC fa:16:3e:c9:ce:d1, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 03:59:38 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:59:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:38 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-2e3f545b-426f-4273-a417-f204a216c6a4 req-430db39e-2248-4964-9e2c-57f1f5db362a service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received event network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:59:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2e3f545b-426f-4273-a417-f204a216c6a4 req-430db39e-2248-4964-9e2c-57f1f5db362a service nova] Acquiring lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:59:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2e3f545b-426f-4273-a417-f204a216c6a4 req-430db39e-2248-4964-9e2c-57f1f5db362a service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:59:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-2e3f545b-426f-4273-a417-f204a216c6a4 req-430db39e-2248-4964-9e2c-57f1f5db362a service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:59:38 user nova-compute[74630]: DEBUG nova.compute.manager [req-2e3f545b-426f-4273-a417-f204a216c6a4 req-430db39e-2248-4964-9e2c-57f1f5db362a service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] No waiting events found dispatching network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:59:38 user nova-compute[74630]: WARNING nova.compute.manager [req-2e3f545b-426f-4273-a417-f204a216c6a4 req-430db39e-2248-4964-9e2c-57f1f5db362a service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received unexpected event network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 for instance with vm_state building and task_state spawning.
Oct 26 03:59:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:40 user nova-compute[74630]: DEBUG nova.compute.manager [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 03:59:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 03:59:40 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Instance spawned successfully.
Oct 26 03:59:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 03:59:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:59:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:59:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:59:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:59:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:59:40 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 03:59:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-6c188c2b-3c20-478f-b981-912fc3f4986a req-e945793e-36a5-4cb0-b343-7a7c241f7710 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received event network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 03:59:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6c188c2b-3c20-478f-b981-912fc3f4986a req-e945793e-36a5-4cb0-b343-7a7c241f7710 service nova] Acquiring lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:59:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6c188c2b-3c20-478f-b981-912fc3f4986a req-e945793e-36a5-4cb0-b343-7a7c241f7710 service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:59:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6c188c2b-3c20-478f-b981-912fc3f4986a req-e945793e-36a5-4cb0-b343-7a7c241f7710 service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:59:40 user nova-compute[74630]: DEBUG nova.compute.manager [req-6c188c2b-3c20-478f-b981-912fc3f4986a req-e945793e-36a5-4cb0-b343-7a7c241f7710 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] No waiting events found dispatching network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 03:59:40 user nova-compute[74630]: WARNING nova.compute.manager [req-6c188c2b-3c20-478f-b981-912fc3f4986a req-e945793e-36a5-4cb0-b343-7a7c241f7710 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received unexpected event network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 for instance with vm_state building and task_state spawning.
Oct 26 03:59:40 user nova-compute[74630]: INFO nova.compute.manager [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Took 6.32 seconds to spawn the instance on the hypervisor.
Oct 26 03:59:40 user nova-compute[74630]: DEBUG nova.compute.manager [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 03:59:40 user nova-compute[74630]: INFO nova.compute.manager [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Took 6.90 seconds to build instance.
Oct 26 03:59:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-634f44a2-1b75-432f-a9ec-a688dd87bbae tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.049s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:59:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:59:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:59:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:59:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 03:59:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 03:59:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-ab2ecfc0-e231-404f-994a-013c0eef007a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 03:59:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-ab2ecfc0-e231-404f-994a-013c0eef007a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 03:59:51 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 03:59:51 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid ab2ecfc0-e231-404f-994a-013c0eef007a {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 03:59:51 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Updating instance_info_cache with network_info: [{"id": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "address": "fa:16:3e:b7:3f:e8", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d9fe7c-7d", "ovs_interfaceid": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 03:59:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-ab2ecfc0-e231-404f-994a-013c0eef007a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 03:59:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 03:59:52 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:59:52 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 03:59:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:53 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:59:54 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:59:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:55 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 03:59:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:59:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:59:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:59:55 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 03:59:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 03:59:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 03:59:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 03:59:55 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:59:55 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 03:59:55 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8630MB free_disk=24.932483673095703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 03:59:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 03:59:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 03:59:56 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance ab2ecfc0-e231-404f-994a-013c0eef007a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:59:56 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 2276b252-dd39-40d6-b0e0-2068d1c40885 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 03:59:56 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 03:59:56 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 03:59:56 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 03:59:56 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 03:59:56 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 03:59:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 03:59:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 03:59:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:02 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:00:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:07 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:17 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:00:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:00:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:00:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:00:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:00:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:00:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:00:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:00:27 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:00:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:00:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:00:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:00:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:00:32 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:00:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:00:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:00:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:00:37 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:38 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:00:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:00:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:00:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:00:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:00:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:00:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:00:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:00:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:00:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:00:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:00:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:00:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:00:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:00:51 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:00:51 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updating instance_info_cache with network_info: [{"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:00:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:00:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:00:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-f84c77d9-faad-40b8-9052-2de57ff773ad req-39087f2d-680c-4a66-8eb6-3cdc542e56eb service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Received event network-changed-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:00:52 user nova-compute[74630]: DEBUG nova.compute.manager [req-f84c77d9-faad-40b8-9052-2de57ff773ad req-39087f2d-680c-4a66-8eb6-3cdc542e56eb service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Refreshing instance network info cache due to event network-changed-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:00:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f84c77d9-faad-40b8-9052-2de57ff773ad req-39087f2d-680c-4a66-8eb6-3cdc542e56eb service nova] Acquiring lock "refresh_cache-ab2ecfc0-e231-404f-994a-013c0eef007a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:00:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f84c77d9-faad-40b8-9052-2de57ff773ad req-39087f2d-680c-4a66-8eb6-3cdc542e56eb service nova] Acquired lock "refresh_cache-ab2ecfc0-e231-404f-994a-013c0eef007a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:00:52 user nova-compute[74630]: DEBUG nova.network.neutron [req-f84c77d9-faad-40b8-9052-2de57ff773ad req-39087f2d-680c-4a66-8eb6-3cdc542e56eb service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Refreshing network info cache for port 95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:00:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:52 user nova-compute[74630]: DEBUG nova.network.neutron [req-f84c77d9-faad-40b8-9052-2de57ff773ad req-39087f2d-680c-4a66-8eb6-3cdc542e56eb service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Updated VIF entry in instance network info cache for port 95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:00:52 user nova-compute[74630]: DEBUG nova.network.neutron [req-f84c77d9-faad-40b8-9052-2de57ff773ad req-39087f2d-680c-4a66-8eb6-3cdc542e56eb service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Updating instance_info_cache with network_info: [{"id": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "address": "fa:16:3e:b7:3f:e8", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d9fe7c-7d", "ovs_interfaceid": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:00:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-f84c77d9-faad-40b8-9052-2de57ff773ad req-39087f2d-680c-4a66-8eb6-3cdc542e56eb service nova] Releasing lock "refresh_cache-ab2ecfc0-e231-404f-994a-013c0eef007a" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "ab2ecfc0-e231-404f-994a-013c0eef007a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "ab2ecfc0-e231-404f-994a-013c0eef007a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "ab2ecfc0-e231-404f-994a-013c0eef007a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "ab2ecfc0-e231-404f-994a-013c0eef007a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "ab2ecfc0-e231-404f-994a-013c0eef007a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:00:53 user nova-compute[74630]: INFO nova.compute.manager [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Terminating instance
Oct 26 04:00:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG nova.compute.manager [req-e458ce83-721a-49c3-bf48-98690e753ee1 req-a1aa7f0b-4be5-4280-84c6-2e0e0fbee26e service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Received event network-vif-unplugged-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e458ce83-721a-49c3-bf48-98690e753ee1 req-a1aa7f0b-4be5-4280-84c6-2e0e0fbee26e service nova] Acquiring lock "ab2ecfc0-e231-404f-994a-013c0eef007a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e458ce83-721a-49c3-bf48-98690e753ee1 req-a1aa7f0b-4be5-4280-84c6-2e0e0fbee26e service nova] Lock "ab2ecfc0-e231-404f-994a-013c0eef007a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e458ce83-721a-49c3-bf48-98690e753ee1 req-a1aa7f0b-4be5-4280-84c6-2e0e0fbee26e service nova] Lock "ab2ecfc0-e231-404f-994a-013c0eef007a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG nova.compute.manager [req-e458ce83-721a-49c3-bf48-98690e753ee1 req-a1aa7f0b-4be5-4280-84c6-2e0e0fbee26e service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] No waiting events found dispatching network-vif-unplugged-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:00:53 user nova-compute[74630]: DEBUG nova.compute.manager [req-e458ce83-721a-49c3-bf48-98690e753ee1 req-a1aa7f0b-4be5-4280-84c6-2e0e0fbee26e service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Received event network-vif-unplugged-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:54 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Instance destroyed successfully.
Oct 26 04:00:54 user nova-compute[74630]: DEBUG nova.objects.instance [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lazy-loading 'resources' on Instance uuid ab2ecfc0-e231-404f-994a-013c0eef007a {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:58:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1473460262',display_name='tempest-TestVolumeBootPattern-server-1473460262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1473460262',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/SIDPQ2UP+8pjr/EDeG7jiIvKtw4wxC8wOR9Ppgf68vzwgAsuUEGb0qigXIxPbeQGiuT7fPQKbEvjMZRXhfqo9CTc8iDOme/8ss3+oEiY5W1hrK42wG17Y5enspUZi+A==',key_name='tempest-TestVolumeBootPattern-1850034835',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:59:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-3124g8gb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T03:59:23Z,user_data=None,user_id='3b3bd794500243df86a1e4e89414bea0',uuid=ab2ecfc0-e231-404f-994a-013c0eef007a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "address": "fa:16:3e:b7:3f:e8", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d9fe7c-7d", "ovs_interfaceid": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "address": "fa:16:3e:b7:3f:e8", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95d9fe7c-7d", "ovs_interfaceid": "95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:3f:e8,bridge_name='br-int',has_traffic_filtering=True,id=95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d9fe7c-7d') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_vif [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:3f:e8,bridge_name='br-int',has_traffic_filtering=True,id=95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d9fe7c-7d') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95d9fe7c-7d, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a134838-0606-4796-9349-d52f4bd25d55) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:00:54 user nova-compute[74630]: INFO os_vif [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:3f:e8,bridge_name='br-int',has_traffic_filtering=True,id=95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95d9fe7c-7d')
Oct 26 04:00:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqetYOCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:00:54 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fb617c-491c-4ac0-85f6-326766bcb531]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 04:00:54 user nova-compute[74630]: No targets found.
Oct 26 04:00:54 user nova-compute[74630]: iSNS:
Oct 26 04:00:54 user nova-compute[74630]: No targets found.
Oct 26 04:00:54 user nova-compute[74630]: STATIC:
Oct 26 04:00:54 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1
Oct 26 04:00:54 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:00:54 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:00:54 user nova-compute[74630]: FIRMWARE:
Oct 26 04:00:54 user nova-compute[74630]: No targets found.
Oct 26 04:00:54 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 04:00:54 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 04:00:54 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9506ec-c93e-4675-acf8-ea65d8f3ac55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[276aee6f-2b55-40cb-a3cc-fdcddd9ee85f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:00:54 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:00:54 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f318464e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6104103b-7a21-4f4e-a1fa-d98bcbd26ead]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b863423-a746-49bd-ab98-dd5abad828df]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f205974b-39fa-42f1-81a6-a53eb15f6650]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e93b2b-faeb-4b4f-8bd6-45c786cd3304]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26138353739613934', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_46b7a275', '/dev/disk/by-id/scsi-1SCST_BIO46b7a275-a8579a9490bd1874') {{(pid=86251) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 04:00:54 user nova-compute[74630]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26138353739613934
Oct 26 04:00:54 user nova-compute[74630]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_46b7a275
Oct 26 04:00:54 user nova-compute[74630]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO46b7a275-a8579a9490bd1874
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1264c25-a047-4fd4-837a-f38d77ba5026]: (4, None) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2a8fee-141a-4243-8756-53a48020755d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[42540637-0a35-4ed4-a550-3f379c1ff82c]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260]
Oct 26 04:00:54 user nova-compute[74630]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260] successful.
Oct 26 04:00:54 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9423d0-8e24-47ae-8af5-2d404b4fae61]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== disconnect_volume: return (362ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 04:00:54 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Deleting instance files /opt/stack/data/nova/instances/ab2ecfc0-e231-404f-994a-013c0eef007a_del
Oct 26 04:00:54 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Deletion of /opt/stack/data/nova/instances/ab2ecfc0-e231-404f-994a-013c0eef007a_del complete
Oct 26 04:00:54 user nova-compute[74630]: INFO nova.compute.manager [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Took 1.24 seconds to destroy the instance on the hypervisor.
Oct 26 04:00:54 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 04:00:54 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 04:00:55 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:00:55 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:00:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:00:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:00:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:00:55 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:00:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:00:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:00:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:00:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:00:55 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:00:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-53cfcb51-95bb-4226-b77e-180aeeffdc8d req-367f096b-19bb-4cda-bd89-0f58131f727b service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Received event network-vif-deleted-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:00:55 user nova-compute[74630]: INFO nova.compute.manager [req-53cfcb51-95bb-4226-b77e-180aeeffdc8d req-367f096b-19bb-4cda-bd89-0f58131f727b service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Neutron deleted interface 95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac; detaching it from the instance and deleting it from the info cache
Oct 26 04:00:55 user nova-compute[74630]: DEBUG nova.network.neutron [req-53cfcb51-95bb-4226-b77e-180aeeffdc8d req-367f096b-19bb-4cda-bd89-0f58131f727b service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:00:55 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Took 0.67 seconds to deallocate network for instance.
Oct 26 04:00:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-53cfcb51-95bb-4226-b77e-180aeeffdc8d req-367f096b-19bb-4cda-bd89-0f58131f727b service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Detach interface failed, port_id=95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac, reason: Instance ab2ecfc0-e231-404f-994a-013c0eef007a could not be found. {{(pid=74630) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 04:00:55 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:00:55 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:00:55 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=24.929248809814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:00:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:00:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:00:56 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance ab2ecfc0-e231-404f-994a-013c0eef007a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:00:56 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 2276b252-dd39-40d6-b0e0-2068d1c40885 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:00:56 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:00:56 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:00:56 user nova-compute[74630]: DEBUG nova.compute.manager [req-55fde4cf-92a6-4466-b333-cd0b54cd8692 req-6091b99d-b5c6-407b-aa64-ff06d1db9962 service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Received event network-vif-plugged-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:00:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-55fde4cf-92a6-4466-b333-cd0b54cd8692 req-6091b99d-b5c6-407b-aa64-ff06d1db9962 service nova] Acquiring lock "ab2ecfc0-e231-404f-994a-013c0eef007a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:00:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-55fde4cf-92a6-4466-b333-cd0b54cd8692 req-6091b99d-b5c6-407b-aa64-ff06d1db9962 service nova] Lock "ab2ecfc0-e231-404f-994a-013c0eef007a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:00:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-55fde4cf-92a6-4466-b333-cd0b54cd8692 req-6091b99d-b5c6-407b-aa64-ff06d1db9962 service nova] Lock "ab2ecfc0-e231-404f-994a-013c0eef007a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:00:56 user nova-compute[74630]: DEBUG nova.compute.manager [req-55fde4cf-92a6-4466-b333-cd0b54cd8692 req-6091b99d-b5c6-407b-aa64-ff06d1db9962 service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] No waiting events found dispatching network-vif-plugged-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:00:56 user nova-compute[74630]: WARNING nova.compute.manager [req-55fde4cf-92a6-4466-b333-cd0b54cd8692 req-6091b99d-b5c6-407b-aa64-ff06d1db9962 service nova] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Received unexpected event network-vif-plugged-95d9fe7c-7d95-4c92-bf15-1b4fd6c1e9ac for instance with vm_state active and task_state deleting.
Oct 26 04:00:56 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:00:56 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:00:56 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:00:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:00:56 user nova-compute[74630]: INFO nova.compute.manager [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: ab2ecfc0-e231-404f-994a-013c0eef007a] Took 0.90 seconds to detach 1 volumes for instance.
Oct 26 04:00:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:00:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:00:56 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:00:56 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:00:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:00:57 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Deleted allocations for instance ab2ecfc0-e231-404f-994a-013c0eef007a
Oct 26 04:00:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-005a8330-03c3-432f-b1ed-63a81046cd56 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "ab2ecfc0-e231-404f-994a-013c0eef007a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.473s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:00:57 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:00:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:00:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:02 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:01:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:01:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:01:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "2276b252-dd39-40d6-b0e0-2068d1c40885" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG nova.objects.instance [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lazy-loading 'flavor' on Instance uuid 2276b252-dd39-40d6-b0e0-2068d1c40885 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "2276b252-dd39-40d6-b0e0-2068d1c40885" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:01:30 user nova-compute[74630]: INFO nova.compute.manager [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Attaching volume 91661e88-74a5-4300-981b-f257d0b8cf63 to /dev/vdb
Oct 26 04:01:30 user nova-compute[74630]: DEBUG os_brick.utils [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[54176cd9-0882-4dbc-8cc8-f90cbe26e304]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[293eabab-c268-4557-bfad-dd635ea567ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce2b894-fc53-48aa-81cd-3b0742033efd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65fbbc3-1f81-4ab8-ae55-0dccafcd7f06]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:01:30 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 04:01:30 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a21dec-7dc2-492a-91db-61ecce6209de]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG os_brick.utils [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:01:30 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updating existing volume attachment record: 795d31ab-507b-45ff-9f13-5b162e86b217 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 04:01:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:38 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:01:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "f9b83cf7-027f-4d50-a605-afda72da2d13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG nova.compute.manager [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 04:01:45 user nova-compute[74630]: INFO nova.compute.claims [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Claim successful on node user
Oct 26 04:01:45 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG nova.compute.manager [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG nova.compute.manager [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG nova.network.neutron [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 04:01:45 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 04:01:45 user nova-compute[74630]: DEBUG nova.compute.manager [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 04:01:45 user nova-compute[74630]: INFO nova.virt.block_device [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Booting with volume 3a3f0821-dbcb-4506-9894-44f41a671fc1 at /dev/vda
Oct 26 04:01:45 user nova-compute[74630]: DEBUG nova.policy [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b3bd794500243df86a1e4e89414bea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbe37117ca24935b46795e7f7479af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG os_brick.utils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a79b1b-352f-4c05-a2e1-131d94693c35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2ac8b5-6089-4fc3-928e-b6bf48492b8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5371c35-8963-44aa-9c01-66073eca5e96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de9a2b9-2c47-4154-8095-fa20acdc1d6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:45 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:01:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 04:01:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:46 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:01:46 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 04:01:46 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5778a766-ab9a-4d26-bc56-f0d1f269e90d]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:01:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 04:01:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 04:01:46 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 04:01:46 user nova-compute[74630]: DEBUG os_brick.utils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:01:46 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Updating existing volume attachment record: 88d77b68-1ddc-484d-a407-c2238d1132c4 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 04:01:46 user nova-compute[74630]: DEBUG nova.network.neutron [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Successfully created port: 9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG nova.network.neutron [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Successfully updated port: 9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquired lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG nova.network.neutron [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "d37238e9-39cd-4605-a870-c6c69b22834b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "d37238e9-39cd-4605-a870-c6c69b22834b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-10800896-925f-458b-b939-b277108b18d5 req-8c9109c9-ff93-408e-a7ca-ff5f5aac0611 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received event network-changed-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-10800896-925f-458b-b939-b277108b18d5 req-8c9109c9-ff93-408e-a7ca-ff5f5aac0611 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Refreshing instance network info cache due to event network-changed-9a7b0f8c-963e-4eb6-922a-517e6fa625b8. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-10800896-925f-458b-b939-b277108b18d5 req-8c9109c9-ff93-408e-a7ca-ff5f5aac0611 service nova] Acquiring lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG nova.network.neutron [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 04:01:47 user nova-compute[74630]: INFO nova.compute.claims [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Claim successful on node user
Oct 26 04:01:47 user nova-compute[74630]: DEBUG nova.network.neutron [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Updating instance_info_cache with network_info: [{"id": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "address": "fa:16:3e:fc:a0:23", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7b0f8c-96", "ovs_interfaceid": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Releasing lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG nova.compute.manager [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Instance network_info: |[{"id": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "address": "fa:16:3e:fc:a0:23", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7b0f8c-96", "ovs_interfaceid": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-10800896-925f-458b-b939-b277108b18d5 req-8c9109c9-ff93-408e-a7ca-ff5f5aac0611 service nova] Acquired lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG nova.network.neutron [req-10800896-925f-458b-b939-b277108b18d5 req-8c9109c9-ff93-408e-a7ca-ff5f5aac0611 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Refreshing network info cache for port 9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.321s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:01:47 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG nova.network.neutron [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 04:01:48 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 04:01:48 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG nova.policy [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96c596f1b11b4fa6845a49d0c56d1cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9f43800c8546da84a4b2528c7cf3af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 04:01:48 user nova-compute[74630]: INFO nova.virt.block_device [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Booting with volume 67489b74-94cc-4429-8e21-f89abc80b034 at /dev/vda
Oct 26 04:01:48 user nova-compute[74630]: DEBUG os_brick.utils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6476dd-df91-4741-9430-18e46bc239ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2040f5-f4e6-4d37-87ca-38446499b49a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b70222-e804-468c-8533-78306395b425]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3ce26c-e490-4e35-a284-78dc05a40c8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:01:48 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6138ac81-1c87-460a-9e8e-0e372cdf132f]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG os_brick.utils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updating existing volume attachment record: e99e8286-dc9c-4257-849f-ede191433cd7 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG nova.network.neutron [req-10800896-925f-458b-b939-b277108b18d5 req-8c9109c9-ff93-408e-a7ca-ff5f5aac0611 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Updated VIF entry in instance network info cache for port 9a7b0f8c-963e-4eb6-922a-517e6fa625b8. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG nova.network.neutron [req-10800896-925f-458b-b939-b277108b18d5 req-8c9109c9-ff93-408e-a7ca-ff5f5aac0611 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Updating instance_info_cache with network_info: [{"id": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "address": "fa:16:3e:fc:a0:23", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7b0f8c-96", "ovs_interfaceid": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:01:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-10800896-925f-458b-b939-b277108b18d5 req-8c9109c9-ff93-408e-a7ca-ff5f5aac0611 service nova] Releasing lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:01:49 user nova-compute[74630]: DEBUG nova.network.neutron [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Successfully created port: 6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 04:01:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:01:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:49 user nova-compute[74630]: DEBUG nova.network.neutron [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Successfully updated port: 6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 04:01:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:01:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquired lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:01:49 user nova-compute[74630]: DEBUG nova.network.neutron [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 04:01:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-fd4f5e10-71c3-4ecc-9514-4760fe727e0b req-c092db80-64f8-4009-a3fc-9e020873cdf4 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received event network-changed-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:01:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-fd4f5e10-71c3-4ecc-9514-4760fe727e0b req-c092db80-64f8-4009-a3fc-9e020873cdf4 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Refreshing instance network info cache due to event network-changed-6e54ed58-c2f0-43c5-8316-511f7908c02e. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:01:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-fd4f5e10-71c3-4ecc-9514-4760fe727e0b req-c092db80-64f8-4009-a3fc-9e020873cdf4 service nova] Acquiring lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:01:49 user nova-compute[74630]: DEBUG nova.network.neutron [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 04:01:50 user nova-compute[74630]: DEBUG nova.network.neutron [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updating instance_info_cache with network_info: [{"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:01:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Releasing lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:01:50 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Instance network_info: |[{"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 04:01:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-fd4f5e10-71c3-4ecc-9514-4760fe727e0b req-c092db80-64f8-4009-a3fc-9e020873cdf4 service nova] Acquired lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:01:50 user nova-compute[74630]: DEBUG nova.network.neutron [req-fd4f5e10-71c3-4ecc-9514-4760fe727e0b req-c092db80-64f8-4009-a3fc-9e020873cdf4 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Refreshing network info cache for port 6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:01:50 user nova-compute[74630]: DEBUG nova.network.neutron [req-fd4f5e10-71c3-4ecc-9514-4760fe727e0b req-c092db80-64f8-4009-a3fc-9e020873cdf4 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updated VIF entry in instance network info cache for port 6e54ed58-c2f0-43c5-8316-511f7908c02e. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:01:50 user nova-compute[74630]: DEBUG nova.network.neutron [req-fd4f5e10-71c3-4ecc-9514-4760fe727e0b req-c092db80-64f8-4009-a3fc-9e020873cdf4 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updating instance_info_cache with network_info: [{"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:01:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-fd4f5e10-71c3-4ecc-9514-4760fe727e0b req-c092db80-64f8-4009-a3fc-9e020873cdf4 service nova] Releasing lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:01:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:01:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:01:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:01:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Skipping network cache update for instance because it is Building. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 04:01:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Skipping network cache update for instance because it is Building. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 04:01:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:01:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:01:51 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:01:51 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid 2276b252-dd39-40d6-b0e0-2068d1c40885 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:01:51 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updating instance_info_cache with network_info: [{"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:01:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:01:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:01:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:01:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 04:01:51 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] There are 0 instances to clean {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 04:01:52 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:01:52 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:01:52 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74630) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 04:01:54 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:01:54 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:01:54 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:01:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:57 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:01:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:01:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:01:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:01:57 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:01:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:01:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:01:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:01:57 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:01:57 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:01:57 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8856MB free_disk=24.926193237304688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:01:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:01:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:01:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 2276b252-dd39-40d6-b0e0-2068d1c40885 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:01:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9b83cf7-027f-4d50-a605-afda72da2d13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:01:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d37238e9-39cd-4605-a870-c6c69b22834b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:01:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:01:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:01:58 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:01:58 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:01:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:01:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:01:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:01:59 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:01:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:02 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:02:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 04:02:06 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Creating image(s)
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Ensure instance console log exists: /opt/stack/data/nova/instances/d37238e9-39cd-4605-a870-c6c69b22834b/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Start _get_guest_xml network_info=[{"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKmbUQwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd37238e9-39cd-4605-a870-c6c69b22834b', 'attached_at': '', 'detached_at': '', 'volume_id': '67489b74-94cc-4429-8e21-f89abc80b034', 'serial': '67489b74-94cc-4429-8e21-f89abc80b034'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': 'e99e8286-dc9c-4257-849f-ede191433cd7', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 04:02:06 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:02:06 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKmbUQwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:02:06 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:02:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:02:06 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:02:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:02:06 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a80a0f-412e-487f-ac52-c0d224671eb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 04:02:06 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[709d26c2-9941-4f81-908c-21b49dfc61dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034] added
Oct 26 04:02:06 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6a343c-e9b8-42a6-99b0-5c9fbbb7c573]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[953aa464-5e09-4ef4-a3b2-ed3f74786149]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lKmbUQwc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lKmbUQwc" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f767152c-1350-4c8f-80f4-c9bbb4a116fd]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lKmbUQwc'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3834c362-ebb7-4e5f-84da-5d8076d15449]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62aafab-0e45-4616-bf5c-97165cd26e10]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:02:06 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:02:06 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:02:06 user nova-compute[74630]:  {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:02:06 user nova-compute[74630]: WARNING os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 04:02:06 user nova-compute[74630]: 
Oct 26 04:02:06 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[596410e1-1a0d-4c60-9139-46a477645c6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260]
Oct 26 04:02:07 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260] successful.
Oct 26 04:02:07 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f177f85-64dd-4e9c-90df-871f22d1ca00]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc15d864-5bb1-4c53-9cb3-9428cea3678b]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:02:07 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:02:07 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a283003a-db78-49b4-a16f-bbbb13f7ff33]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:02:07 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKmbUQwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23661343064393133', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661343064393133', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T04:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-30403276',display_name='tempest-TestShelveInstance-server-30403276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-30403276',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpwZbeVvWqMIrse9jqV356hQeCjjtAitu6ZLe3vy7VgaQ56KqTb6ML+JuI6Ggpo/o2Vk0ZIvGG+Oyw+favsHOZpNHvgyN4yMaeLnlujM+XfU5er5o8PFPK2nF17krwq/g==',key_name='tempest-TestShelveInstance-1204480980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c9f43800c8546da84a4b2528c7cf3af',ramdisk_id='',reservation_id='r-8kwumzo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1993769457',owner_user_name='tempest-TestShelveInstance-1993769457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T04:01:48Z,user_data=None,user_id='96c596f1b11b4fa6845a49d0c56d1cdc',uuid=d37238e9-39cd-4605-a870-c6c69b22834b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Converting VIF {"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=6e54ed58-c2f0-43c5-8316-511f7908c02e,network=Network(ad8a2537-08f1-4094-bfd1-9285359aadbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e54ed58-c2') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG nova.objects.instance [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lazy-loading 'pci_devices' on Instance uuid d37238e9-39cd-4605-a870-c6c69b22834b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] End _get_guest_xml xml=<domain type="kvm">
Oct 26 04:02:08 user nova-compute[74630]:   <uuid>d37238e9-39cd-4605-a870-c6c69b22834b</uuid>
Oct 26 04:02:08 user nova-compute[74630]:   <name>instance-00000032</name>
Oct 26 04:02:08 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 04:02:08 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 04:02:08 user nova-compute[74630]:   <metadata>
Oct 26 04:02:08 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 04:02:08 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 04:02:08 user nova-compute[74630]:       <nova:name>tempest-TestShelveInstance-server-30403276</nova:name>
Oct 26 04:02:08 user nova-compute[74630]:       <nova:creationTime>2023-10-26 04:02:06</nova:creationTime>
Oct 26 04:02:08 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 04:02:08 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 04:02:08 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 04:02:08 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 04:02:08 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 04:02:08 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 04:02:08 user nova-compute[74630]:       </nova:flavor>
Oct 26 04:02:08 user nova-compute[74630]:       <nova:owner>
Oct 26 04:02:08 user nova-compute[74630]:         <nova:user uuid="96c596f1b11b4fa6845a49d0c56d1cdc">tempest-TestShelveInstance-1993769457-project-member</nova:user>
Oct 26 04:02:08 user nova-compute[74630]:         <nova:project uuid="9c9f43800c8546da84a4b2528c7cf3af">tempest-TestShelveInstance-1993769457</nova:project>
Oct 26 04:02:08 user nova-compute[74630]:       </nova:owner>
Oct 26 04:02:08 user nova-compute[74630]:       <nova:ports>
Oct 26 04:02:08 user nova-compute[74630]:         <nova:port uuid="6e54ed58-c2f0-43c5-8316-511f7908c02e">
Oct 26 04:02:08 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 04:02:08 user nova-compute[74630]:         </nova:port>
Oct 26 04:02:08 user nova-compute[74630]:       </nova:ports>
Oct 26 04:02:08 user nova-compute[74630]:     </nova:instance>
Oct 26 04:02:08 user nova-compute[74630]:   </metadata>
Oct 26 04:02:08 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 04:02:08 user nova-compute[74630]:     <system>
Oct 26 04:02:08 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 04:02:08 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 04:02:08 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 04:02:08 user nova-compute[74630]:       <entry name="serial">d37238e9-39cd-4605-a870-c6c69b22834b</entry>
Oct 26 04:02:08 user nova-compute[74630]:       <entry name="uuid">d37238e9-39cd-4605-a870-c6c69b22834b</entry>
Oct 26 04:02:08 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 04:02:08 user nova-compute[74630]:     </system>
Oct 26 04:02:08 user nova-compute[74630]:   </sysinfo>
Oct 26 04:02:08 user nova-compute[74630]:   <os>
Oct 26 04:02:08 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 04:02:08 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 04:02:08 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 04:02:08 user nova-compute[74630]:   </os>
Oct 26 04:02:08 user nova-compute[74630]:   <features>
Oct 26 04:02:08 user nova-compute[74630]:     <acpi/>
Oct 26 04:02:08 user nova-compute[74630]:     <apic/>
Oct 26 04:02:08 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 04:02:08 user nova-compute[74630]:   </features>
Oct 26 04:02:08 user nova-compute[74630]:   <clock offset="utc">
Oct 26 04:02:08 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 04:02:08 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 04:02:08 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 04:02:08 user nova-compute[74630]:   </clock>
Oct 26 04:02:08 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 04:02:08 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 04:02:08 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 04:02:08 user nova-compute[74630]:   </cpu>
Oct 26 04:02:08 user nova-compute[74630]:   <devices>
Oct 26 04:02:08 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 04:02:08 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:02:08 user nova-compute[74630]:       <source dev="/dev/sdb"/>
Oct 26 04:02:08 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 04:02:08 user nova-compute[74630]:       <serial>67489b74-94cc-4429-8e21-f89abc80b034</serial>
Oct 26 04:02:08 user nova-compute[74630]:     </disk>
Oct 26 04:02:08 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 04:02:08 user nova-compute[74630]:       <mac address="fa:16:3e:42:e3:29"/>
Oct 26 04:02:08 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 04:02:08 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 04:02:08 user nova-compute[74630]:       <target dev="tap6e54ed58-c2"/>
Oct 26 04:02:08 user nova-compute[74630]:     </interface>
Oct 26 04:02:08 user nova-compute[74630]:     <serial type="pty">
Oct 26 04:02:08 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/d37238e9-39cd-4605-a870-c6c69b22834b/console.log" append="off"/>
Oct 26 04:02:08 user nova-compute[74630]:     </serial>
Oct 26 04:02:08 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 04:02:08 user nova-compute[74630]:     <video>
Oct 26 04:02:08 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 04:02:08 user nova-compute[74630]:     </video>
Oct 26 04:02:08 user nova-compute[74630]:     <rng model="virtio">
Oct 26 04:02:08 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 04:02:08 user nova-compute[74630]:     </rng>
Oct 26 04:02:08 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 04:02:08 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 04:02:08 user nova-compute[74630]:       <stats period="10"/>
Oct 26 04:02:08 user nova-compute[74630]:     </memballoon>
Oct 26 04:02:08 user nova-compute[74630]:   </devices>
Oct 26 04:02:08 user nova-compute[74630]: </domain>
Oct 26 04:02:08 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T04:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-30403276',display_name='tempest-TestShelveInstance-server-30403276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-30403276',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpwZbeVvWqMIrse9jqV356hQeCjjtAitu6ZLe3vy7VgaQ56KqTb6ML+JuI6Ggpo/o2Vk0ZIvGG+Oyw+favsHOZpNHvgyN4yMaeLnlujM+XfU5er5o8PFPK2nF17krwq/g==',key_name='tempest-TestShelveInstance-1204480980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c9f43800c8546da84a4b2528c7cf3af',ramdisk_id='',reservation_id='r-8kwumzo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1993769457',owner_user_name='tempest-TestShelveInstance-1993769457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T04:01:48Z,user_data=None,user_id='96c596f1b11b4fa6845a49d0c56d1cdc',uuid=d37238e9-39cd-4605-a870-c6c69b22834b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Converting VIF {"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=6e54ed58-c2f0-43c5-8316-511f7908c02e,network=Network(ad8a2537-08f1-4094-bfd1-9285359aadbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e54ed58-c2') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG os_vif [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=6e54ed58-c2f0-43c5-8316-511f7908c02e,network=Network(ad8a2537-08f1-4094-bfd1-9285359aadbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e54ed58-c2') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fed12a36-9073-531e-8750-8c5789947a2c', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e54ed58-c2, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e54ed58-c2, col_values=(('qos', UUID('9ff40178-1b23-49bd-ac72-f66fa01ae0b4')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e54ed58-c2, col_values=(('external_ids', {'iface-id': '6e54ed58-c2f0-43c5-8316-511f7908c02e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:e3:29', 'vm-uuid': 'd37238e9-39cd-4605-a870-c6c69b22834b'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:08 user nova-compute[74630]: INFO os_vif [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=6e54ed58-c2f0-43c5-8316-511f7908c02e,network=Network(ad8a2537-08f1-4094-bfd1-9285359aadbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e54ed58-c2')
Oct 26 04:02:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:02:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] No VIF found with MAC fa:16:3e:42:e3:29, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 04:02:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-0934b25b-3ae9-49b1-9955-a658ad009a03 req-c1f3c20d-a524-4cd9-b92d-1babc31c00ef service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received event network-vif-plugged-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:02:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0934b25b-3ae9-49b1-9955-a658ad009a03 req-c1f3c20d-a524-4cd9-b92d-1babc31c00ef service nova] Acquiring lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:02:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0934b25b-3ae9-49b1-9955-a658ad009a03 req-c1f3c20d-a524-4cd9-b92d-1babc31c00ef service nova] Lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:02:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0934b25b-3ae9-49b1-9955-a658ad009a03 req-c1f3c20d-a524-4cd9-b92d-1babc31c00ef service nova] Lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:09 user nova-compute[74630]: DEBUG nova.compute.manager [req-0934b25b-3ae9-49b1-9955-a658ad009a03 req-c1f3c20d-a524-4cd9-b92d-1babc31c00ef service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] No waiting events found dispatching network-vif-plugged-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:02:09 user nova-compute[74630]: WARNING nova.compute.manager [req-0934b25b-3ae9-49b1-9955-a658ad009a03 req-c1f3c20d-a524-4cd9-b92d-1babc31c00ef service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received unexpected event network-vif-plugged-6e54ed58-c2f0-43c5-8316-511f7908c02e for instance with vm_state building and task_state spawning.
Oct 26 04:02:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 04:02:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 04:02:11 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Instance spawned successfully.
Oct 26 04:02:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 04:02:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:02:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:02:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:02:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:02:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:02:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:02:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-24d663d2-7665-476c-833b-20aa490422f8 req-a790f8a6-682b-4806-b256-566c3f977539 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received event network-vif-plugged-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:02:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-24d663d2-7665-476c-833b-20aa490422f8 req-a790f8a6-682b-4806-b256-566c3f977539 service nova] Acquiring lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:02:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-24d663d2-7665-476c-833b-20aa490422f8 req-a790f8a6-682b-4806-b256-566c3f977539 service nova] Lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:02:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-24d663d2-7665-476c-833b-20aa490422f8 req-a790f8a6-682b-4806-b256-566c3f977539 service nova] Lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:11 user nova-compute[74630]: DEBUG nova.compute.manager [req-24d663d2-7665-476c-833b-20aa490422f8 req-a790f8a6-682b-4806-b256-566c3f977539 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] No waiting events found dispatching network-vif-plugged-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:02:11 user nova-compute[74630]: WARNING nova.compute.manager [req-24d663d2-7665-476c-833b-20aa490422f8 req-a790f8a6-682b-4806-b256-566c3f977539 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received unexpected event network-vif-plugged-6e54ed58-c2f0-43c5-8316-511f7908c02e for instance with vm_state building and task_state spawning.
Oct 26 04:02:11 user nova-compute[74630]: INFO nova.compute.manager [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Took 5.11 seconds to spawn the instance on the hypervisor.
Oct 26 04:02:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 04:02:11 user nova-compute[74630]: INFO nova.compute.manager [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Took 24.26 seconds to build instance.
Oct 26 04:02:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d37ef4bc-cb21-4744-b8ca-bf371863340e tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "d37238e9-39cd-4605-a870-c6c69b22834b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.362s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:13 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MveVgJad', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:02:18 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:02:18 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:02:18 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31a10e5-20b7-4cd0-858c-cb3718c7889a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 04:02:18 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dda79fb-d0d6-4ca1-978a-ba905941d734]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63] added
Oct 26 04:02:18 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f7511b-9e74-4a2f-8ba6-2f57728514a7]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b5b7ba-a557-47ac-ba65-59cc447e1f6f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MveVgJad {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MveVgJad" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[01aec591-d1cf-4790-ae9c-25cffe868e0c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MveVgJad'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6505e1cb-7295-4176-81bf-4fb93905bf99]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60a2aa8-3f76-4806-9062-402901dfda88]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:02:18 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:02:18 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c6b371-a1a1-46a1-bce2-3df18dece401]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63, portal: 172.16.0.220,3260]
Oct 26 04:02:18 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63, portal: 172.16.0.220,3260] successful.
Oct 26 04:02:18 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39d8a62-2df2-490b-b834-4669effb89fb]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 04:02:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Creating image(s)
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Ensure instance console log exists: /opt/stack/data/nova/instances/f9b83cf7-027f-4d50-a605-afda72da2d13/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Start _get_guest_xml network_info=[{"id": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "address": "fa:16:3e:fc:a0:23", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7b0f8c-96", "ovs_interfaceid": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqetYOCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f9b83cf7-027f-4d50-a605-afda72da2d13', 'attached_at': '', 'detached_at': '', 'volume_id': '3a3f0821-dbcb-4506-9894-44f41a671fc1', 'serial': '3a3f0821-dbcb-4506-9894-44f41a671fc1'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': '88d77b68-1ddc-484d-a407-c2238d1132c4', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:18 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:02:18 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[14efbfdc-80ac-4b3b-991d-d3a6a9c16543]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:02:18 user nova-compute[74630]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)
Oct 26 04:02:18 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:02:18 user nova-compute[74630]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)
Oct 26 04:02:18 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqetYOCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:02:18 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f5f4b9-d948-4dfd-9105-47b113f11803]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:02:18 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MveVgJad', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23438653039333563', 'path': '/dev/sdc'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438653039333563', 'path': '/dev/sdc'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.011s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:02:19 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:02:19 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG nova.objects.instance [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lazy-loading 'flavor' on Instance uuid 2276b252-dd39-40d6-b0e0-2068d1c40885 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[391b1742-c387-47ab-8e9d-382b5e45ce34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 04:02:19 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 04:02:19 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:02:19 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 04:02:19 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:02:19 user nova-compute[74630]:   <serial>91661e88-74a5-4300-981b-f257d0b8cf63</serial>
Oct 26 04:02:19 user nova-compute[74630]: </disk>
Oct 26 04:02:19 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c3d7f5-9b84-4c2f-b6ad-3690297abb7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1] added
Oct 26 04:02:19 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[617194ff-2537-4549-bcf8-b614d88a7bc8]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f14b3b-d393-4950-8a14-40ec57ba7c92]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqetYOCx {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqetYOCx" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a74f7c2-4b82-40bd-a12e-c3f3121bbda5]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HqetYOCx'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edb6034-a226-4a1e-9ca7-f71953e06730]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6133b4-9b87-4a96-a800-50c27b9fcba9]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:02:19 user nova-compute[74630]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)
Oct 26 04:02:19 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:02:19 user nova-compute[74630]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)
Oct 26 04:02:19 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5558e0ee-fe29-4104-9f4a-b722a9e8dcf0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260]
Oct 26 04:02:19 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260] successful.
Oct 26 04:02:19 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c33342-4dcd-493a-9433-45507933a1ea]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1907fb7e-c7c1-4c95-9a7d-a445df765c3d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:02:19 user nova-compute[74630]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)
Oct 26 04:02:19 user nova-compute[74630]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:02:19 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:02:19 user nova-compute[74630]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)
Oct 26 04:02:19 user nova-compute[74630]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:02:19 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a564e87-974f-46a2-9688-d81658e02730]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:02:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqetYOCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 04:02:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:02:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:02:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] No VIF found with MAC fa:16:3e:c9:ce:d1, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 04:02:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-265e298c-5882-4083-9a7d-a904bc270372 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 49.541s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:02:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== connect_volume: return (2345ms) {'type': 'block', 'scsi_wwn': '26138353739613934', 'path': '/dev/sdd'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:02:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138353739613934', 'path': '/dev/sdd'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 04:02:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T04:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2129270195',display_name='tempest-TestVolumeBootPattern-server-2129270195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2129270195',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/SIDPQ2UP+8pjr/EDeG7jiIvKtw4wxC8wOR9Ppgf68vzwgAsuUEGb0qigXIxPbeQGiuT7fPQKbEvjMZRXhfqo9CTc8iDOme/8ss3+oEiY5W1hrK42wG17Y5enspUZi+A==',key_name='tempest-TestVolumeBootPattern-1850034835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-s852oius',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T04:01:46Z,user_data=None,user_id='3b3bd794500243df86a1e4e89414bea0',uuid=f9b83cf7-027f-4d50-a605-afda72da2d13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "address": "fa:16:3e:fc:a0:23", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7b0f8c-96", "ovs_interfaceid": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 04:02:20 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "address": "fa:16:3e:fc:a0:23", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7b0f8c-96", "ovs_interfaceid": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:02:20 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a0:23,bridge_name='br-int',has_traffic_filtering=True,id=9a7b0f8c-963e-4eb6-922a-517e6fa625b8,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a7b0f8c-96') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:02:20 user nova-compute[74630]: DEBUG nova.objects.instance [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lazy-loading 'pci_devices' on Instance uuid f9b83cf7-027f-4d50-a605-afda72da2d13 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] End _get_guest_xml xml=<domain type="kvm">
Oct 26 04:02:21 user nova-compute[74630]:   <uuid>f9b83cf7-027f-4d50-a605-afda72da2d13</uuid>
Oct 26 04:02:21 user nova-compute[74630]:   <name>instance-00000031</name>
Oct 26 04:02:21 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 04:02:21 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 04:02:21 user nova-compute[74630]:   <metadata>
Oct 26 04:02:21 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 04:02:21 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 04:02:21 user nova-compute[74630]:       <nova:name>tempest-TestVolumeBootPattern-server-2129270195</nova:name>
Oct 26 04:02:21 user nova-compute[74630]:       <nova:creationTime>2023-10-26 04:02:18</nova:creationTime>
Oct 26 04:02:21 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 04:02:21 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 04:02:21 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 04:02:21 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 04:02:21 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 04:02:21 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 04:02:21 user nova-compute[74630]:       </nova:flavor>
Oct 26 04:02:21 user nova-compute[74630]:       <nova:owner>
Oct 26 04:02:21 user nova-compute[74630]:         <nova:user uuid="3b3bd794500243df86a1e4e89414bea0">tempest-TestVolumeBootPattern-1203294393-project-member</nova:user>
Oct 26 04:02:21 user nova-compute[74630]:         <nova:project uuid="4dbe37117ca24935b46795e7f7479af9">tempest-TestVolumeBootPattern-1203294393</nova:project>
Oct 26 04:02:21 user nova-compute[74630]:       </nova:owner>
Oct 26 04:02:21 user nova-compute[74630]:       <nova:ports>
Oct 26 04:02:21 user nova-compute[74630]:         <nova:port uuid="9a7b0f8c-963e-4eb6-922a-517e6fa625b8">
Oct 26 04:02:21 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 04:02:21 user nova-compute[74630]:         </nova:port>
Oct 26 04:02:21 user nova-compute[74630]:       </nova:ports>
Oct 26 04:02:21 user nova-compute[74630]:     </nova:instance>
Oct 26 04:02:21 user nova-compute[74630]:   </metadata>
Oct 26 04:02:21 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 04:02:21 user nova-compute[74630]:     <system>
Oct 26 04:02:21 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 04:02:21 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 04:02:21 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 04:02:21 user nova-compute[74630]:       <entry name="serial">f9b83cf7-027f-4d50-a605-afda72da2d13</entry>
Oct 26 04:02:21 user nova-compute[74630]:       <entry name="uuid">f9b83cf7-027f-4d50-a605-afda72da2d13</entry>
Oct 26 04:02:21 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 04:02:21 user nova-compute[74630]:     </system>
Oct 26 04:02:21 user nova-compute[74630]:   </sysinfo>
Oct 26 04:02:21 user nova-compute[74630]:   <os>
Oct 26 04:02:21 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 04:02:21 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 04:02:21 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 04:02:21 user nova-compute[74630]:   </os>
Oct 26 04:02:21 user nova-compute[74630]:   <features>
Oct 26 04:02:21 user nova-compute[74630]:     <acpi/>
Oct 26 04:02:21 user nova-compute[74630]:     <apic/>
Oct 26 04:02:21 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 04:02:21 user nova-compute[74630]:   </features>
Oct 26 04:02:21 user nova-compute[74630]:   <clock offset="utc">
Oct 26 04:02:21 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 04:02:21 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 04:02:21 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 04:02:21 user nova-compute[74630]:   </clock>
Oct 26 04:02:21 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 04:02:21 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 04:02:21 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 04:02:21 user nova-compute[74630]:   </cpu>
Oct 26 04:02:21 user nova-compute[74630]:   <devices>
Oct 26 04:02:21 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 04:02:21 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:02:21 user nova-compute[74630]:       <source dev="/dev/sdd"/>
Oct 26 04:02:21 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 04:02:21 user nova-compute[74630]:       <serial>3a3f0821-dbcb-4506-9894-44f41a671fc1</serial>
Oct 26 04:02:21 user nova-compute[74630]:     </disk>
Oct 26 04:02:21 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 04:02:21 user nova-compute[74630]:       <mac address="fa:16:3e:fc:a0:23"/>
Oct 26 04:02:21 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 04:02:21 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 04:02:21 user nova-compute[74630]:       <target dev="tap9a7b0f8c-96"/>
Oct 26 04:02:21 user nova-compute[74630]:     </interface>
Oct 26 04:02:21 user nova-compute[74630]:     <serial type="pty">
Oct 26 04:02:21 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/f9b83cf7-027f-4d50-a605-afda72da2d13/console.log" append="off"/>
Oct 26 04:02:21 user nova-compute[74630]:     </serial>
Oct 26 04:02:21 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 04:02:21 user nova-compute[74630]:     <video>
Oct 26 04:02:21 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 04:02:21 user nova-compute[74630]:     </video>
Oct 26 04:02:21 user nova-compute[74630]:     <rng model="virtio">
Oct 26 04:02:21 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 04:02:21 user nova-compute[74630]:     </rng>
Oct 26 04:02:21 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 04:02:21 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 04:02:21 user nova-compute[74630]:       <stats period="10"/>
Oct 26 04:02:21 user nova-compute[74630]:     </memballoon>
Oct 26 04:02:21 user nova-compute[74630]:   </devices>
Oct 26 04:02:21 user nova-compute[74630]: </domain>
Oct 26 04:02:21 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T04:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2129270195',display_name='tempest-TestVolumeBootPattern-server-2129270195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2129270195',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/SIDPQ2UP+8pjr/EDeG7jiIvKtw4wxC8wOR9Ppgf68vzwgAsuUEGb0qigXIxPbeQGiuT7fPQKbEvjMZRXhfqo9CTc8iDOme/8ss3+oEiY5W1hrK42wG17Y5enspUZi+A==',key_name='tempest-TestVolumeBootPattern-1850034835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-s852oius',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T04:01:46Z,user_data=None,user_id='3b3bd794500243df86a1e4e89414bea0',uuid=f9b83cf7-027f-4d50-a605-afda72da2d13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "address": "fa:16:3e:fc:a0:23", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7b0f8c-96", "ovs_interfaceid": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "address": "fa:16:3e:fc:a0:23", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7b0f8c-96", "ovs_interfaceid": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a0:23,bridge_name='br-int',has_traffic_filtering=True,id=9a7b0f8c-963e-4eb6-922a-517e6fa625b8,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a7b0f8c-96') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG os_vif [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a0:23,bridge_name='br-int',has_traffic_filtering=True,id=9a7b0f8c-963e-4eb6-922a-517e6fa625b8,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a7b0f8c-96') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'add9b0ad-2d7f-51ba-a64c-3e2cb0a894af', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a7b0f8c-96, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a7b0f8c-96, col_values=(('qos', UUID('8804e0cf-83d7-4d3d-9b32-feba4c97af0e')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a7b0f8c-96, col_values=(('external_ids', {'iface-id': '9a7b0f8c-963e-4eb6-922a-517e6fa625b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:a0:23', 'vm-uuid': 'f9b83cf7-027f-4d50-a605-afda72da2d13'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:21 user nova-compute[74630]: INFO os_vif [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:a0:23,bridge_name='br-int',has_traffic_filtering=True,id=9a7b0f8c-963e-4eb6-922a-517e6fa625b8,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a7b0f8c-96')
Oct 26 04:02:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:02:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] No VIF found with MAC fa:16:3e:fc:a0:23, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 04:02:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-822c85f7-2794-4d61-b99b-ed75f82676f8 req-2890681b-37cb-490f-82ae-8ceb1d058edb service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received event network-changed-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:02:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-822c85f7-2794-4d61-b99b-ed75f82676f8 req-2890681b-37cb-490f-82ae-8ceb1d058edb service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Refreshing instance network info cache due to event network-changed-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:02:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-822c85f7-2794-4d61-b99b-ed75f82676f8 req-2890681b-37cb-490f-82ae-8ceb1d058edb service nova] Acquiring lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:02:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-822c85f7-2794-4d61-b99b-ed75f82676f8 req-2890681b-37cb-490f-82ae-8ceb1d058edb service nova] Acquired lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:02:22 user nova-compute[74630]: DEBUG nova.network.neutron [req-822c85f7-2794-4d61-b99b-ed75f82676f8 req-2890681b-37cb-490f-82ae-8ceb1d058edb service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Refreshing network info cache for port 3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:02:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-1b66ad8a-66de-4c66-94ac-9d946a9b02f9 req-1541f5e7-0818-40c4-9bbd-c71db3f85704 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received event network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:02:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1b66ad8a-66de-4c66-94ac-9d946a9b02f9 req-1541f5e7-0818-40c4-9bbd-c71db3f85704 service nova] Acquiring lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:02:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1b66ad8a-66de-4c66-94ac-9d946a9b02f9 req-1541f5e7-0818-40c4-9bbd-c71db3f85704 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:02:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1b66ad8a-66de-4c66-94ac-9d946a9b02f9 req-1541f5e7-0818-40c4-9bbd-c71db3f85704 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-1b66ad8a-66de-4c66-94ac-9d946a9b02f9 req-1541f5e7-0818-40c4-9bbd-c71db3f85704 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] No waiting events found dispatching network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:02:22 user nova-compute[74630]: WARNING nova.compute.manager [req-1b66ad8a-66de-4c66-94ac-9d946a9b02f9 req-1541f5e7-0818-40c4-9bbd-c71db3f85704 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received unexpected event network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 for instance with vm_state building and task_state spawning.
Oct 26 04:02:22 user nova-compute[74630]: DEBUG nova.network.neutron [req-822c85f7-2794-4d61-b99b-ed75f82676f8 req-2890681b-37cb-490f-82ae-8ceb1d058edb service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updated VIF entry in instance network info cache for port 3fe1b43c-b4a6-4a74-a018-8ed57cc50be4. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:02:22 user nova-compute[74630]: DEBUG nova.network.neutron [req-822c85f7-2794-4d61-b99b-ed75f82676f8 req-2890681b-37cb-490f-82ae-8ceb1d058edb service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updating instance_info_cache with network_info: [{"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:02:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-822c85f7-2794-4d61-b99b-ed75f82676f8 req-2890681b-37cb-490f-82ae-8ceb1d058edb service nova] Releasing lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:02:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:24 user nova-compute[74630]: DEBUG nova.compute.manager [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 04:02:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 04:02:24 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Instance spawned successfully.
Oct 26 04:02:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 04:02:24 user nova-compute[74630]: DEBUG nova.compute.manager [req-fc2bb137-9490-41dd-b812-794faba90ea4 req-92075ce8-0975-4161-8f80-541b17f18744 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received event network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:02:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-fc2bb137-9490-41dd-b812-794faba90ea4 req-92075ce8-0975-4161-8f80-541b17f18744 service nova] Acquiring lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:02:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-fc2bb137-9490-41dd-b812-794faba90ea4 req-92075ce8-0975-4161-8f80-541b17f18744 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:02:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-fc2bb137-9490-41dd-b812-794faba90ea4 req-92075ce8-0975-4161-8f80-541b17f18744 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:24 user nova-compute[74630]: DEBUG nova.compute.manager [req-fc2bb137-9490-41dd-b812-794faba90ea4 req-92075ce8-0975-4161-8f80-541b17f18744 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] No waiting events found dispatching network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:02:24 user nova-compute[74630]: WARNING nova.compute.manager [req-fc2bb137-9490-41dd-b812-794faba90ea4 req-92075ce8-0975-4161-8f80-541b17f18744 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received unexpected event network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 for instance with vm_state building and task_state spawning.
Oct 26 04:02:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:02:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:02:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:02:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:02:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:02:24 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:02:24 user nova-compute[74630]: INFO nova.compute.manager [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Took 6.42 seconds to spawn the instance on the hypervisor.
Oct 26 04:02:24 user nova-compute[74630]: DEBUG nova.compute.manager [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 04:02:25 user nova-compute[74630]: DEBUG nova.compute.manager [req-c1812f34-a81c-46ad-95b9-396c6efc58e7 req-c823b861-22f2-46ff-ab22-1d6856c8eb9b service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received event network-changed-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:02:25 user nova-compute[74630]: DEBUG nova.compute.manager [req-c1812f34-a81c-46ad-95b9-396c6efc58e7 req-c823b861-22f2-46ff-ab22-1d6856c8eb9b service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Refreshing instance network info cache due to event network-changed-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:02:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c1812f34-a81c-46ad-95b9-396c6efc58e7 req-c823b861-22f2-46ff-ab22-1d6856c8eb9b service nova] Acquiring lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:02:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c1812f34-a81c-46ad-95b9-396c6efc58e7 req-c823b861-22f2-46ff-ab22-1d6856c8eb9b service nova] Acquired lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:02:25 user nova-compute[74630]: DEBUG nova.network.neutron [req-c1812f34-a81c-46ad-95b9-396c6efc58e7 req-c823b861-22f2-46ff-ab22-1d6856c8eb9b service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Refreshing network info cache for port 3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:02:25 user nova-compute[74630]: INFO nova.compute.manager [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Took 39.65 seconds to build instance.
Oct 26 04:02:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-95c3328a-e342-4a9d-8bd5-3ba2631f12f8 tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.782s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:25 user nova-compute[74630]: DEBUG nova.network.neutron [req-c1812f34-a81c-46ad-95b9-396c6efc58e7 req-c823b861-22f2-46ff-ab22-1d6856c8eb9b service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updated VIF entry in instance network info cache for port 3fe1b43c-b4a6-4a74-a018-8ed57cc50be4. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:02:25 user nova-compute[74630]: DEBUG nova.network.neutron [req-c1812f34-a81c-46ad-95b9-396c6efc58e7 req-c823b861-22f2-46ff-ab22-1d6856c8eb9b service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updating instance_info_cache with network_info: [{"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:02:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c1812f34-a81c-46ad-95b9-396c6efc58e7 req-c823b861-22f2-46ff-ab22-1d6856c8eb9b service nova] Releasing lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:02:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9da9e55d-bc72-4338-84fb-75eef0d7c9f3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "2276b252-dd39-40d6-b0e0-2068d1c40885" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:02:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9da9e55d-bc72-4338-84fb-75eef0d7c9f3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:02:25 user nova-compute[74630]: INFO nova.compute.manager [None req-9da9e55d-bc72-4338-84fb-75eef0d7c9f3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Rebooting instance
Oct 26 04:02:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9da9e55d-bc72-4338-84fb-75eef0d7c9f3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:02:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9da9e55d-bc72-4338-84fb-75eef0d7c9f3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquired lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:02:26 user nova-compute[74630]: DEBUG nova.network.neutron [None req-9da9e55d-bc72-4338-84fb-75eef0d7c9f3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 04:02:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:26 user nova-compute[74630]: DEBUG nova.network.neutron [None req-9da9e55d-bc72-4338-84fb-75eef0d7c9f3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updating instance_info_cache with network_info: [{"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:02:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9da9e55d-bc72-4338-84fb-75eef0d7c9f3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Releasing lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:02:26 user nova-compute[74630]: DEBUG nova.compute.manager [None req-9da9e55d-bc72-4338-84fb-75eef0d7c9f3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 04:02:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-06c9a6a2-5e50-4bba-9417-b3cc7982014a req-3bea57d7-855e-464b-81db-cfb721c710b4 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received event network-vif-unplugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:02:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-06c9a6a2-5e50-4bba-9417-b3cc7982014a req-3bea57d7-855e-464b-81db-cfb721c710b4 service nova] Acquiring lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:02:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-06c9a6a2-5e50-4bba-9417-b3cc7982014a req-3bea57d7-855e-464b-81db-cfb721c710b4 service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:02:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-06c9a6a2-5e50-4bba-9417-b3cc7982014a req-3bea57d7-855e-464b-81db-cfb721c710b4 service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-06c9a6a2-5e50-4bba-9417-b3cc7982014a req-3bea57d7-855e-464b-81db-cfb721c710b4 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] No waiting events found dispatching network-vif-unplugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:02:29 user nova-compute[74630]: WARNING nova.compute.manager [req-06c9a6a2-5e50-4bba-9417-b3cc7982014a req-3bea57d7-855e-464b-81db-cfb721c710b4 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received unexpected event network-vif-unplugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 for instance with vm_state active and task_state reboot_started.
Oct 26 04:02:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:29 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-9da9e55d-bc72-4338-84fb-75eef0d7c9f3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Instance shutdown successfully.
Oct 26 04:02:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-295c863b-beac-4fc6-b07e-5920e2444e19 req-8d1c37f1-28b2-4d1a-9d34-00618fa96a83 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received event network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:02:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-295c863b-beac-4fc6-b07e-5920e2444e19 req-8d1c37f1-28b2-4d1a-9d34-00618fa96a83 service nova] Acquiring lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:02:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-295c863b-beac-4fc6-b07e-5920e2444e19 req-8d1c37f1-28b2-4d1a-9d34-00618fa96a83 service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:02:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-295c863b-beac-4fc6-b07e-5920e2444e19 req-8d1c37f1-28b2-4d1a-9d34-00618fa96a83 service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-295c863b-beac-4fc6-b07e-5920e2444e19 req-8d1c37f1-28b2-4d1a-9d34-00618fa96a83 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] No waiting events found dispatching network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:02:31 user nova-compute[74630]: WARNING nova.compute.manager [req-295c863b-beac-4fc6-b07e-5920e2444e19 req-8d1c37f1-28b2-4d1a-9d34-00618fa96a83 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received unexpected event network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 for instance with vm_state active and task_state reboot_started.
Oct 26 04:02:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-295c863b-beac-4fc6-b07e-5920e2444e19 req-8d1c37f1-28b2-4d1a-9d34-00618fa96a83 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received event network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:02:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-295c863b-beac-4fc6-b07e-5920e2444e19 req-8d1c37f1-28b2-4d1a-9d34-00618fa96a83 service nova] Acquiring lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:02:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-295c863b-beac-4fc6-b07e-5920e2444e19 req-8d1c37f1-28b2-4d1a-9d34-00618fa96a83 service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:02:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-295c863b-beac-4fc6-b07e-5920e2444e19 req-8d1c37f1-28b2-4d1a-9d34-00618fa96a83 service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-295c863b-beac-4fc6-b07e-5920e2444e19 req-8d1c37f1-28b2-4d1a-9d34-00618fa96a83 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] No waiting events found dispatching network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:02:31 user nova-compute[74630]: WARNING nova.compute.manager [req-295c863b-beac-4fc6-b07e-5920e2444e19 req-8d1c37f1-28b2-4d1a-9d34-00618fa96a83 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received unexpected event network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 for instance with vm_state active and task_state reboot_started.
Oct 26 04:02:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:33 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Instance running successfully.
Oct 26 04:02:33 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-9da9e55d-bc72-4338-84fb-75eef0d7c9f3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Instance soft rebooted successfully.
Oct 26 04:02:33 user nova-compute[74630]: DEBUG nova.compute.manager [None req-9da9e55d-bc72-4338-84fb-75eef0d7c9f3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 04:02:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-9da9e55d-bc72-4338-84fb-75eef0d7c9f3 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.202s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:33 user nova-compute[74630]: DEBUG nova.compute.manager [req-dcf22645-b1e3-4ec8-9679-0374440eeed7 req-0f143928-626f-4a5c-aaea-361d1ae706c2 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received event network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:02:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dcf22645-b1e3-4ec8-9679-0374440eeed7 req-0f143928-626f-4a5c-aaea-361d1ae706c2 service nova] Acquiring lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:02:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dcf22645-b1e3-4ec8-9679-0374440eeed7 req-0f143928-626f-4a5c-aaea-361d1ae706c2 service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:02:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dcf22645-b1e3-4ec8-9679-0374440eeed7 req-0f143928-626f-4a5c-aaea-361d1ae706c2 service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:33 user nova-compute[74630]: DEBUG nova.compute.manager [req-dcf22645-b1e3-4ec8-9679-0374440eeed7 req-0f143928-626f-4a5c-aaea-361d1ae706c2 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] No waiting events found dispatching network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:02:33 user nova-compute[74630]: WARNING nova.compute.manager [req-dcf22645-b1e3-4ec8-9679-0374440eeed7 req-0f143928-626f-4a5c-aaea-361d1ae706c2 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received unexpected event network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 for instance with vm_state active and task_state None.
Oct 26 04:02:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:39 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:02:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:02:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:53 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:02:53 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:02:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:02:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:02:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:02:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:02:53 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:02:53 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid 2276b252-dd39-40d6-b0e0-2068d1c40885 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:02:53 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updating instance_info_cache with network_info: [{"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:02:53 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:02:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:02:54 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:02:54 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:02:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:55 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:02:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:02:57 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:02:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:02:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:02:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:57 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:02:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:02:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:02:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 04:02:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 04:02:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 04:02:57 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:02:57 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:02:57 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8517MB free_disk=24.914966583251953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:02:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:02:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:02:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 2276b252-dd39-40d6-b0e0-2068d1c40885 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:02:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9b83cf7-027f-4d50-a605-afda72da2d13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:02:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d37238e9-39cd-4605-a870-c6c69b22834b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:02:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:02:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:02:58 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing inventories for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 04:02:58 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating ProviderTree inventory for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 04:02:58 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating inventory in ProviderTree for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 04:02:58 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing aggregate associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, aggregates: None {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 04:02:58 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing trait associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, traits: HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 04:02:58 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:02:58 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:02:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:02:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:02:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:01 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:03:01 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:03:04 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:03:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:03:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:03:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:03:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:03:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:03:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:36 user nova-compute[74630]: DEBUG nova.compute.manager [req-78a38c5b-e247-4fab-bcb9-dc1d5111a54d req-7ef060a5-0719-4952-b892-eb5ffadafcd8 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received event network-changed-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:03:36 user nova-compute[74630]: DEBUG nova.compute.manager [req-78a38c5b-e247-4fab-bcb9-dc1d5111a54d req-7ef060a5-0719-4952-b892-eb5ffadafcd8 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Refreshing instance network info cache due to event network-changed-9a7b0f8c-963e-4eb6-922a-517e6fa625b8. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:03:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-78a38c5b-e247-4fab-bcb9-dc1d5111a54d req-7ef060a5-0719-4952-b892-eb5ffadafcd8 service nova] Acquiring lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:03:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-78a38c5b-e247-4fab-bcb9-dc1d5111a54d req-7ef060a5-0719-4952-b892-eb5ffadafcd8 service nova] Acquired lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:03:36 user nova-compute[74630]: DEBUG nova.network.neutron [req-78a38c5b-e247-4fab-bcb9-dc1d5111a54d req-7ef060a5-0719-4952-b892-eb5ffadafcd8 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Refreshing network info cache for port 9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:03:37 user nova-compute[74630]: DEBUG nova.network.neutron [req-78a38c5b-e247-4fab-bcb9-dc1d5111a54d req-7ef060a5-0719-4952-b892-eb5ffadafcd8 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Updated VIF entry in instance network info cache for port 9a7b0f8c-963e-4eb6-922a-517e6fa625b8. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:03:37 user nova-compute[74630]: DEBUG nova.network.neutron [req-78a38c5b-e247-4fab-bcb9-dc1d5111a54d req-7ef060a5-0719-4952-b892-eb5ffadafcd8 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Updating instance_info_cache with network_info: [{"id": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "address": "fa:16:3e:fc:a0:23", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7b0f8c-96", "ovs_interfaceid": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:03:37 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-78a38c5b-e247-4fab-bcb9-dc1d5111a54d req-7ef060a5-0719-4952-b892-eb5ffadafcd8 service nova] Releasing lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:03:39 user nova-compute[74630]: DEBUG nova.compute.manager [req-dc3fe959-11d4-45f1-9e55-a3749865b5c4 req-1e79d225-bf99-4068-92f5-b97e930961ae service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received event network-changed-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:03:39 user nova-compute[74630]: DEBUG nova.compute.manager [req-dc3fe959-11d4-45f1-9e55-a3749865b5c4 req-1e79d225-bf99-4068-92f5-b97e930961ae service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Refreshing instance network info cache due to event network-changed-6e54ed58-c2f0-43c5-8316-511f7908c02e. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:03:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dc3fe959-11d4-45f1-9e55-a3749865b5c4 req-1e79d225-bf99-4068-92f5-b97e930961ae service nova] Acquiring lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:03:39 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dc3fe959-11d4-45f1-9e55-a3749865b5c4 req-1e79d225-bf99-4068-92f5-b97e930961ae service nova] Acquired lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:03:39 user nova-compute[74630]: DEBUG nova.network.neutron [req-dc3fe959-11d4-45f1-9e55-a3749865b5c4 req-1e79d225-bf99-4068-92f5-b97e930961ae service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Refreshing network info cache for port 6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:03:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:40 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:03:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "d37238e9-39cd-4605-a870-c6c69b22834b" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:03:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "d37238e9-39cd-4605-a870-c6c69b22834b" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:03:40 user nova-compute[74630]: INFO nova.compute.manager [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Shelve offloading
Oct 26 04:03:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:40 user nova-compute[74630]: DEBUG nova.network.neutron [req-dc3fe959-11d4-45f1-9e55-a3749865b5c4 req-1e79d225-bf99-4068-92f5-b97e930961ae service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updated VIF entry in instance network info cache for port 6e54ed58-c2f0-43c5-8316-511f7908c02e. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:03:40 user nova-compute[74630]: DEBUG nova.network.neutron [req-dc3fe959-11d4-45f1-9e55-a3749865b5c4 req-1e79d225-bf99-4068-92f5-b97e930961ae service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updating instance_info_cache with network_info: [{"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:03:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-dc3fe959-11d4-45f1-9e55-a3749865b5c4 req-1e79d225-bf99-4068-92f5-b97e930961ae service nova] Releasing lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:03:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:40 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Instance destroyed successfully.
Oct 26 04:03:40 user nova-compute[74630]: DEBUG nova.compute.manager [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 04:03:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:03:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquired lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:03:40 user nova-compute[74630]: DEBUG nova.network.neutron [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG nova.network.neutron [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updating instance_info_cache with network_info: [{"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Releasing lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-44cdf5eb-252e-45b3-a865-357961bf6317 req-e0ed9430-ffc2-45e8-9583-4d5dd5ab88bf service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received event network-vif-unplugged-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-44cdf5eb-252e-45b3-a865-357961bf6317 req-e0ed9430-ffc2-45e8-9583-4d5dd5ab88bf service nova] Acquiring lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-44cdf5eb-252e-45b3-a865-357961bf6317 req-e0ed9430-ffc2-45e8-9583-4d5dd5ab88bf service nova] Lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-44cdf5eb-252e-45b3-a865-357961bf6317 req-e0ed9430-ffc2-45e8-9583-4d5dd5ab88bf service nova] Lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-44cdf5eb-252e-45b3-a865-357961bf6317 req-e0ed9430-ffc2-45e8-9583-4d5dd5ab88bf service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] No waiting events found dispatching network-vif-unplugged-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:03:41 user nova-compute[74630]: WARNING nova.compute.manager [req-44cdf5eb-252e-45b3-a865-357961bf6317 req-e0ed9430-ffc2-45e8-9583-4d5dd5ab88bf service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received unexpected event network-vif-unplugged-6e54ed58-c2f0-43c5-8316-511f7908c02e for instance with vm_state active and task_state shelving.
Oct 26 04:03:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-44cdf5eb-252e-45b3-a865-357961bf6317 req-e0ed9430-ffc2-45e8-9583-4d5dd5ab88bf service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received event network-vif-plugged-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-44cdf5eb-252e-45b3-a865-357961bf6317 req-e0ed9430-ffc2-45e8-9583-4d5dd5ab88bf service nova] Acquiring lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-44cdf5eb-252e-45b3-a865-357961bf6317 req-e0ed9430-ffc2-45e8-9583-4d5dd5ab88bf service nova] Lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-44cdf5eb-252e-45b3-a865-357961bf6317 req-e0ed9430-ffc2-45e8-9583-4d5dd5ab88bf service nova] Lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-44cdf5eb-252e-45b3-a865-357961bf6317 req-e0ed9430-ffc2-45e8-9583-4d5dd5ab88bf service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] No waiting events found dispatching network-vif-plugged-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:03:41 user nova-compute[74630]: WARNING nova.compute.manager [req-44cdf5eb-252e-45b3-a865-357961bf6317 req-e0ed9430-ffc2-45e8-9583-4d5dd5ab88bf service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received unexpected event network-vif-plugged-6e54ed58-c2f0-43c5-8316-511f7908c02e for instance with vm_state active and task_state shelving.
Oct 26 04:03:41 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Instance destroyed successfully.
Oct 26 04:03:41 user nova-compute[74630]: DEBUG nova.objects.instance [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lazy-loading 'resources' on Instance uuid d37238e9-39cd-4605-a870-c6c69b22834b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T04:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-30403276',display_name='tempest-TestShelveInstance-server-30403276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-30403276',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpwZbeVvWqMIrse9jqV356hQeCjjtAitu6ZLe3vy7VgaQ56KqTb6ML+JuI6Ggpo/o2Vk0ZIvGG+Oyw+favsHOZpNHvgyN4yMaeLnlujM+XfU5er5o8PFPK2nF17krwq/g==',key_name='tempest-TestShelveInstance-1204480980',keypairs=<?>,launch_index=0,launched_at=2023-10-26T04:02:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c9f43800c8546da84a4b2528c7cf3af',ramdisk_id='',reservation_id='r-8kwumzo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1993769457',owner_user_name='tempest-TestShelveInstance-1993769457-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T04:02:12Z,user_data=None,user_id='96c596f1b11b4fa6845a49d0c56d1cdc',uuid=d37238e9-39cd-4605-a870-c6c69b22834b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Converting VIF {"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=6e54ed58-c2f0-43c5-8316-511f7908c02e,network=Network(ad8a2537-08f1-4094-bfd1-9285359aadbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e54ed58-c2') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG os_vif [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=6e54ed58-c2f0-43c5-8316-511f7908c02e,network=Network(ad8a2537-08f1-4094-bfd1-9285359aadbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e54ed58-c2') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e54ed58-c2, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-ce8d70d9-fc7f-4b9d-b7bc-24f983f75464 req-4ff1b319-1e7e-4e20-a5a6-5cb0b53135fb service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received event network-changed-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG nova.compute.manager [req-ce8d70d9-fc7f-4b9d-b7bc-24f983f75464 req-4ff1b319-1e7e-4e20-a5a6-5cb0b53135fb service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Refreshing instance network info cache due to event network-changed-6e54ed58-c2f0-43c5-8316-511f7908c02e. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ce8d70d9-fc7f-4b9d-b7bc-24f983f75464 req-4ff1b319-1e7e-4e20-a5a6-5cb0b53135fb service nova] Acquiring lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ce8d70d9-fc7f-4b9d-b7bc-24f983f75464 req-4ff1b319-1e7e-4e20-a5a6-5cb0b53135fb service nova] Acquired lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG nova.network.neutron [req-ce8d70d9-fc7f-4b9d-b7bc-24f983f75464 req-4ff1b319-1e7e-4e20-a5a6-5cb0b53135fb service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Refreshing network info cache for port 6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ff40178-1b23-49bd-ac72-f66fa01ae0b4) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:03:41 user nova-compute[74630]: INFO os_vif [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=6e54ed58-c2f0-43c5-8316-511f7908c02e,network=Network(ad8a2537-08f1-4094-bfd1-9285359aadbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e54ed58-c2')
Oct 26 04:03:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKmbUQwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:03:41 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:03:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc51d2ee-274d-4370-b711-ee1be6e819df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 04:03:41 user nova-compute[74630]: No targets found.
Oct 26 04:03:41 user nova-compute[74630]: iSNS:
Oct 26 04:03:41 user nova-compute[74630]: No targets found.
Oct 26 04:03:41 user nova-compute[74630]: STATIC:
Oct 26 04:03:41 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63
Oct 26 04:03:41 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:03:41 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:03:41 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034
Oct 26 04:03:41 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:03:41 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:03:41 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1
Oct 26 04:03:41 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:03:41 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:03:41 user nova-compute[74630]: FIRMWARE:
Oct 26 04:03:41 user nova-compute[74630]: No targets found.
Oct 26 04:03:41 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 04:03:41 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 04:03:41 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[067973e2-fa30-4cf8-8986-f17822174c87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[de021548-720d-4e2f-a0fc-09c1a7781481]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:03:41 user nova-compute[74630]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)
Oct 26 04:03:41 user nova-compute[74630]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:03:41 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:03:41 user nova-compute[74630]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)
Oct 26 04:03:41 user nova-compute[74630]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:03:41 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f315c796ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af8f838-74db-402f-8af9-4a78457676eb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d1429a-6435-4f21-99bb-40e820e8a8f6]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[88050f46-c34f-4b3e-8c54-bd8062fbb2ca]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 04:03:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f20e16a-5a8d-48e7-a27d-c10316ee0e0b]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f24f3f-958f-4977-afbd-a38f952fed93]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6768c5e-efd8-4df6-8967-a1878d6c0374]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260]
Oct 26 04:03:42 user nova-compute[74630]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260] successful.
Oct 26 04:03:42 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[43793ea4-f7fc-4f31-bf49-5097268824b3]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] <== disconnect_volume: return (279ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 04:03:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Deleting instance files /opt/stack/data/nova/instances/d37238e9-39cd-4605-a870-c6c69b22834b_del
Oct 26 04:03:42 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Deletion of /opt/stack/data/nova/instances/d37238e9-39cd-4605-a870-c6c69b22834b_del complete
Oct 26 04:03:42 user nova-compute[74630]: DEBUG nova.network.neutron [req-ce8d70d9-fc7f-4b9d-b7bc-24f983f75464 req-4ff1b319-1e7e-4e20-a5a6-5cb0b53135fb service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updated VIF entry in instance network info cache for port 6e54ed58-c2f0-43c5-8316-511f7908c02e. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG nova.network.neutron [req-ce8d70d9-fc7f-4b9d-b7bc-24f983f75464 req-4ff1b319-1e7e-4e20-a5a6-5cb0b53135fb service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updating instance_info_cache with network_info: [{"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": null, "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:03:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-ce8d70d9-fc7f-4b9d-b7bc-24f983f75464 req-4ff1b319-1e7e-4e20-a5a6-5cb0b53135fb service nova] Releasing lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:03:43 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Deleted allocations for instance d37238e9-39cd-4605-a870-c6c69b22834b
Oct 26 04:03:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:03:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:03:43 user nova-compute[74630]: DEBUG nova.objects.instance [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lazy-loading 'numa_topology' on Instance uuid d37238e9-39cd-4605-a870-c6c69b22834b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:03:43 user nova-compute[74630]: DEBUG nova.objects.base [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Object Instance<d37238e9-39cd-4605-a870-c6c69b22834b> lazy-loaded attributes: resources,numa_topology {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 04:03:43 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:03:43 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:03:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:03:43 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d6dfa22c-899e-4cad-b8d9-51636e93c1c7 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "d37238e9-39cd-4605-a870-c6c69b22834b" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.593s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:03:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:03:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:53 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:03:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:03:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:03:54 user nova-compute[74630]: DEBUG nova.compute.manager [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 04:03:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:03:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:03:54 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 04:03:54 user nova-compute[74630]: INFO nova.compute.claims [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Claim successful on node user
Oct 26 04:03:55 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG nova.compute.manager [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG nova.compute.manager [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:03:55 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 04:03:55 user nova-compute[74630]: DEBUG nova.compute.manager [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG nova.policy [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b3bd794500243df86a1e4e89414bea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dbe37117ca24935b46795e7f7479af9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 04:03:55 user nova-compute[74630]: INFO nova.virt.block_device [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Booting with volume 0e4d639e-4754-4743-a587-931bc2ee9cb5 at /dev/vda
Oct 26 04:03:55 user nova-compute[74630]: DEBUG os_brick.utils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b24d731-3bd1-4235-8f90-bd143da3314d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bcfc51-2c6d-44d3-856f-db737b59eeda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[57da8dfa-0706-499f-a00e-ce34bb262de5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4078f773-c1a7-4012-af0c-15e48bcfd204]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:03:55 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5830cdb9-d4c9-4785-a19b-289b6d2f45c1]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG os_brick.utils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Updating existing volume attachment record: e54bd245-2300-4870-bc1d-a3b85c3c24e9 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Updating instance_info_cache with network_info: [{"id": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "address": "fa:16:3e:fc:a0:23", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7b0f8c-96", "ovs_interfaceid": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:03:55 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:03:56 user nova-compute[74630]: DEBUG nova.network.neutron [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Successfully created port: c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 04:03:56 user nova-compute[74630]: DEBUG nova.network.neutron [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Successfully updated port: c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 04:03:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "refresh_cache-4a15e8e6-35a8-4958-99d5-7e8a187f18f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:03:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquired lock "refresh_cache-4a15e8e6-35a8-4958-99d5-7e8a187f18f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:03:56 user nova-compute[74630]: DEBUG nova.network.neutron [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 04:03:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:03:56 user nova-compute[74630]: DEBUG nova.compute.manager [req-d841398c-107f-4262-aebf-32e396db36af req-67e56633-b37a-4b53-a088-3355530a0469 service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Received event network-changed-c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:03:56 user nova-compute[74630]: DEBUG nova.compute.manager [req-d841398c-107f-4262-aebf-32e396db36af req-67e56633-b37a-4b53-a088-3355530a0469 service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Refreshing instance network info cache due to event network-changed-c2779cdf-2358-4fb2-839e-5ddff169ecbc. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:03:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d841398c-107f-4262-aebf-32e396db36af req-67e56633-b37a-4b53-a088-3355530a0469 service nova] Acquiring lock "refresh_cache-4a15e8e6-35a8-4958-99d5-7e8a187f18f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG nova.network.neutron [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG nova.network.neutron [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Updating instance_info_cache with network_info: [{"id": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "address": "fa:16:3e:cf:7b:ea", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2779cdf-23", "ovs_interfaceid": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Releasing lock "refresh_cache-4a15e8e6-35a8-4958-99d5-7e8a187f18f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG nova.compute.manager [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Instance network_info: |[{"id": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "address": "fa:16:3e:cf:7b:ea", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2779cdf-23", "ovs_interfaceid": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d841398c-107f-4262-aebf-32e396db36af req-67e56633-b37a-4b53-a088-3355530a0469 service nova] Acquired lock "refresh_cache-4a15e8e6-35a8-4958-99d5-7e8a187f18f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG nova.network.neutron [req-d841398c-107f-4262-aebf-32e396db36af req-67e56633-b37a-4b53-a088-3355530a0469 service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Refreshing network info cache for port c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 04:03:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 04:03:57 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:03:57 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:03:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=24.913406372070312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:03:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:03:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:03:58 user nova-compute[74630]: DEBUG nova.network.neutron [req-d841398c-107f-4262-aebf-32e396db36af req-67e56633-b37a-4b53-a088-3355530a0469 service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Updated VIF entry in instance network info cache for port c2779cdf-2358-4fb2-839e-5ddff169ecbc. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:03:58 user nova-compute[74630]: DEBUG nova.network.neutron [req-d841398c-107f-4262-aebf-32e396db36af req-67e56633-b37a-4b53-a088-3355530a0469 service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Updating instance_info_cache with network_info: [{"id": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "address": "fa:16:3e:cf:7b:ea", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2779cdf-23", "ovs_interfaceid": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:03:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d841398c-107f-4262-aebf-32e396db36af req-67e56633-b37a-4b53-a088-3355530a0469 service nova] Releasing lock "refresh_cache-4a15e8e6-35a8-4958-99d5-7e8a187f18f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:03:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 2276b252-dd39-40d6-b0e0-2068d1c40885 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:03:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9b83cf7-027f-4d50-a605-afda72da2d13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:03:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 4a15e8e6-35a8-4958-99d5-7e8a187f18f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:03:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:03:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:03:58 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:03:58 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:03:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:03:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:04:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:04:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:04:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:04:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:04:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:02 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:04:05 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:04:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:04:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:04:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:04:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:04:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.compute.manager [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 04:04:13 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Creating image(s)
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Ensure instance console log exists: /opt/stack/data/nova/instances/4a15e8e6-35a8-4958-99d5-7e8a187f18f7/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Start _get_guest_xml network_info=[{"id": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "address": "fa:16:3e:cf:7b:ea", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2779cdf-23", "ovs_interfaceid": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTJfLMVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a15e8e6-35a8-4958-99d5-7e8a187f18f7', 'attached_at': '', 'detached_at': '', 'volume_id': '0e4d639e-4754-4743-a587-931bc2ee9cb5', 'serial': '0e4d639e-4754-4743-a587-931bc2ee9cb5'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'device_type': 'disk', 'attachment_id': 'e54bd245-2300-4870-bc1d-a3b85c3c24e9', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 04:04:13 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:04:13 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTJfLMVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:04:13 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:04:13 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:04:13 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[78388e88-b295-48f7-9adc-e7883f3efe3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 04:04:13 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b163176-62e9-41cb-ad86-7934ea90bcd0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5] added
Oct 26 04:04:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbf8be5-18ac-4967-9745-8380f9d2c6a8]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9162ff5-fc6e-4f73-bb5d-fce813e6b37a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WTJfLMVt {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WTJfLMVt" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8f082f-e18d-483f-87ca-f939a0cfeb81]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WTJfLMVt'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f922bdc6-288a-4e98-b785-6029b3b624c8]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b00a7e-3fa5-4b8f-95f0-7fa62d8e46a0]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)
Oct 26 04:04:13 user nova-compute[74630]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:04:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)
Oct 26 04:04:13 user nova-compute[74630]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:04:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7827606-0a57-4079-a36a-336fd6098d00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5, portal: 172.16.0.220,3260]
Oct 26 04:04:13 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5, portal: 172.16.0.220,3260] successful.
Oct 26 04:04:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9dcc2a-68ce-4480-ba2f-d06003c17981]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[718a0c54-6a9b-4079-abc3-ce9480ea8f08]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)
Oct 26 04:04:13 user nova-compute[74630]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:04:13 user nova-compute[74630]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 (non-flash)
Oct 26 04:04:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)
Oct 26 04:04:13 user nova-compute[74630]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:04:13 user nova-compute[74630]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 (non-flash)
Oct 26 04:04:13 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c3117a-e80f-4e0f-bfc0-a94b9526a703]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:13 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTJfLMVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26335363936363739', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335363936363739', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T04:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-474031025',display_name='tempest-TestVolumeBootPattern-server-474031025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-474031025',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/SIDPQ2UP+8pjr/EDeG7jiIvKtw4wxC8wOR9Ppgf68vzwgAsuUEGb0qigXIxPbeQGiuT7fPQKbEvjMZRXhfqo9CTc8iDOme/8ss3+oEiY5W1hrK42wG17Y5enspUZi+A==',key_name='tempest-TestVolumeBootPattern-1850034835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-x6lgc0ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T04:03:55Z,user_data=None,user_id='3b3bd794500243df86a1e4e89414bea0',uuid=4a15e8e6-35a8-4958-99d5-7e8a187f18f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "address": "fa:16:3e:cf:7b:ea", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2779cdf-23", "ovs_interfaceid": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "address": "fa:16:3e:cf:7b:ea", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2779cdf-23", "ovs_interfaceid": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:7b:ea,bridge_name='br-int',has_traffic_filtering=True,id=c2779cdf-2358-4fb2-839e-5ddff169ecbc,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2779cdf-23') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG nova.objects.instance [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a15e8e6-35a8-4958-99d5-7e8a187f18f7 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] End _get_guest_xml xml=<domain type="kvm">
Oct 26 04:04:14 user nova-compute[74630]:   <uuid>4a15e8e6-35a8-4958-99d5-7e8a187f18f7</uuid>
Oct 26 04:04:14 user nova-compute[74630]:   <name>instance-00000033</name>
Oct 26 04:04:14 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 04:04:14 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 04:04:14 user nova-compute[74630]:   <metadata>
Oct 26 04:04:14 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 04:04:14 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 04:04:14 user nova-compute[74630]:       <nova:name>tempest-TestVolumeBootPattern-server-474031025</nova:name>
Oct 26 04:04:14 user nova-compute[74630]:       <nova:creationTime>2023-10-26 04:04:13</nova:creationTime>
Oct 26 04:04:14 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 04:04:14 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 04:04:14 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 04:04:14 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 04:04:14 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 04:04:14 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 04:04:14 user nova-compute[74630]:       </nova:flavor>
Oct 26 04:04:14 user nova-compute[74630]:       <nova:owner>
Oct 26 04:04:14 user nova-compute[74630]:         <nova:user uuid="3b3bd794500243df86a1e4e89414bea0">tempest-TestVolumeBootPattern-1203294393-project-member</nova:user>
Oct 26 04:04:14 user nova-compute[74630]:         <nova:project uuid="4dbe37117ca24935b46795e7f7479af9">tempest-TestVolumeBootPattern-1203294393</nova:project>
Oct 26 04:04:14 user nova-compute[74630]:       </nova:owner>
Oct 26 04:04:14 user nova-compute[74630]:       <nova:ports>
Oct 26 04:04:14 user nova-compute[74630]:         <nova:port uuid="c2779cdf-2358-4fb2-839e-5ddff169ecbc">
Oct 26 04:04:14 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 04:04:14 user nova-compute[74630]:         </nova:port>
Oct 26 04:04:14 user nova-compute[74630]:       </nova:ports>
Oct 26 04:04:14 user nova-compute[74630]:     </nova:instance>
Oct 26 04:04:14 user nova-compute[74630]:   </metadata>
Oct 26 04:04:14 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 04:04:14 user nova-compute[74630]:     <system>
Oct 26 04:04:14 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 04:04:14 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 04:04:14 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 04:04:14 user nova-compute[74630]:       <entry name="serial">4a15e8e6-35a8-4958-99d5-7e8a187f18f7</entry>
Oct 26 04:04:14 user nova-compute[74630]:       <entry name="uuid">4a15e8e6-35a8-4958-99d5-7e8a187f18f7</entry>
Oct 26 04:04:14 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 04:04:14 user nova-compute[74630]:     </system>
Oct 26 04:04:14 user nova-compute[74630]:   </sysinfo>
Oct 26 04:04:14 user nova-compute[74630]:   <os>
Oct 26 04:04:14 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 04:04:14 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 04:04:14 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 04:04:14 user nova-compute[74630]:   </os>
Oct 26 04:04:14 user nova-compute[74630]:   <features>
Oct 26 04:04:14 user nova-compute[74630]:     <acpi/>
Oct 26 04:04:14 user nova-compute[74630]:     <apic/>
Oct 26 04:04:14 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 04:04:14 user nova-compute[74630]:   </features>
Oct 26 04:04:14 user nova-compute[74630]:   <clock offset="utc">
Oct 26 04:04:14 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 04:04:14 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 04:04:14 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 04:04:14 user nova-compute[74630]:   </clock>
Oct 26 04:04:14 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 04:04:14 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 04:04:14 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 04:04:14 user nova-compute[74630]:   </cpu>
Oct 26 04:04:14 user nova-compute[74630]:   <devices>
Oct 26 04:04:14 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 04:04:14 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:04:14 user nova-compute[74630]:       <source dev="/dev/sdb"/>
Oct 26 04:04:14 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 04:04:14 user nova-compute[74630]:       <serial>0e4d639e-4754-4743-a587-931bc2ee9cb5</serial>
Oct 26 04:04:14 user nova-compute[74630]:     </disk>
Oct 26 04:04:14 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 04:04:14 user nova-compute[74630]:       <mac address="fa:16:3e:cf:7b:ea"/>
Oct 26 04:04:14 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 04:04:14 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 04:04:14 user nova-compute[74630]:       <target dev="tapc2779cdf-23"/>
Oct 26 04:04:14 user nova-compute[74630]:     </interface>
Oct 26 04:04:14 user nova-compute[74630]:     <serial type="pty">
Oct 26 04:04:14 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/4a15e8e6-35a8-4958-99d5-7e8a187f18f7/console.log" append="off"/>
Oct 26 04:04:14 user nova-compute[74630]:     </serial>
Oct 26 04:04:14 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 04:04:14 user nova-compute[74630]:     <video>
Oct 26 04:04:14 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 04:04:14 user nova-compute[74630]:     </video>
Oct 26 04:04:14 user nova-compute[74630]:     <rng model="virtio">
Oct 26 04:04:14 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 04:04:14 user nova-compute[74630]:     </rng>
Oct 26 04:04:14 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 04:04:14 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 04:04:14 user nova-compute[74630]:       <stats period="10"/>
Oct 26 04:04:14 user nova-compute[74630]:     </memballoon>
Oct 26 04:04:14 user nova-compute[74630]:   </devices>
Oct 26 04:04:14 user nova-compute[74630]: </domain>
Oct 26 04:04:14 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T04:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-474031025',display_name='tempest-TestVolumeBootPattern-server-474031025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-474031025',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/SIDPQ2UP+8pjr/EDeG7jiIvKtw4wxC8wOR9Ppgf68vzwgAsuUEGb0qigXIxPbeQGiuT7fPQKbEvjMZRXhfqo9CTc8iDOme/8ss3+oEiY5W1hrK42wG17Y5enspUZi+A==',key_name='tempest-TestVolumeBootPattern-1850034835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-x6lgc0ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T04:03:55Z,user_data=None,user_id='3b3bd794500243df86a1e4e89414bea0',uuid=4a15e8e6-35a8-4958-99d5-7e8a187f18f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "address": "fa:16:3e:cf:7b:ea", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2779cdf-23", "ovs_interfaceid": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "address": "fa:16:3e:cf:7b:ea", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2779cdf-23", "ovs_interfaceid": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:7b:ea,bridge_name='br-int',has_traffic_filtering=True,id=c2779cdf-2358-4fb2-839e-5ddff169ecbc,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2779cdf-23') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG os_vif [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:7b:ea,bridge_name='br-int',has_traffic_filtering=True,id=c2779cdf-2358-4fb2-839e-5ddff169ecbc,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2779cdf-23') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ee81c21-da51-59ee-b875-eaa2c662774b', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2779cdf-23, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2779cdf-23, col_values=(('qos', UUID('e4f4d531-9597-43e2-8c11-969f85e402fa')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2779cdf-23, col_values=(('external_ids', {'iface-id': 'c2779cdf-2358-4fb2-839e-5ddff169ecbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:7b:ea', 'vm-uuid': '4a15e8e6-35a8-4958-99d5-7e8a187f18f7'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:14 user nova-compute[74630]: INFO os_vif [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:7b:ea,bridge_name='br-int',has_traffic_filtering=True,id=c2779cdf-2358-4fb2-839e-5ddff169ecbc,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2779cdf-23')
Oct 26 04:04:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:04:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] No VIF found with MAC fa:16:3e:cf:7b:ea, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 04:04:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-e389fcb8-fa68-44fc-8f5a-cee3754b28a2 req-e61faafd-3248-44d1-9b08-0de6f7f31774 service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Received event network-vif-plugged-c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:04:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e389fcb8-fa68-44fc-8f5a-cee3754b28a2 req-e61faafd-3248-44d1-9b08-0de6f7f31774 service nova] Acquiring lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:04:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e389fcb8-fa68-44fc-8f5a-cee3754b28a2 req-e61faafd-3248-44d1-9b08-0de6f7f31774 service nova] Lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:04:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e389fcb8-fa68-44fc-8f5a-cee3754b28a2 req-e61faafd-3248-44d1-9b08-0de6f7f31774 service nova] Lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:04:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-e389fcb8-fa68-44fc-8f5a-cee3754b28a2 req-e61faafd-3248-44d1-9b08-0de6f7f31774 service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] No waiting events found dispatching network-vif-plugged-c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:04:16 user nova-compute[74630]: WARNING nova.compute.manager [req-e389fcb8-fa68-44fc-8f5a-cee3754b28a2 req-e61faafd-3248-44d1-9b08-0de6f7f31774 service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Received unexpected event network-vif-plugged-c2779cdf-2358-4fb2-839e-5ddff169ecbc for instance with vm_state building and task_state spawning.
Oct 26 04:04:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:17 user nova-compute[74630]: DEBUG nova.compute.manager [req-6138611b-26df-41a2-a8f5-35f20b097505 req-111ce1df-3028-4491-bed9-ef4eb20832be service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received event network-changed-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:04:17 user nova-compute[74630]: DEBUG nova.compute.manager [req-6138611b-26df-41a2-a8f5-35f20b097505 req-111ce1df-3028-4491-bed9-ef4eb20832be service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Refreshing instance network info cache due to event network-changed-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:04:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6138611b-26df-41a2-a8f5-35f20b097505 req-111ce1df-3028-4491-bed9-ef4eb20832be service nova] Acquiring lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:04:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6138611b-26df-41a2-a8f5-35f20b097505 req-111ce1df-3028-4491-bed9-ef4eb20832be service nova] Acquired lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:04:17 user nova-compute[74630]: DEBUG nova.network.neutron [req-6138611b-26df-41a2-a8f5-35f20b097505 req-111ce1df-3028-4491-bed9-ef4eb20832be service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Refreshing network info cache for port 3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:04:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 04:04:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 04:04:17 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Instance spawned successfully.
Oct 26 04:04:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 04:04:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:04:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:04:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:04:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:04:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:04:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:04:18 user nova-compute[74630]: DEBUG nova.network.neutron [req-6138611b-26df-41a2-a8f5-35f20b097505 req-111ce1df-3028-4491-bed9-ef4eb20832be service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updated VIF entry in instance network info cache for port 3fe1b43c-b4a6-4a74-a018-8ed57cc50be4. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:04:18 user nova-compute[74630]: DEBUG nova.network.neutron [req-6138611b-26df-41a2-a8f5-35f20b097505 req-111ce1df-3028-4491-bed9-ef4eb20832be service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updating instance_info_cache with network_info: [{"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:04:18 user nova-compute[74630]: INFO nova.compute.manager [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Took 4.94 seconds to spawn the instance on the hypervisor.
Oct 26 04:04:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 04:04:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6138611b-26df-41a2-a8f5-35f20b097505 req-111ce1df-3028-4491-bed9-ef4eb20832be service nova] Releasing lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:04:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-de3557aa-5398-4dda-9fc6-951d69c421fb req-f752e4f1-3b91-4a58-82d9-2ba51bb659de service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Received event network-vif-plugged-c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:04:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-de3557aa-5398-4dda-9fc6-951d69c421fb req-f752e4f1-3b91-4a58-82d9-2ba51bb659de service nova] Acquiring lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:04:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-de3557aa-5398-4dda-9fc6-951d69c421fb req-f752e4f1-3b91-4a58-82d9-2ba51bb659de service nova] Lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:04:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-de3557aa-5398-4dda-9fc6-951d69c421fb req-f752e4f1-3b91-4a58-82d9-2ba51bb659de service nova] Lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:04:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-de3557aa-5398-4dda-9fc6-951d69c421fb req-f752e4f1-3b91-4a58-82d9-2ba51bb659de service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] No waiting events found dispatching network-vif-plugged-c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:04:18 user nova-compute[74630]: WARNING nova.compute.manager [req-de3557aa-5398-4dda-9fc6-951d69c421fb req-f752e4f1-3b91-4a58-82d9-2ba51bb659de service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Received unexpected event network-vif-plugged-c2779cdf-2358-4fb2-839e-5ddff169ecbc for instance with vm_state active and task_state None.
Oct 26 04:04:18 user nova-compute[74630]: INFO nova.compute.manager [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Took 23.39 seconds to build instance.
Oct 26 04:04:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-00550ebe-d0d0-4c2e-ab0e-f3a4febc238a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.493s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:04:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "2276b252-dd39-40d6-b0e0-2068d1c40885" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:04:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:04:18 user nova-compute[74630]: INFO nova.compute.manager [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Detaching volume 91661e88-74a5-4300-981b-f257d0b8cf63
Oct 26 04:04:18 user nova-compute[74630]: INFO nova.virt.block_device [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Attempting to driver detach volume 91661e88-74a5-4300-981b-f257d0b8cf63 from mountpoint /dev/vdb
Oct 26 04:04:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Attempting to detach device vdb from instance 2276b252-dd39-40d6-b0e0-2068d1c40885 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 04:04:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:04:18 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:04:18 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 04:04:18 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:04:18 user nova-compute[74630]:   <serial>91661e88-74a5-4300-981b-f257d0b8cf63</serial>
Oct 26 04:04:18 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:04:18 user nova-compute[74630]: </disk>
Oct 26 04:04:18 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:04:18 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Successfully detached device vdb from instance 2276b252-dd39-40d6-b0e0-2068d1c40885 from the persistent domain config.
Oct 26 04:04:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2276b252-dd39-40d6-b0e0-2068d1c40885 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 04:04:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:04:18 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:04:18 user nova-compute[74630]:   <source dev="/dev/sdc"/>
Oct 26 04:04:18 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:04:18 user nova-compute[74630]:   <serial>91661e88-74a5-4300-981b-f257d0b8cf63</serial>
Oct 26 04:04:18 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:04:18 user nova-compute[74630]: </disk>
Oct 26 04:04:18 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:04:18 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2276b252-dd39-40d6-b0e0-2068d1c40885 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 04:04:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-4667cd11-3fdb-47c2-bfd8-d613f2232bd9 req-29dcd84a-91c9-47f1-b6eb-5d442ce8f26f service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received event network-changed-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:04:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-4667cd11-3fdb-47c2-bfd8-d613f2232bd9 req-29dcd84a-91c9-47f1-b6eb-5d442ce8f26f service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Refreshing instance network info cache due to event network-changed-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:04:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4667cd11-3fdb-47c2-bfd8-d613f2232bd9 req-29dcd84a-91c9-47f1-b6eb-5d442ce8f26f service nova] Acquiring lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:04:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4667cd11-3fdb-47c2-bfd8-d613f2232bd9 req-29dcd84a-91c9-47f1-b6eb-5d442ce8f26f service nova] Acquired lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:04:20 user nova-compute[74630]: DEBUG nova.network.neutron [req-4667cd11-3fdb-47c2-bfd8-d613f2232bd9 req-29dcd84a-91c9-47f1-b6eb-5d442ce8f26f service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Refreshing network info cache for port 3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:04:20 user nova-compute[74630]: DEBUG nova.network.neutron [req-4667cd11-3fdb-47c2-bfd8-d613f2232bd9 req-29dcd84a-91c9-47f1-b6eb-5d442ce8f26f service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updated VIF entry in instance network info cache for port 3fe1b43c-b4a6-4a74-a018-8ed57cc50be4. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:04:20 user nova-compute[74630]: DEBUG nova.network.neutron [req-4667cd11-3fdb-47c2-bfd8-d613f2232bd9 req-29dcd84a-91c9-47f1-b6eb-5d442ce8f26f service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updating instance_info_cache with network_info: [{"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:04:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4667cd11-3fdb-47c2-bfd8-d613f2232bd9 req-29dcd84a-91c9-47f1-b6eb-5d442ce8f26f service nova] Releasing lock "refresh_cache-2276b252-dd39-40d6-b0e0-2068d1c40885" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:04:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:04:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:04:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:04:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:04:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:04:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:04:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:38 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2276b252-dd39-40d6-b0e0-2068d1c40885 is timed out.
Oct 26 04:04:38 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Successfully detached device vdb from instance 2276b252-dd39-40d6-b0e0-2068d1c40885 from the live domain config.
Oct 26 04:04:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 04:04:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MveVgJad', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:04:38 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:04:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:04:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:04:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:38 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb9709e-acc5-4fa7-9f2a-8a20efc29234]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 04:04:38 user nova-compute[74630]: No targets found.
Oct 26 04:04:38 user nova-compute[74630]: iSNS:
Oct 26 04:04:38 user nova-compute[74630]: No targets found.
Oct 26 04:04:38 user nova-compute[74630]: STATIC:
Oct 26 04:04:38 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5
Oct 26 04:04:38 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:04:38 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:04:38 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63
Oct 26 04:04:38 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:04:38 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:04:38 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1
Oct 26 04:04:38 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:04:38 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:04:38 user nova-compute[74630]: FIRMWARE:
Oct 26 04:04:38 user nova-compute[74630]: No targets found.
Oct 26 04:04:38 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:04:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 04:04:38 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 04:04:38 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 04:04:38 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 04:04:38 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c159b88-f876-4904-b45f-d90b88b1ffeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f930e4ee-1506-463d-8aff-3ff80461ad8a]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)
Oct 26 04:04:39 user nova-compute[74630]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:04:39 user nova-compute[74630]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 (non-flash)
Oct 26 04:04:39 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 (non-flash)
Oct 26 04:04:39 user nova-compute[74630]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:04:39 user nova-compute[74630]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 (non-flash)
Oct 26 04:04:39 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f318464d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63'): ({'sdc'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Removing single pathed devices sdc {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa6c25e-ca77-440f-95a1-e3045ffa2d46]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4011db4-3e54-4535-9206-67569b079259]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Flushing IO for device /dev/sdc {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c87fd95-5935-4e7e-b026-eb8817bc4382]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1906b9-b767-4190-9933-fb559bdd381a]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] SCSI volumes sdc have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdef71de-16b4-409c-9ae5-be186c137d62]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3335302b-d411-4643-ae2a-e0e1ec709fdb]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63, portal: 172.16.0.220,3260]
Oct 26 04:04:39 user nova-compute[74630]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63, portal: 172.16.0.220,3260] successful.
Oct 26 04:04:39 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91661e88-74a5-4300-981b-f257d0b8cf63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff330c35-63cc-4d79-8318-deb470148385]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] <== disconnect_volume: return (305ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:40 user nova-compute[74630]: DEBUG nova.objects.instance [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lazy-loading 'flavor' on Instance uuid 2276b252-dd39-40d6-b0e0-2068d1c40885 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:04:40 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-61d9b1b5-41f0-445b-b35c-ccd21965264d tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.788s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:04:42 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:04:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:04:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:04:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:04:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:04:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:04:55 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 04:04:57 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:04:57 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:04:57 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8651MB free_disk=24.911758422851562GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:04:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:04:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 2276b252-dd39-40d6-b0e0-2068d1c40885 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:04:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9b83cf7-027f-4d50-a605-afda72da2d13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:04:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance 4a15e8e6-35a8-4958-99d5-7e8a187f18f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:04:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:04:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:04:58 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:04:58 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:04:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:04:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:04:59 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:04:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:05:01 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:05:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:05:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:05:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:05:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:05:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:05 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:05:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:05:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:05:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:05:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:05:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:05:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:05:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:05:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "2276b252-dd39-40d6-b0e0-2068d1c40885" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:19 user nova-compute[74630]: INFO nova.compute.manager [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Terminating instance
Oct 26 04:05:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-e773861f-828e-407e-a3c6-2198dd8b5f01 req-9cf0ace4-6026-43f1-81d8-7a2e3b5aa005 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received event network-vif-unplugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e773861f-828e-407e-a3c6-2198dd8b5f01 req-9cf0ace4-6026-43f1-81d8-7a2e3b5aa005 service nova] Acquiring lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e773861f-828e-407e-a3c6-2198dd8b5f01 req-9cf0ace4-6026-43f1-81d8-7a2e3b5aa005 service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e773861f-828e-407e-a3c6-2198dd8b5f01 req-9cf0ace4-6026-43f1-81d8-7a2e3b5aa005 service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-e773861f-828e-407e-a3c6-2198dd8b5f01 req-9cf0ace4-6026-43f1-81d8-7a2e3b5aa005 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] No waiting events found dispatching network-vif-unplugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:05:19 user nova-compute[74630]: DEBUG nova.compute.manager [req-e773861f-828e-407e-a3c6-2198dd8b5f01 req-9cf0ace4-6026-43f1-81d8-7a2e3b5aa005 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received event network-vif-unplugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:20 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Instance destroyed successfully.
Oct 26 04:05:20 user nova-compute[74630]: DEBUG nova.objects.instance [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lazy-loading 'resources' on Instance uuid 2276b252-dd39-40d6-b0e0-2068d1c40885 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T03:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-195522810',display_name='tempest-TestMinimumBasicScenario-server-195522810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-195522810',id=48,image_ref='44b6e60b-c7e5-44f0-b839-7648dc0a1514',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdvtkgV2VTRoxsaerF2gtNXBg/Ir6n35ETN3ox4hwfE/9TNffT9IzpDvZb+aszYIXUysbBSBR1fHWUyuZL/LooYqBtkZAGtTPM1Qq0VB+zsrwNQ0eCPtS5jgOYDr/o3xg==',key_name='tempest-TestMinimumBasicScenario-271791202',keypairs=<?>,launch_index=0,launched_at=2023-10-26T03:59:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d280a7d3a82455f9929dea5a753861c',ramdisk_id='',reservation_id='r-jgh7teqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='44b6e60b-c7e5-44f0-b839-7648dc0a1514',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1824331495',owner_user_name='tempest-TestMinimumBasicScenario-1824331495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T04:02:33Z,user_data=None,user_id='550739bc40d54768ba62e194386d0857',uuid=2276b252-dd39-40d6-b0e0-2068d1c40885,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converting VIF {"id": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "address": "fa:16:3e:c9:ce:d1", "network": {"id": "bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-506164171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d280a7d3a82455f9929dea5a753861c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe1b43c-b4", "ovs_interfaceid": "3fe1b43c-b4a6-4a74-a018-8ed57cc50be4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:ce:d1,bridge_name='br-int',has_traffic_filtering=True,id=3fe1b43c-b4a6-4a74-a018-8ed57cc50be4,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe1b43c-b4') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG os_vif [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:ce:d1,bridge_name='br-int',has_traffic_filtering=True,id=3fe1b43c-b4a6-4a74-a018-8ed57cc50be4,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe1b43c-b4') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fe1b43c-b4, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd63b1f2-594b-4428-bd46-58701c642228) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:20 user nova-compute[74630]: INFO os_vif [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:ce:d1,bridge_name='br-int',has_traffic_filtering=True,id=3fe1b43c-b4a6-4a74-a018-8ed57cc50be4,network=Network(bcb1048b-dc94-4e5d-9db9-6d2caac2d5a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe1b43c-b4')
Oct 26 04:05:20 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Deleting instance files /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885_del
Oct 26 04:05:20 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Deletion of /opt/stack/data/nova/instances/2276b252-dd39-40d6-b0e0-2068d1c40885_del complete
Oct 26 04:05:20 user nova-compute[74630]: INFO nova.compute.manager [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 26 04:05:20 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:05:20 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Took 0.45 seconds to deallocate network for instance.
Oct 26 04:05:20 user nova-compute[74630]: DEBUG nova.compute.manager [req-cf09b2c2-5573-4fe9-bcf3-368015f35cdd req-d3520f89-2fdd-410e-9a43-8cb94d5123d9 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received event network-vif-deleted-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:21 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:05:21 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:05:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:21 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Deleted allocations for instance 2276b252-dd39-40d6-b0e0-2068d1c40885
Oct 26 04:05:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-92094975-bb7c-4125-90be-a82a28e5bab4 tempest-TestMinimumBasicScenario-1824331495 tempest-TestMinimumBasicScenario-1824331495-project-member] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.680s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:21 user nova-compute[74630]: DEBUG nova.compute.manager [req-a457a301-93f7-4616-8798-f221a5b948ce req-0c2cd2f2-cae3-4bdd-a617-2b8a20faa870 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received event network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:05:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a457a301-93f7-4616-8798-f221a5b948ce req-0c2cd2f2-cae3-4bdd-a617-2b8a20faa870 service nova] Acquiring lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a457a301-93f7-4616-8798-f221a5b948ce req-0c2cd2f2-cae3-4bdd-a617-2b8a20faa870 service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-a457a301-93f7-4616-8798-f221a5b948ce req-0c2cd2f2-cae3-4bdd-a617-2b8a20faa870 service nova] Lock "2276b252-dd39-40d6-b0e0-2068d1c40885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:21 user nova-compute[74630]: DEBUG nova.compute.manager [req-a457a301-93f7-4616-8798-f221a5b948ce req-0c2cd2f2-cae3-4bdd-a617-2b8a20faa870 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] No waiting events found dispatching network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:05:21 user nova-compute[74630]: WARNING nova.compute.manager [req-a457a301-93f7-4616-8798-f221a5b948ce req-0c2cd2f2-cae3-4bdd-a617-2b8a20faa870 service nova] [instance: 2276b252-dd39-40d6-b0e0-2068d1c40885] Received unexpected event network-vif-plugged-3fe1b43c-b4a6-4a74-a018-8ed57cc50be4 for instance with vm_state deleted and task_state None.
Oct 26 04:05:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "d37238e9-39cd-4605-a870-c6c69b22834b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "d37238e9-39cd-4605-a870-c6c69b22834b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:31 user nova-compute[74630]: INFO nova.compute.manager [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Unshelving
Oct 26 04:05:31 user nova-compute[74630]: INFO nova.virt.block_device [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Booting with volume 67489b74-94cc-4429-8e21-f89abc80b034 at /dev/vda
Oct 26 04:05:31 user nova-compute[74630]: DEBUG os_brick.utils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e2517f-1062-4010-ab53-d4adf383b296]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bad2ed-67ac-4af0-980c-657ded7023ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[935d4fd8-8098-4c34-a1be-21cd28d912c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[de847c94-2834-4c6f-90f8-5827f55474eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:05:31 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 04:05:31 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcab579c-deac-4432-96ed-2d114cb9f7a6]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG os_brick.utils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:05:31 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updating existing volume attachment record: fcde8b0d-9962-4092-b2ca-112a48e91e51 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 04:05:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:05:43 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:05:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:05:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-66ab3f92-58bd-450b-bc4c-fd186ed16be2 req-7ba493de-1bbd-4afc-9449-70e30a34361e service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Received event network-changed-c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:05:46 user nova-compute[74630]: DEBUG nova.compute.manager [req-66ab3f92-58bd-450b-bc4c-fd186ed16be2 req-7ba493de-1bbd-4afc-9449-70e30a34361e service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Refreshing instance network info cache due to event network-changed-c2779cdf-2358-4fb2-839e-5ddff169ecbc. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:05:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-66ab3f92-58bd-450b-bc4c-fd186ed16be2 req-7ba493de-1bbd-4afc-9449-70e30a34361e service nova] Acquiring lock "refresh_cache-4a15e8e6-35a8-4958-99d5-7e8a187f18f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:05:46 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-66ab3f92-58bd-450b-bc4c-fd186ed16be2 req-7ba493de-1bbd-4afc-9449-70e30a34361e service nova] Acquired lock "refresh_cache-4a15e8e6-35a8-4958-99d5-7e8a187f18f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:05:46 user nova-compute[74630]: DEBUG nova.network.neutron [req-66ab3f92-58bd-450b-bc4c-fd186ed16be2 req-7ba493de-1bbd-4afc-9449-70e30a34361e service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Refreshing network info cache for port c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG nova.network.neutron [req-66ab3f92-58bd-450b-bc4c-fd186ed16be2 req-7ba493de-1bbd-4afc-9449-70e30a34361e service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Updated VIF entry in instance network info cache for port c2779cdf-2358-4fb2-839e-5ddff169ecbc. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG nova.network.neutron [req-66ab3f92-58bd-450b-bc4c-fd186ed16be2 req-7ba493de-1bbd-4afc-9449-70e30a34361e service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Updating instance_info_cache with network_info: [{"id": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "address": "fa:16:3e:cf:7b:ea", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2779cdf-23", "ovs_interfaceid": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-66ab3f92-58bd-450b-bc4c-fd186ed16be2 req-7ba493de-1bbd-4afc-9449-70e30a34361e service nova] Releasing lock "refresh_cache-4a15e8e6-35a8-4958-99d5-7e8a187f18f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-c725cd97-2a4f-4aa4-b2b7-d7bd1886ec09 req-713c6beb-ce23-480f-9804-d39ff1bcceea service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Received event network-changed-c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG nova.compute.manager [req-c725cd97-2a4f-4aa4-b2b7-d7bd1886ec09 req-713c6beb-ce23-480f-9804-d39ff1bcceea service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Refreshing instance network info cache due to event network-changed-c2779cdf-2358-4fb2-839e-5ddff169ecbc. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c725cd97-2a4f-4aa4-b2b7-d7bd1886ec09 req-713c6beb-ce23-480f-9804-d39ff1bcceea service nova] Acquiring lock "refresh_cache-4a15e8e6-35a8-4958-99d5-7e8a187f18f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c725cd97-2a4f-4aa4-b2b7-d7bd1886ec09 req-713c6beb-ce23-480f-9804-d39ff1bcceea service nova] Acquired lock "refresh_cache-4a15e8e6-35a8-4958-99d5-7e8a187f18f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG nova.network.neutron [req-c725cd97-2a4f-4aa4-b2b7-d7bd1886ec09 req-713c6beb-ce23-480f-9804-d39ff1bcceea service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Refreshing network info cache for port c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:47 user nova-compute[74630]: INFO nova.compute.manager [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Terminating instance
Oct 26 04:05:47 user nova-compute[74630]: DEBUG nova.compute.manager [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG nova.network.neutron [req-c725cd97-2a4f-4aa4-b2b7-d7bd1886ec09 req-713c6beb-ce23-480f-9804-d39ff1bcceea service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Updated VIF entry in instance network info cache for port c2779cdf-2358-4fb2-839e-5ddff169ecbc. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG nova.network.neutron [req-c725cd97-2a4f-4aa4-b2b7-d7bd1886ec09 req-713c6beb-ce23-480f-9804-d39ff1bcceea service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Updating instance_info_cache with network_info: [{"id": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "address": "fa:16:3e:cf:7b:ea", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2779cdf-23", "ovs_interfaceid": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:05:47 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c725cd97-2a4f-4aa4-b2b7-d7bd1886ec09 req-713c6beb-ce23-480f-9804-d39ff1bcceea service nova] Releasing lock "refresh_cache-4a15e8e6-35a8-4958-99d5-7e8a187f18f7" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:48 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Instance destroyed successfully.
Oct 26 04:05:48 user nova-compute[74630]: DEBUG nova.objects.instance [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lazy-loading 'resources' on Instance uuid 4a15e8e6-35a8-4958-99d5-7e8a187f18f7 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T04:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-474031025',display_name='tempest-TestVolumeBootPattern-server-474031025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-474031025',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/SIDPQ2UP+8pjr/EDeG7jiIvKtw4wxC8wOR9Ppgf68vzwgAsuUEGb0qigXIxPbeQGiuT7fPQKbEvjMZRXhfqo9CTc8iDOme/8ss3+oEiY5W1hrK42wG17Y5enspUZi+A==',key_name='tempest-TestVolumeBootPattern-1850034835',keypairs=<?>,launch_index=0,launched_at=2023-10-26T04:04:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-x6lgc0ak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T04:04:18Z,user_data=None,user_id='3b3bd794500243df86a1e4e89414bea0',uuid=4a15e8e6-35a8-4958-99d5-7e8a187f18f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "address": "fa:16:3e:cf:7b:ea", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2779cdf-23", "ovs_interfaceid": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "address": "fa:16:3e:cf:7b:ea", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2779cdf-23", "ovs_interfaceid": "c2779cdf-2358-4fb2-839e-5ddff169ecbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:7b:ea,bridge_name='br-int',has_traffic_filtering=True,id=c2779cdf-2358-4fb2-839e-5ddff169ecbc,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2779cdf-23') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_vif [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:7b:ea,bridge_name='br-int',has_traffic_filtering=True,id=c2779cdf-2358-4fb2-839e-5ddff169ecbc,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2779cdf-23') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2779cdf-23, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4f4d531-9597-43e2-8c11-969f85e402fa) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:05:48 user nova-compute[74630]: INFO os_vif [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:7b:ea,bridge_name='br-int',has_traffic_filtering=True,id=c2779cdf-2358-4fb2-839e-5ddff169ecbc,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2779cdf-23')
Oct 26 04:05:48 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WTJfLMVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:05:48 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e60e1f7-dc33-41ae-9767-a49661a6ab02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 04:05:48 user nova-compute[74630]: No targets found.
Oct 26 04:05:48 user nova-compute[74630]: iSNS:
Oct 26 04:05:48 user nova-compute[74630]: No targets found.
Oct 26 04:05:48 user nova-compute[74630]: STATIC:
Oct 26 04:05:48 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5
Oct 26 04:05:48 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:05:48 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:05:48 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1
Oct 26 04:05:48 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:05:48 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:05:48 user nova-compute[74630]: FIRMWARE:
Oct 26 04:05:48 user nova-compute[74630]: No targets found.
Oct 26 04:05:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 04:05:48 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 04:05:48 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa891a8-5557-4c9e-80ab-dcc472a1a69f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4074983-b03e-4465-95f1-24d06bc4534a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:05:48 user nova-compute[74630]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 (non-flash)
Oct 26 04:05:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:05:48 user nova-compute[74630]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 (non-flash)
Oct 26 04:05:48 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c6652d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-71d3a325-a48a-401a-aad5-9dc99231c252 req-df86029a-df6e-4c46-84d0-992e8bfb9c9a service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Received event network-vif-unplugged-c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-71d3a325-a48a-401a-aad5-9dc99231c252 req-df86029a-df6e-4c46-84d0-992e8bfb9c9a service nova] Acquiring lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-71d3a325-a48a-401a-aad5-9dc99231c252 req-df86029a-df6e-4c46-84d0-992e8bfb9c9a service nova] Lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-71d3a325-a48a-401a-aad5-9dc99231c252 req-df86029a-df6e-4c46-84d0-992e8bfb9c9a service nova] Lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-71d3a325-a48a-401a-aad5-9dc99231c252 req-df86029a-df6e-4c46-84d0-992e8bfb9c9a service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] No waiting events found dispatching network-vif-unplugged-c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-71d3a325-a48a-401a-aad5-9dc99231c252 req-df86029a-df6e-4c46-84d0-992e8bfb9c9a service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Received event network-vif-unplugged-c2779cdf-2358-4fb2-839e-5ddff169ecbc for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-71d3a325-a48a-401a-aad5-9dc99231c252 req-df86029a-df6e-4c46-84d0-992e8bfb9c9a service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Received event network-vif-plugged-c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-71d3a325-a48a-401a-aad5-9dc99231c252 req-df86029a-df6e-4c46-84d0-992e8bfb9c9a service nova] Acquiring lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-71d3a325-a48a-401a-aad5-9dc99231c252 req-df86029a-df6e-4c46-84d0-992e8bfb9c9a service nova] Lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-71d3a325-a48a-401a-aad5-9dc99231c252 req-df86029a-df6e-4c46-84d0-992e8bfb9c9a service nova] Lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG nova.compute.manager [req-71d3a325-a48a-401a-aad5-9dc99231c252 req-df86029a-df6e-4c46-84d0-992e8bfb9c9a service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] No waiting events found dispatching network-vif-plugged-c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:05:48 user nova-compute[74630]: WARNING nova.compute.manager [req-71d3a325-a48a-401a-aad5-9dc99231c252 req-df86029a-df6e-4c46-84d0-992e8bfb9c9a service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Received unexpected event network-vif-plugged-c2779cdf-2358-4fb2-839e-5ddff169ecbc for instance with vm_state active and task_state deleting.
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[691b4a8a-4adf-4a5e-aa12-0f113d20473b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[402aab76-9232-4bde-858e-2c110f268b06]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeef9ed-c1fc-47d9-a1e7-c944a6773cae]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3a6ae7-2df5-4f05-bf87-cf85c56bb263]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1f03f7f2-c5696679276b9b88', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1f03f7f2', '/dev/disk/by-id/scsi-26335363936363739') {{(pid=86251) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e64d9ad-e7ab-475d-943e-51c1594e9c96]: (4, None) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd11b5e-788e-4896-b23e-0ab388a1ee30]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:05:48 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d143a99-7e1e-469d-9a66-fcdc12c93852]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5, portal: 172.16.0.220,3260]
Oct 26 04:05:49 user nova-compute[74630]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5, portal: 172.16.0.220,3260] successful.
Oct 26 04:05:49 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4d639e-4754-4743-a587-931bc2ee9cb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7aa6cca-4843-4c49-91f5-b9582b086088]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== disconnect_volume: return (336ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 04:05:49 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Deleting instance files /opt/stack/data/nova/instances/4a15e8e6-35a8-4958-99d5-7e8a187f18f7_del
Oct 26 04:05:49 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Deletion of /opt/stack/data/nova/instances/4a15e8e6-35a8-4958-99d5-7e8a187f18f7_del complete
Oct 26 04:05:49 user nova-compute[74630]: INFO nova.compute.manager [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Took 1.47 seconds to destroy the instance on the hypervisor.
Oct 26 04:05:49 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:49 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Took 0.43 seconds to deallocate network for instance.
Oct 26 04:05:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-e3fc71e9-912a-4b3c-b365-5f9385504c6a req-60300146-4e8d-4278-a62d-24da3fa0b116 service nova] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Received event network-vif-deleted-c2779cdf-2358-4fb2-839e-5ddff169ecbc {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lazy-loading 'pci_requests' on Instance uuid d37238e9-39cd-4605-a870-c6c69b22834b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lazy-loading 'numa_topology' on Instance uuid d37238e9-39cd-4605-a870-c6c69b22834b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:05:49 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 04:05:49 user nova-compute[74630]: INFO nova.compute.claims [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Claim successful on node user
Oct 26 04:05:50 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:05:50 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:05:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:50 user nova-compute[74630]: INFO nova.network.neutron [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updating port 6e54ed58-c2f0-43c5-8316-511f7908c02e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 04:05:50 user nova-compute[74630]: INFO nova.compute.manager [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: 4a15e8e6-35a8-4958-99d5-7e8a187f18f7] Took 1.01 seconds to detach 1 volumes for instance.
Oct 26 04:05:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:50 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:05:50 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:05:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:50 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Deleted allocations for instance 4a15e8e6-35a8-4958-99d5-7e8a187f18f7
Oct 26 04:05:50 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-45e4a9cc-95d4-4fcb-9736-8a686a8ac0be tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "4a15e8e6-35a8-4958-99d5-7e8a187f18f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.302s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquired lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.network.neutron [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.network.neutron [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updating instance_info_cache with network_info: [{"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Releasing lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 04:05:51 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Creating image(s)
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Did not create local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Ensure instance console log exists: /opt/stack/data/nova/instances/d37238e9-39cd-4605-a870-c6c69b22834b/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Start _get_guest_xml network_info=[{"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKmbUQwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd37238e9-39cd-4605-a870-c6c69b22834b', 'attached_at': '', 'detached_at': '', 'volume_id': '67489b74-94cc-4429-8e21-f89abc80b034', 'serial': '67489b74-94cc-4429-8e21-f89abc80b034'}, 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'device_type': 'disk', 'attachment_id': 'fcde8b0d-9962-4092-b2ca-112a48e91e51', 'volume_type': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 04:05:51 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:05:51 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lazy-loading 'vcpu_model' on Instance uuid d37238e9-39cd-4605-a870-c6c69b22834b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.objects.base [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Object Instance<d37238e9-39cd-4605-a870-c6c69b22834b> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKmbUQwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:05:51 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:05:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:05:51 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:05:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:05:51 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb782e1-ec72-4a68-bdc5-b11db8e65250]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 04:05:51 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bff8b7-ee92-43be-8413-781c65084641]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034] added
Oct 26 04:05:51 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-76b0a43f-d343-4b33-97cb-1e1c0fc1eaad req-7e09726e-9988-4810-9dac-8225f5be0949 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received event network-changed-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.compute.manager [req-76b0a43f-d343-4b33-97cb-1e1c0fc1eaad req-7e09726e-9988-4810-9dac-8225f5be0949 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Refreshing instance network info cache due to event network-changed-6e54ed58-c2f0-43c5-8316-511f7908c02e. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-76b0a43f-d343-4b33-97cb-1e1c0fc1eaad req-7e09726e-9988-4810-9dac-8225f5be0949 service nova] Acquiring lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-76b0a43f-d343-4b33-97cb-1e1c0fc1eaad req-7e09726e-9988-4810-9dac-8225f5be0949 service nova] Acquired lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG nova.network.neutron [req-76b0a43f-d343-4b33-97cb-1e1c0fc1eaad req-7e09726e-9988-4810-9dac-8225f5be0949 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Refreshing network info cache for port 6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d3ccdd-5491-41d2-b914-49c47729de84]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ed249a-6195-4274-95ea-cd89cf79736c]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lKmbUQwc {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lKmbUQwc" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc318ca5-b170-4fc3-831c-d690ac2d852a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lKmbUQwc'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f24814-8006-425a-96ab-99fac487787b]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ca85a8-07b5-4347-9db3-3f65c1cad46a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:05:51 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:05:51 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:05:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG nova.network.neutron [req-76b0a43f-d343-4b33-97cb-1e1c0fc1eaad req-7e09726e-9988-4810-9dac-8225f5be0949 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updated VIF entry in instance network info cache for port 6e54ed58-c2f0-43c5-8316-511f7908c02e. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG nova.network.neutron [req-76b0a43f-d343-4b33-97cb-1e1c0fc1eaad req-7e09726e-9988-4810-9dac-8225f5be0949 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updating instance_info_cache with network_info: [{"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-76b0a43f-d343-4b33-97cb-1e1c0fc1eaad req-7e09726e-9988-4810-9dac-8225f5be0949 service nova] Releasing lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --login" returned: 0 in 1.053s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5932398-f660-4620-a1af-5e7648f23822]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260]
Oct 26 04:05:52 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260] successful.
Oct 26 04:05:52 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2350bee9-d6cc-49fc-b63a-e15a8ccb5596]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[204b51b7-9f68-4fdf-b358-c15e62b9b1b6]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:05:52 user nova-compute[74630]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:05:52 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:05:52 user nova-compute[74630]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:05:52 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.300s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dbebf5-7c60-4a3b-adf6-db72df412a06]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:05:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKmbUQwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 04:05:53 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.337s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] <== connect_volume: return (2339ms) {'type': 'block', 'scsi_wwn': '23661343064393133', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661343064393133', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T04:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-30403276',display_name='tempest-TestShelveInstance-server-30403276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-30403276',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1204480980',keypairs=<?>,launch_index=0,launched_at=2023-10-26T04:02:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9c9f43800c8546da84a4b2528c7cf3af',ramdisk_id='',reservation_id='r-8kwumzo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1993769457',owner_user_name='tempest-TestShelveInstance-1993769457-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T04:05:32Z,user_data=None,user_id='96c596f1b11b4fa6845a49d0c56d1cdc',uuid=d37238e9-39cd-4605-a870-c6c69b22834b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Converting VIF {"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=6e54ed58-c2f0-43c5-8316-511f7908c02e,network=Network(ad8a2537-08f1-4094-bfd1-9285359aadbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e54ed58-c2') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lazy-loading 'pci_devices' on Instance uuid d37238e9-39cd-4605-a870-c6c69b22834b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG nova.objects.base [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Object Instance<d37238e9-39cd-4605-a870-c6c69b22834b> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74630) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] End _get_guest_xml xml=<domain type="kvm">
Oct 26 04:05:54 user nova-compute[74630]:   <uuid>d37238e9-39cd-4605-a870-c6c69b22834b</uuid>
Oct 26 04:05:54 user nova-compute[74630]:   <name>instance-00000032</name>
Oct 26 04:05:54 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 04:05:54 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 04:05:54 user nova-compute[74630]:   <metadata>
Oct 26 04:05:54 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 04:05:54 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 04:05:54 user nova-compute[74630]:       <nova:name>tempest-TestShelveInstance-server-30403276</nova:name>
Oct 26 04:05:54 user nova-compute[74630]:       <nova:creationTime>2023-10-26 04:05:51</nova:creationTime>
Oct 26 04:05:54 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 04:05:54 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 04:05:54 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 04:05:54 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 04:05:54 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 04:05:54 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 04:05:54 user nova-compute[74630]:       </nova:flavor>
Oct 26 04:05:54 user nova-compute[74630]:       <nova:owner>
Oct 26 04:05:54 user nova-compute[74630]:         <nova:user uuid="96c596f1b11b4fa6845a49d0c56d1cdc">tempest-TestShelveInstance-1993769457-project-member</nova:user>
Oct 26 04:05:54 user nova-compute[74630]:         <nova:project uuid="9c9f43800c8546da84a4b2528c7cf3af">tempest-TestShelveInstance-1993769457</nova:project>
Oct 26 04:05:54 user nova-compute[74630]:       </nova:owner>
Oct 26 04:05:54 user nova-compute[74630]:       <nova:ports>
Oct 26 04:05:54 user nova-compute[74630]:         <nova:port uuid="6e54ed58-c2f0-43c5-8316-511f7908c02e">
Oct 26 04:05:54 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 04:05:54 user nova-compute[74630]:         </nova:port>
Oct 26 04:05:54 user nova-compute[74630]:       </nova:ports>
Oct 26 04:05:54 user nova-compute[74630]:     </nova:instance>
Oct 26 04:05:54 user nova-compute[74630]:   </metadata>
Oct 26 04:05:54 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 04:05:54 user nova-compute[74630]:     <system>
Oct 26 04:05:54 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 04:05:54 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 04:05:54 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 04:05:54 user nova-compute[74630]:       <entry name="serial">d37238e9-39cd-4605-a870-c6c69b22834b</entry>
Oct 26 04:05:54 user nova-compute[74630]:       <entry name="uuid">d37238e9-39cd-4605-a870-c6c69b22834b</entry>
Oct 26 04:05:54 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 04:05:54 user nova-compute[74630]:     </system>
Oct 26 04:05:54 user nova-compute[74630]:   </sysinfo>
Oct 26 04:05:54 user nova-compute[74630]:   <os>
Oct 26 04:05:54 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 04:05:54 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 04:05:54 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 04:05:54 user nova-compute[74630]:   </os>
Oct 26 04:05:54 user nova-compute[74630]:   <features>
Oct 26 04:05:54 user nova-compute[74630]:     <acpi/>
Oct 26 04:05:54 user nova-compute[74630]:     <apic/>
Oct 26 04:05:54 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 04:05:54 user nova-compute[74630]:   </features>
Oct 26 04:05:54 user nova-compute[74630]:   <clock offset="utc">
Oct 26 04:05:54 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 04:05:54 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 04:05:54 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 04:05:54 user nova-compute[74630]:   </clock>
Oct 26 04:05:54 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 04:05:54 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 04:05:54 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 04:05:54 user nova-compute[74630]:   </cpu>
Oct 26 04:05:54 user nova-compute[74630]:   <devices>
Oct 26 04:05:54 user nova-compute[74630]:     <disk type="block" device="disk">
Oct 26 04:05:54 user nova-compute[74630]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:05:54 user nova-compute[74630]:       <source dev="/dev/sdb"/>
Oct 26 04:05:54 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 04:05:54 user nova-compute[74630]:       <serial>67489b74-94cc-4429-8e21-f89abc80b034</serial>
Oct 26 04:05:54 user nova-compute[74630]:     </disk>
Oct 26 04:05:54 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 04:05:54 user nova-compute[74630]:       <mac address="fa:16:3e:42:e3:29"/>
Oct 26 04:05:54 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 04:05:54 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 04:05:54 user nova-compute[74630]:       <target dev="tap6e54ed58-c2"/>
Oct 26 04:05:54 user nova-compute[74630]:     </interface>
Oct 26 04:05:54 user nova-compute[74630]:     <serial type="pty">
Oct 26 04:05:54 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/d37238e9-39cd-4605-a870-c6c69b22834b/console.log" append="off"/>
Oct 26 04:05:54 user nova-compute[74630]:     </serial>
Oct 26 04:05:54 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 04:05:54 user nova-compute[74630]:     <video>
Oct 26 04:05:54 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 04:05:54 user nova-compute[74630]:     </video>
Oct 26 04:05:54 user nova-compute[74630]:     <rng model="virtio">
Oct 26 04:05:54 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 04:05:54 user nova-compute[74630]:     </rng>
Oct 26 04:05:54 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 04:05:54 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 04:05:54 user nova-compute[74630]:       <stats period="10"/>
Oct 26 04:05:54 user nova-compute[74630]:     </memballoon>
Oct 26 04:05:54 user nova-compute[74630]:   </devices>
Oct 26 04:05:54 user nova-compute[74630]: </domain>
Oct 26 04:05:54 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T04:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-30403276',display_name='tempest-TestShelveInstance-server-30403276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-30403276',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1204480980',keypairs=<?>,launch_index=0,launched_at=2023-10-26T04:02:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9c9f43800c8546da84a4b2528c7cf3af',ramdisk_id='',reservation_id='r-8kwumzo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1993769457',owner_user_name='tempest-TestShelveInstance-1993769457-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T04:05:32Z,user_data=None,user_id='96c596f1b11b4fa6845a49d0c56d1cdc',uuid=d37238e9-39cd-4605-a870-c6c69b22834b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Converting VIF {"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=6e54ed58-c2f0-43c5-8316-511f7908c02e,network=Network(ad8a2537-08f1-4094-bfd1-9285359aadbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e54ed58-c2') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG os_vif [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=6e54ed58-c2f0-43c5-8316-511f7908c02e,network=Network(ad8a2537-08f1-4094-bfd1-9285359aadbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e54ed58-c2') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fed12a36-9073-531e-8750-8c5789947a2c', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e54ed58-c2, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e54ed58-c2, col_values=(('qos', UUID('445a17c4-93b9-4a87-accc-5f9d1dae3337')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e54ed58-c2, col_values=(('external_ids', {'iface-id': '6e54ed58-c2f0-43c5-8316-511f7908c02e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:e3:29', 'vm-uuid': 'd37238e9-39cd-4605-a870-c6c69b22834b'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:54 user nova-compute[74630]: INFO os_vif [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=6e54ed58-c2f0-43c5-8316-511f7908c02e,network=Network(ad8a2537-08f1-4094-bfd1-9285359aadbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e54ed58-c2')
Oct 26 04:05:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:05:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] No VIF found with MAC fa:16:3e:42:e3:29, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 04:05:55 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:05:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-88178a66-87d4-43a5-8c13-30ecd59d4b0a req-e2b7d467-90c6-4e0b-9bc1-4445bc061ab5 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received event network-vif-plugged-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:05:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-88178a66-87d4-43a5-8c13-30ecd59d4b0a req-e2b7d467-90c6-4e0b-9bc1-4445bc061ab5 service nova] Acquiring lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-88178a66-87d4-43a5-8c13-30ecd59d4b0a req-e2b7d467-90c6-4e0b-9bc1-4445bc061ab5 service nova] Lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-88178a66-87d4-43a5-8c13-30ecd59d4b0a req-e2b7d467-90c6-4e0b-9bc1-4445bc061ab5 service nova] Lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-88178a66-87d4-43a5-8c13-30ecd59d4b0a req-e2b7d467-90c6-4e0b-9bc1-4445bc061ab5 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] No waiting events found dispatching network-vif-plugged-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:05:55 user nova-compute[74630]: WARNING nova.compute.manager [req-88178a66-87d4-43a5-8c13-30ecd59d4b0a req-e2b7d467-90c6-4e0b-9bc1-4445bc061ab5 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received unexpected event network-vif-plugged-6e54ed58-c2f0-43c5-8316-511f7908c02e for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 04:05:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:57 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 04:05:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 04:05:57 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Instance spawned successfully.
Oct 26 04:05:57 user nova-compute[74630]: DEBUG nova.compute.manager [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 04:05:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c6e42121-33c0-4f2b-af4b-8b05788eb081 tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "d37238e9-39cd-4605-a870-c6c69b22834b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.981s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:57 user nova-compute[74630]: DEBUG nova.compute.manager [req-d2ed123f-d677-4239-bfe9-63673464eae1 req-f7c6a7c9-15de-4c5b-b274-8c8fe9010736 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received event network-vif-plugged-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:05:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d2ed123f-d677-4239-bfe9-63673464eae1 req-f7c6a7c9-15de-4c5b-b274-8c8fe9010736 service nova] Acquiring lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d2ed123f-d677-4239-bfe9-63673464eae1 req-f7c6a7c9-15de-4c5b-b274-8c8fe9010736 service nova] Lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d2ed123f-d677-4239-bfe9-63673464eae1 req-f7c6a7c9-15de-4c5b-b274-8c8fe9010736 service nova] Lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:57 user nova-compute[74630]: DEBUG nova.compute.manager [req-d2ed123f-d677-4239-bfe9-63673464eae1 req-f7c6a7c9-15de-4c5b-b274-8c8fe9010736 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] No waiting events found dispatching network-vif-plugged-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:05:57 user nova-compute[74630]: WARNING nova.compute.manager [req-d2ed123f-d677-4239-bfe9-63673464eae1 req-f7c6a7c9-15de-4c5b-b274-8c8fe9010736 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received unexpected event network-vif-plugged-6e54ed58-c2f0-43c5-8316-511f7908c02e for instance with vm_state active and task_state None.
Oct 26 04:05:58 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid f9b83cf7-027f-4d50-a605-afda72da2d13 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Updating instance_info_cache with network_info: [{"id": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "address": "fa:16:3e:fc:a0:23", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7b0f8c-96", "ovs_interfaceid": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 04:05:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 04:05:59 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:05:59 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:05:59 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8778MB free_disk=24.937786102294922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:05:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:05:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:05:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:59 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9b83cf7-027f-4d50-a605-afda72da2d13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:05:59 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d37238e9-39cd-4605-a870-c6c69b22834b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:05:59 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:05:59 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:05:59 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:05:59 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:05:59 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:05:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:05:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:05:59 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:06:03 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:06:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:06:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:12 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:45 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:06:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:06:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:06:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:06:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:06:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:52 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:06:52 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74630) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 04:06:54 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:06:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:56 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:06:59 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:06:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 04:06:59 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] There are 0 instances to clean {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 04:06:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:06:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:06:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:06:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:06:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:06:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updating instance_info_cache with network_info: [{"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 04:07:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 04:07:01 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:07:01 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:07:01 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8792MB free_disk=24.97580337524414GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:07:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:01 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance f9b83cf7-027f-4d50-a605-afda72da2d13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:07:01 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d37238e9-39cd-4605-a870-c6c69b22834b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:07:01 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:07:01 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:07:01 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:07:01 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:07:01 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:07:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:01 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:07:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:07:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:07:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:07:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:07:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:07:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:07:05 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:07:05 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG nova.compute.manager [req-1775c64c-94c3-4aec-87e8-5fb0929b0fcc req-2375b9aa-ec1e-40a6-9c47-ff225398348b service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received event network-changed-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG nova.compute.manager [req-1775c64c-94c3-4aec-87e8-5fb0929b0fcc req-2375b9aa-ec1e-40a6-9c47-ff225398348b service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Refreshing instance network info cache due to event network-changed-9a7b0f8c-963e-4eb6-922a-517e6fa625b8. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1775c64c-94c3-4aec-87e8-5fb0929b0fcc req-2375b9aa-ec1e-40a6-9c47-ff225398348b service nova] Acquiring lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1775c64c-94c3-4aec-87e8-5fb0929b0fcc req-2375b9aa-ec1e-40a6-9c47-ff225398348b service nova] Acquired lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG nova.network.neutron [req-1775c64c-94c3-4aec-87e8-5fb0929b0fcc req-2375b9aa-ec1e-40a6-9c47-ff225398348b service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Refreshing network info cache for port 9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "f9b83cf7-027f-4d50-a605-afda72da2d13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:08 user nova-compute[74630]: INFO nova.compute.manager [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Terminating instance
Oct 26 04:07:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG nova.compute.manager [req-6067b06a-e01a-49cc-bc34-33b261a7d525 req-8b785ef0-1cd8-4cd3-9a08-d52639c1fc40 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received event network-vif-unplugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6067b06a-e01a-49cc-bc34-33b261a7d525 req-8b785ef0-1cd8-4cd3-9a08-d52639c1fc40 service nova] Acquiring lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6067b06a-e01a-49cc-bc34-33b261a7d525 req-8b785ef0-1cd8-4cd3-9a08-d52639c1fc40 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-6067b06a-e01a-49cc-bc34-33b261a7d525 req-8b785ef0-1cd8-4cd3-9a08-d52639c1fc40 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG nova.compute.manager [req-6067b06a-e01a-49cc-bc34-33b261a7d525 req-8b785ef0-1cd8-4cd3-9a08-d52639c1fc40 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] No waiting events found dispatching network-vif-unplugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG nova.compute.manager [req-6067b06a-e01a-49cc-bc34-33b261a7d525 req-8b785ef0-1cd8-4cd3-9a08-d52639c1fc40 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received event network-vif-unplugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG nova.network.neutron [req-1775c64c-94c3-4aec-87e8-5fb0929b0fcc req-2375b9aa-ec1e-40a6-9c47-ff225398348b service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Updated VIF entry in instance network info cache for port 9a7b0f8c-963e-4eb6-922a-517e6fa625b8. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG nova.network.neutron [req-1775c64c-94c3-4aec-87e8-5fb0929b0fcc req-2375b9aa-ec1e-40a6-9c47-ff225398348b service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Updating instance_info_cache with network_info: [{"id": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "address": "fa:16:3e:fc:a0:23", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7b0f8c-96", "ovs_interfaceid": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1775c64c-94c3-4aec-87e8-5fb0929b0fcc req-2375b9aa-ec1e-40a6-9c47-ff225398348b service nova] Releasing lock "refresh_cache-f9b83cf7-027f-4d50-a605-afda72da2d13" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:07:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Instance destroyed successfully.
Oct 26 04:07:09 user nova-compute[74630]: DEBUG nova.objects.instance [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lazy-loading 'resources' on Instance uuid f9b83cf7-027f-4d50-a605-afda72da2d13 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T04:01:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2129270195',display_name='tempest-TestVolumeBootPattern-server-2129270195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2129270195',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/SIDPQ2UP+8pjr/EDeG7jiIvKtw4wxC8wOR9Ppgf68vzwgAsuUEGb0qigXIxPbeQGiuT7fPQKbEvjMZRXhfqo9CTc8iDOme/8ss3+oEiY5W1hrK42wG17Y5enspUZi+A==',key_name='tempest-TestVolumeBootPattern-1850034835',keypairs=<?>,launch_index=0,launched_at=2023-10-26T04:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4dbe37117ca24935b46795e7f7479af9',ramdisk_id='',reservation_id='r-s852oius',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1203294393',owner_user_name='tempest-TestVolumeBootPattern-1203294393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T04:02:25Z,user_data=None,user_id='3b3bd794500243df86a1e4e89414bea0',uuid=f9b83cf7-027f-4d50-a605-afda72da2d13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "address": "fa:16:3e:fc:a0:23", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7b0f8c-96", "ovs_interfaceid": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converting VIF {"id": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "address": "fa:16:3e:fc:a0:23", "network": {"id": "a86ac0c9-9475-4107-8c79-7f9608e7825f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-380015609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4dbe37117ca24935b46795e7f7479af9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a7b0f8c-96", "ovs_interfaceid": "9a7b0f8c-963e-4eb6-922a-517e6fa625b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:a0:23,bridge_name='br-int',has_traffic_filtering=True,id=9a7b0f8c-963e-4eb6-922a-517e6fa625b8,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a7b0f8c-96') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_vif [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:a0:23,bridge_name='br-int',has_traffic_filtering=True,id=9a7b0f8c-963e-4eb6-922a-517e6fa625b8,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a7b0f8c-96') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a7b0f8c-96, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8804e0cf-83d7-4d3d-9b32-feba4c97af0e) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:09 user nova-compute[74630]: INFO os_vif [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:a0:23,bridge_name='br-int',has_traffic_filtering=True,id=9a7b0f8c-963e-4eb6-922a-517e6fa625b8,network=Network(a86ac0c9-9475-4107-8c79-7f9608e7825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a7b0f8c-96')
Oct 26 04:07:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqetYOCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:07:09 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e33a95-48e2-49e5-938d-13f605a9ef92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 04:07:09 user nova-compute[74630]: No targets found.
Oct 26 04:07:09 user nova-compute[74630]: iSNS:
Oct 26 04:07:09 user nova-compute[74630]: No targets found.
Oct 26 04:07:09 user nova-compute[74630]: STATIC:
Oct 26 04:07:09 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034
Oct 26 04:07:09 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:07:09 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:07:09 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1
Oct 26 04:07:09 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:07:09 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:07:09 user nova-compute[74630]: FIRMWARE:
Oct 26 04:07:09 user nova-compute[74630]: No targets found.
Oct 26 04:07:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 04:07:09 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 04:07:09 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2280a0a4-32c7-48bb-bda4-00eb13cc06cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0063c2-5c9d-42e9-8a0e-bd13af22e5e0]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:07:09 user nova-compute[74630]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:07:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 (non-flash)
Oct 26 04:07:09 user nova-compute[74630]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:07:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c665b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1'): ({'sdd'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Removing single pathed devices sdd {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1114490-16a4-4b0e-be23-d4145def907c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fe8264-fe34-4d20-ac3e-abe4e5fc6e5d]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Flushing IO for device /dev/sdd {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[652242eb-5dd5-4772-ab0b-5fc9168ddb12]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.099s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[74819ded-ba7d-4992-a1ab-bfc156c0c1fe]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] SCSI volumes sdd have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26138353739613934', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_46b7a275', '/dev/disk/by-id/scsi-1SCST_BIO46b7a275-a8579a9490bd1874') {{(pid=86251) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84392eb-6372-4af3-8066-b57c15dfe8f4]: (4, None) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c01e77-8a50-4cf2-bb39-67b2836ac7e6]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c307ba1a-a475-4ec2-b504-a10587ddf590]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260]
Oct 26 04:07:09 user nova-compute[74630]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1, portal: 172.16.0.220,3260] successful.
Oct 26 04:07:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f0821-dbcb-4506-9894-44f41a671fc1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[947436b6-c3b3-4155-a1e7-ad0381e809d5]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] <== disconnect_volume: return (386ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 04:07:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Deleting instance files /opt/stack/data/nova/instances/f9b83cf7-027f-4d50-a605-afda72da2d13_del
Oct 26 04:07:09 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Deletion of /opt/stack/data/nova/instances/f9b83cf7-027f-4d50-a605-afda72da2d13_del complete
Oct 26 04:07:09 user nova-compute[74630]: INFO nova.compute.manager [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Took 1.27 seconds to destroy the instance on the hypervisor.
Oct 26 04:07:09 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:07:10 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Took 0.64 seconds to deallocate network for instance.
Oct 26 04:07:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-99626e9f-9029-4d0f-86e9-d5b4971c169f req-8ce6522a-ab89-4e35-af33-3ec58890df55 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received event network-vif-deleted-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received event network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] Acquiring lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] No waiting events found dispatching network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:07:10 user nova-compute[74630]: WARNING nova.compute.manager [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received unexpected event network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 for instance with vm_state active and task_state deleting.
Oct 26 04:07:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received event network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] Acquiring lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] No waiting events found dispatching network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:07:10 user nova-compute[74630]: WARNING nova.compute.manager [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received unexpected event network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 for instance with vm_state active and task_state deleting.
Oct 26 04:07:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received event network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] Acquiring lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] No waiting events found dispatching network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:07:10 user nova-compute[74630]: WARNING nova.compute.manager [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received unexpected event network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 for instance with vm_state active and task_state deleting.
Oct 26 04:07:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received event network-vif-unplugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] Acquiring lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] No waiting events found dispatching network-vif-unplugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received event network-vif-unplugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received event network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] Acquiring lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:10 user nova-compute[74630]: DEBUG nova.compute.manager [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] No waiting events found dispatching network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:07:10 user nova-compute[74630]: WARNING nova.compute.manager [req-e885e0fe-65de-4cc9-918e-bbeae5443b4c req-d1b11d3e-dfd5-4b62-b651-5ea34f86a234 service nova] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Received unexpected event network-vif-plugged-9a7b0f8c-963e-4eb6-922a-517e6fa625b8 for instance with vm_state active and task_state deleting.
Oct 26 04:07:11 user nova-compute[74630]: INFO nova.compute.manager [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] [instance: f9b83cf7-027f-4d50-a605-afda72da2d13] Took 0.87 seconds to detach 1 volumes for instance.
Oct 26 04:07:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:11 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:07:11 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:07:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:11 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Deleted allocations for instance f9b83cf7-027f-4d50-a605-afda72da2d13
Oct 26 04:07:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fa3a5926-7883-4afa-ad3c-e1a9d4963b0a tempest-TestVolumeBootPattern-1203294393 tempest-TestVolumeBootPattern-1203294393-project-member] Lock "f9b83cf7-027f-4d50-a605-afda72da2d13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.147s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:07:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:20 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:07:20 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Triggering sync for uuid d37238e9-39cd-4605-a870-c6c69b22834b {{(pid=74630) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 04:07:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "d37238e9-39cd-4605-a870-c6c69b22834b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "d37238e9-39cd-4605-a870-c6c69b22834b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "d37238e9-39cd-4605-a870-c6c69b22834b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-155116af-7cbe-4005-91bf-64b676c0399c req-11b2b653-bd15-444f-811b-e865dd6142be service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received event network-changed-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG nova.compute.manager [req-155116af-7cbe-4005-91bf-64b676c0399c req-11b2b653-bd15-444f-811b-e865dd6142be service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Refreshing instance network info cache due to event network-changed-6e54ed58-c2f0-43c5-8316-511f7908c02e. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-155116af-7cbe-4005-91bf-64b676c0399c req-11b2b653-bd15-444f-811b-e865dd6142be service nova] Acquiring lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-155116af-7cbe-4005-91bf-64b676c0399c req-11b2b653-bd15-444f-811b-e865dd6142be service nova] Acquired lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG nova.network.neutron [req-155116af-7cbe-4005-91bf-64b676c0399c req-11b2b653-bd15-444f-811b-e865dd6142be service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Refreshing network info cache for port 6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "d37238e9-39cd-4605-a870-c6c69b22834b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "d37238e9-39cd-4605-a870-c6c69b22834b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "d37238e9-39cd-4605-a870-c6c69b22834b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:22 user nova-compute[74630]: INFO nova.compute.manager [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Terminating instance
Oct 26 04:07:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG nova.network.neutron [req-155116af-7cbe-4005-91bf-64b676c0399c req-11b2b653-bd15-444f-811b-e865dd6142be service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updated VIF entry in instance network info cache for port 6e54ed58-c2f0-43c5-8316-511f7908c02e. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG nova.network.neutron [req-155116af-7cbe-4005-91bf-64b676c0399c req-11b2b653-bd15-444f-811b-e865dd6142be service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updating instance_info_cache with network_info: [{"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:07:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-155116af-7cbe-4005-91bf-64b676c0399c req-11b2b653-bd15-444f-811b-e865dd6142be service nova] Releasing lock "refresh_cache-d37238e9-39cd-4605-a870-c6c69b22834b" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:07:23 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Instance destroyed successfully.
Oct 26 04:07:23 user nova-compute[74630]: DEBUG nova.objects.instance [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lazy-loading 'resources' on Instance uuid d37238e9-39cd-4605-a870-c6c69b22834b {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T04:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-30403276',display_name='tempest-TestShelveInstance-server-30403276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-30403276',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpwZbeVvWqMIrse9jqV356hQeCjjtAitu6ZLe3vy7VgaQ56KqTb6ML+JuI6Ggpo/o2Vk0ZIvGG+Oyw+favsHOZpNHvgyN4yMaeLnlujM+XfU5er5o8PFPK2nF17krwq/g==',key_name='tempest-TestShelveInstance-1204480980',keypairs=<?>,launch_index=0,launched_at=2023-10-26T04:05:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c9f43800c8546da84a4b2528c7cf3af',ramdisk_id='',reservation_id='r-8kwumzo6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1993769457',owner_user_name='tempest-TestShelveInstance-1993769457-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T04:05:58Z,user_data=None,user_id='96c596f1b11b4fa6845a49d0c56d1cdc',uuid=d37238e9-39cd-4605-a870-c6c69b22834b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Converting VIF {"id": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "address": "fa:16:3e:42:e3:29", "network": {"id": "ad8a2537-08f1-4094-bfd1-9285359aadbd", "bridge": "br-int", "label": "tempest-TestShelveInstance-643872225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c9f43800c8546da84a4b2528c7cf3af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e54ed58-c2", "ovs_interfaceid": "6e54ed58-c2f0-43c5-8316-511f7908c02e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=6e54ed58-c2f0-43c5-8316-511f7908c02e,network=Network(ad8a2537-08f1-4094-bfd1-9285359aadbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e54ed58-c2') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_vif [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=6e54ed58-c2f0-43c5-8316-511f7908c02e,network=Network(ad8a2537-08f1-4094-bfd1-9285359aadbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e54ed58-c2') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e54ed58-c2, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=445a17c4-93b9-4a87-accc-5f9d1dae3337) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:07:23 user nova-compute[74630]: INFO os_vif [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:e3:29,bridge_name='br-int',has_traffic_filtering=True,id=6e54ed58-c2f0-43c5-8316-511f7908c02e,network=Network(ad8a2537-08f1-4094-bfd1-9285359aadbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e54ed58-c2')
Oct 26 04:07:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lKmbUQwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:07:23 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[80314691-5f85-4568-9a31-a25344472557]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 04:07:23 user nova-compute[74630]: No targets found.
Oct 26 04:07:23 user nova-compute[74630]: iSNS:
Oct 26 04:07:23 user nova-compute[74630]: No targets found.
Oct 26 04:07:23 user nova-compute[74630]: STATIC:
Oct 26 04:07:23 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034
Oct 26 04:07:23 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:07:23 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:07:23 user nova-compute[74630]: FIRMWARE:
Oct 26 04:07:23 user nova-compute[74630]: No targets found.
Oct 26 04:07:23 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 04:07:23 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 04:07:23 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92b4ff2-fba8-414a-b03f-e4e45f1a700e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4ef3d0-cf14-4d31-a360-420b239d7c76]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:07:23 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 (non-flash)
Oct 26 04:07:23 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f315c779d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ec63ed-bb35-40b5-8d28-7f9657224da8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bd1049-48fb-453b-a8d7-8ab616f77455]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6004b3-59f0-40ea-9f8d-08e541ead14f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[983143af-cb7b-4540-8f9d-0e0690875d05]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1e3ffd35-6a40d9136efa8fe7', '/dev/disk/by-id/scsi-23661343064393133', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1e3ffd35') {{(pid=86251) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a72bd5-8404-44e1-b91b-dadb50749ca4]: (4, None) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1148b9-1a17-4796-ba08-e5fe99a112ad]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b509c0a-b4fd-47ee-88da-70c41160e435]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260]
Oct 26 04:07:23 user nova-compute[74630]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034, portal: 172.16.0.220,3260] successful.
Oct 26 04:07:23 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67489b74-94cc-4429-8e21-f89abc80b034 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b735943-c30c-4ca7-81f8-d733629f0f22]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] <== disconnect_volume: return (314ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 04:07:23 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Deleting instance files /opt/stack/data/nova/instances/d37238e9-39cd-4605-a870-c6c69b22834b_del
Oct 26 04:07:23 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Deletion of /opt/stack/data/nova/instances/d37238e9-39cd-4605-a870-c6c69b22834b_del complete
Oct 26 04:07:23 user nova-compute[74630]: INFO nova.compute.manager [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 26 04:07:23 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 04:07:23 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 04:07:24 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:07:24 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Took 0.46 seconds to deallocate network for instance.
Oct 26 04:07:24 user nova-compute[74630]: DEBUG nova.compute.manager [req-2b890216-55b5-47c2-8f0e-9fdcbbd62d71 req-b71163d7-b69c-4562-92f7-76c20a8d27b7 service nova] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Received event network-vif-deleted-6e54ed58-c2f0-43c5-8316-511f7908c02e {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:07:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:25 user nova-compute[74630]: INFO nova.compute.manager [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Took 0.90 seconds to detach 1 volumes for instance.
Oct 26 04:07:25 user nova-compute[74630]: DEBUG nova.compute.manager [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] [instance: d37238e9-39cd-4605-a870-c6c69b22834b] Deleting volume: 67489b74-94cc-4429-8e21-f89abc80b034 {{(pid=74630) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 04:07:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:25 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:07:25 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:07:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:25 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Deleted allocations for instance d37238e9-39cd-4605-a870-c6c69b22834b
Oct 26 04:07:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-2d295aeb-2839-4d3e-82a8-c32d8bc2912d tempest-TestShelveInstance-1993769457 tempest-TestShelveInstance-1993769457-project-member] Lock "d37238e9-39cd-4605-a870-c6c69b22834b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.887s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 04:07:27 user nova-compute[74630]: INFO nova.compute.claims [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Claim successful on node user
Oct 26 04:07:27 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.208s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG nova.network.neutron [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 04:07:27 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 04:07:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG nova.policy [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bef3d0cfc53649b49d5aa14fb3c74e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb9cea58c1ea46f0a358513888599475', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 04:07:27 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Creating image(s)
Oct 26 04:07:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "/opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "/opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.180s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:27 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk 1073741824" returned: 0 in 0.058s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG nova.network.neutron [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Successfully created port: 9b9b5e63-0904-437f-a6dc-4df9cc88bcbb {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.182s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Cannot resize image /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Ensure instance console log exists: /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:28 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.network.neutron [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Successfully updated port: 9b9b5e63-0904-437f-a6dc-4df9cc88bcbb {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquired lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.network.neutron [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-e8f31b49-ede6-4cbf-b2fb-ed52114364b8 req-d18d27aa-5c9c-423b-89a6-c352610e8ed3 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Received event network-changed-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.compute.manager [req-e8f31b49-ede6-4cbf-b2fb-ed52114364b8 req-d18d27aa-5c9c-423b-89a6-c352610e8ed3 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Refreshing instance network info cache due to event network-changed-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e8f31b49-ede6-4cbf-b2fb-ed52114364b8 req-d18d27aa-5c9c-423b-89a6-c352610e8ed3 service nova] Acquiring lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.network.neutron [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.network.neutron [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating instance_info_cache with network_info: [{"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Releasing lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Instance network_info: |[{"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e8f31b49-ede6-4cbf-b2fb-ed52114364b8 req-d18d27aa-5c9c-423b-89a6-c352610e8ed3 service nova] Acquired lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.network.neutron [req-e8f31b49-ede6-4cbf-b2fb-ed52114364b8 req-d18d27aa-5c9c-423b-89a6-c352610e8ed3 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Refreshing network info cache for port 9b9b5e63-0904-437f-a6dc-4df9cc88bcbb {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Start _get_guest_xml network_info=[{"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 04:07:29 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:07:29 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T04:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-317914246',display_name='tempest-SnapshotDataIntegrityTests-server-317914246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-317914246',id=52,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvQkOSCWs2i/qu/wjiHenXiY+4IX567ZkLIrRLVE+EZiZHfhVC59U6kMmKl49bKA+j7yn3ompEOb8Lc4UW2Ls+G7N4xeHhHRNcaA9P9KV3HXAgmEVOgWE4TPEKpwS4Y0Q==',key_name='tempest-keypair-790115128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb9cea58c1ea46f0a358513888599475',ramdisk_id='',reservation_id='r-16yx4atn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-360316176',owner_user_name='tempest-SnapshotDataIntegrityTests-360316176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T04:07:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bef3d0cfc53649b49d5aa14fb3c74e2c',uuid=d7ff3289-9a55-4f3f-aee6-9e96212766e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Converting VIF {"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:4b:dc,bridge_name='br-int',has_traffic_filtering=True,id=9b9b5e63-0904-437f-a6dc-4df9cc88bcbb,network=Network(9f8fd0e3-0f07-444e-8da2-8df9925d800c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b9b5e63-09') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.objects.instance [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lazy-loading 'pci_devices' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] End _get_guest_xml xml=<domain type="kvm">
Oct 26 04:07:29 user nova-compute[74630]:   <uuid>d7ff3289-9a55-4f3f-aee6-9e96212766e1</uuid>
Oct 26 04:07:29 user nova-compute[74630]:   <name>instance-00000034</name>
Oct 26 04:07:29 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 04:07:29 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 04:07:29 user nova-compute[74630]:   <metadata>
Oct 26 04:07:29 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 04:07:29 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 04:07:29 user nova-compute[74630]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-317914246</nova:name>
Oct 26 04:07:29 user nova-compute[74630]:       <nova:creationTime>2023-10-26 04:07:29</nova:creationTime>
Oct 26 04:07:29 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 04:07:29 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 04:07:29 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 04:07:29 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 04:07:29 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 04:07:29 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 04:07:29 user nova-compute[74630]:       </nova:flavor>
Oct 26 04:07:29 user nova-compute[74630]:       <nova:owner>
Oct 26 04:07:29 user nova-compute[74630]:         <nova:user uuid="bef3d0cfc53649b49d5aa14fb3c74e2c">tempest-SnapshotDataIntegrityTests-360316176-project-member</nova:user>
Oct 26 04:07:29 user nova-compute[74630]:         <nova:project uuid="cb9cea58c1ea46f0a358513888599475">tempest-SnapshotDataIntegrityTests-360316176</nova:project>
Oct 26 04:07:29 user nova-compute[74630]:       </nova:owner>
Oct 26 04:07:29 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 04:07:29 user nova-compute[74630]:       <nova:ports>
Oct 26 04:07:29 user nova-compute[74630]:         <nova:port uuid="9b9b5e63-0904-437f-a6dc-4df9cc88bcbb">
Oct 26 04:07:29 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 04:07:29 user nova-compute[74630]:         </nova:port>
Oct 26 04:07:29 user nova-compute[74630]:       </nova:ports>
Oct 26 04:07:29 user nova-compute[74630]:     </nova:instance>
Oct 26 04:07:29 user nova-compute[74630]:   </metadata>
Oct 26 04:07:29 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 04:07:29 user nova-compute[74630]:     <system>
Oct 26 04:07:29 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 04:07:29 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 04:07:29 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 04:07:29 user nova-compute[74630]:       <entry name="serial">d7ff3289-9a55-4f3f-aee6-9e96212766e1</entry>
Oct 26 04:07:29 user nova-compute[74630]:       <entry name="uuid">d7ff3289-9a55-4f3f-aee6-9e96212766e1</entry>
Oct 26 04:07:29 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 04:07:29 user nova-compute[74630]:     </system>
Oct 26 04:07:29 user nova-compute[74630]:   </sysinfo>
Oct 26 04:07:29 user nova-compute[74630]:   <os>
Oct 26 04:07:29 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 04:07:29 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 04:07:29 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 04:07:29 user nova-compute[74630]:   </os>
Oct 26 04:07:29 user nova-compute[74630]:   <features>
Oct 26 04:07:29 user nova-compute[74630]:     <acpi/>
Oct 26 04:07:29 user nova-compute[74630]:     <apic/>
Oct 26 04:07:29 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 04:07:29 user nova-compute[74630]:   </features>
Oct 26 04:07:29 user nova-compute[74630]:   <clock offset="utc">
Oct 26 04:07:29 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 04:07:29 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 04:07:29 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 04:07:29 user nova-compute[74630]:   </clock>
Oct 26 04:07:29 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 04:07:29 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 04:07:29 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 04:07:29 user nova-compute[74630]:   </cpu>
Oct 26 04:07:29 user nova-compute[74630]:   <devices>
Oct 26 04:07:29 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 04:07:29 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 04:07:29 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk"/>
Oct 26 04:07:29 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 04:07:29 user nova-compute[74630]:     </disk>
Oct 26 04:07:29 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 04:07:29 user nova-compute[74630]:       <mac address="fa:16:3e:0c:4b:dc"/>
Oct 26 04:07:29 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 04:07:29 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 04:07:29 user nova-compute[74630]:       <target dev="tap9b9b5e63-09"/>
Oct 26 04:07:29 user nova-compute[74630]:     </interface>
Oct 26 04:07:29 user nova-compute[74630]:     <serial type="pty">
Oct 26 04:07:29 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/console.log" append="off"/>
Oct 26 04:07:29 user nova-compute[74630]:     </serial>
Oct 26 04:07:29 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 04:07:29 user nova-compute[74630]:     <video>
Oct 26 04:07:29 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 04:07:29 user nova-compute[74630]:     </video>
Oct 26 04:07:29 user nova-compute[74630]:     <rng model="virtio">
Oct 26 04:07:29 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 04:07:29 user nova-compute[74630]:     </rng>
Oct 26 04:07:29 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 04:07:29 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 04:07:29 user nova-compute[74630]:       <stats period="10"/>
Oct 26 04:07:29 user nova-compute[74630]:     </memballoon>
Oct 26 04:07:29 user nova-compute[74630]:   </devices>
Oct 26 04:07:29 user nova-compute[74630]: </domain>
Oct 26 04:07:29 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T04:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-317914246',display_name='tempest-SnapshotDataIntegrityTests-server-317914246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-317914246',id=52,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvQkOSCWs2i/qu/wjiHenXiY+4IX567ZkLIrRLVE+EZiZHfhVC59U6kMmKl49bKA+j7yn3ompEOb8Lc4UW2Ls+G7N4xeHhHRNcaA9P9KV3HXAgmEVOgWE4TPEKpwS4Y0Q==',key_name='tempest-keypair-790115128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb9cea58c1ea46f0a358513888599475',ramdisk_id='',reservation_id='r-16yx4atn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-360316176',owner_user_name='tempest-SnapshotDataIntegrityTests-360316176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T04:07:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bef3d0cfc53649b49d5aa14fb3c74e2c',uuid=d7ff3289-9a55-4f3f-aee6-9e96212766e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Converting VIF {"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:4b:dc,bridge_name='br-int',has_traffic_filtering=True,id=9b9b5e63-0904-437f-a6dc-4df9cc88bcbb,network=Network(9f8fd0e3-0f07-444e-8da2-8df9925d800c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b9b5e63-09') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG os_vif [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:4b:dc,bridge_name='br-int',has_traffic_filtering=True,id=9b9b5e63-0904-437f-a6dc-4df9cc88bcbb,network=Network(9f8fd0e3-0f07-444e-8da2-8df9925d800c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b9b5e63-09') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13aa9862-efc2-52ae-a6c9-165be24ea193', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b9b5e63-09, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b9b5e63-09, col_values=(('qos', UUID('3f0609a6-b7b2-477b-ad22-d64384e70ed1')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b9b5e63-09, col_values=(('external_ids', {'iface-id': '9b9b5e63-0904-437f-a6dc-4df9cc88bcbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:4b:dc', 'vm-uuid': 'd7ff3289-9a55-4f3f-aee6-9e96212766e1'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:29 user nova-compute[74630]: INFO os_vif [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:4b:dc,bridge_name='br-int',has_traffic_filtering=True,id=9b9b5e63-0904-437f-a6dc-4df9cc88bcbb,network=Network(9f8fd0e3-0f07-444e-8da2-8df9925d800c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b9b5e63-09')
Oct 26 04:07:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] No VIF found with MAC fa:16:3e:0c:4b:dc, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.network.neutron [req-e8f31b49-ede6-4cbf-b2fb-ed52114364b8 req-d18d27aa-5c9c-423b-89a6-c352610e8ed3 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updated VIF entry in instance network info cache for port 9b9b5e63-0904-437f-a6dc-4df9cc88bcbb. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG nova.network.neutron [req-e8f31b49-ede6-4cbf-b2fb-ed52114364b8 req-d18d27aa-5c9c-423b-89a6-c352610e8ed3 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating instance_info_cache with network_info: [{"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:07:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-e8f31b49-ede6-4cbf-b2fb-ed52114364b8 req-d18d27aa-5c9c-423b-89a6-c352610e8ed3 service nova] Releasing lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:07:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-36aa85e5-cb4c-4e26-9696-571f9d183d16 req-40c56bb2-e708-4441-b129-6bfb28c7925c service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Received event network-vif-plugged-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:07:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-36aa85e5-cb4c-4e26-9696-571f9d183d16 req-40c56bb2-e708-4441-b129-6bfb28c7925c service nova] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-36aa85e5-cb4c-4e26-9696-571f9d183d16 req-40c56bb2-e708-4441-b129-6bfb28c7925c service nova] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:31 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-36aa85e5-cb4c-4e26-9696-571f9d183d16 req-40c56bb2-e708-4441-b129-6bfb28c7925c service nova] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:31 user nova-compute[74630]: DEBUG nova.compute.manager [req-36aa85e5-cb4c-4e26-9696-571f9d183d16 req-40c56bb2-e708-4441-b129-6bfb28c7925c service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] No waiting events found dispatching network-vif-plugged-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:07:31 user nova-compute[74630]: WARNING nova.compute.manager [req-36aa85e5-cb4c-4e26-9696-571f9d183d16 req-40c56bb2-e708-4441-b129-6bfb28c7925c service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Received unexpected event network-vif-plugged-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb for instance with vm_state building and task_state spawning.
Oct 26 04:07:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:33 user nova-compute[74630]: DEBUG nova.compute.manager [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 04:07:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 04:07:33 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Instance spawned successfully.
Oct 26 04:07:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 04:07:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:07:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:07:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:07:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:07:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:07:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:07:33 user nova-compute[74630]: INFO nova.compute.manager [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Took 5.34 seconds to spawn the instance on the hypervisor.
Oct 26 04:07:33 user nova-compute[74630]: DEBUG nova.compute.manager [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 04:07:33 user nova-compute[74630]: DEBUG nova.compute.manager [req-0c6a21bf-7fdb-4193-9577-8f3b0ea1ba2c req-ec28402a-ea77-4caf-accd-05b841120119 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Received event network-vif-plugged-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:07:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0c6a21bf-7fdb-4193-9577-8f3b0ea1ba2c req-ec28402a-ea77-4caf-accd-05b841120119 service nova] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:07:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0c6a21bf-7fdb-4193-9577-8f3b0ea1ba2c req-ec28402a-ea77-4caf-accd-05b841120119 service nova] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:07:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-0c6a21bf-7fdb-4193-9577-8f3b0ea1ba2c req-ec28402a-ea77-4caf-accd-05b841120119 service nova] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:33 user nova-compute[74630]: DEBUG nova.compute.manager [req-0c6a21bf-7fdb-4193-9577-8f3b0ea1ba2c req-ec28402a-ea77-4caf-accd-05b841120119 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] No waiting events found dispatching network-vif-plugged-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:07:33 user nova-compute[74630]: WARNING nova.compute.manager [req-0c6a21bf-7fdb-4193-9577-8f3b0ea1ba2c req-ec28402a-ea77-4caf-accd-05b841120119 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Received unexpected event network-vif-plugged-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb for instance with vm_state building and task_state spawning.
Oct 26 04:07:33 user nova-compute[74630]: INFO nova.compute.manager [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Took 5.87 seconds to build instance.
Oct 26 04:07:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-50018a71-d1a7-453a-a43e-2919c2a982b1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.968s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:07:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:45 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:07:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:07:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:07:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:07:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:07:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:56 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:07:57 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:07:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:07:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:00 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:08:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:08:01 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:08:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:08:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:08:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:08:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:08:01 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:08:01 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:08:01 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating instance_info_cache with network_info: [{"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:08:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:08:01 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:08:02 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:08:02 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:08:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:08:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:08:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:08:02 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:08:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:08:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:08:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:08:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:08:02 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:08:02 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:08:02 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=24.936668395996094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:08:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:08:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:08:03 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:08:03 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:08:03 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:08:03 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing inventories for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 04:08:03 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating ProviderTree inventory for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 04:08:03 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating inventory in ProviderTree for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 04:08:03 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing aggregate associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, aggregates: None {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 04:08:03 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing trait associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, traits: HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 04:08:03 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:08:03 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:08:03 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:08:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:08:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:08:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:10 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:08:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:08:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:08:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:08:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:08:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:08:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:08:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:08:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:08:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:08:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:08:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:08:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:08:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:08:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:08:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:08:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:47 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:08:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:08:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:08:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:08:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:08:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:08:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:08:56 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:08:57 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:08:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:08:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:08:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:08:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:08:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:02 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:09:02 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:09:02 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8919MB free_disk=24.934555053710938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:09:02 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:09:03 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:09:03 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:09:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:09:04 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:09:04 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:09:04 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:09:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:09:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:09:04 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:09:04 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:09:04 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating instance_info_cache with network_info: [{"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:09:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:09:04 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:09:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:09:05 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:09:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:09:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:09:12 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:09:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:09:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-b5f70b6a-5308-4f37-949f-cca1e120996c req-b5ce2f85-d252-4132-ac7e-f982c9964dc8 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Received event network-changed-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:09:18 user nova-compute[74630]: DEBUG nova.compute.manager [req-b5f70b6a-5308-4f37-949f-cca1e120996c req-b5ce2f85-d252-4132-ac7e-f982c9964dc8 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Refreshing instance network info cache due to event network-changed-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:09:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b5f70b6a-5308-4f37-949f-cca1e120996c req-b5ce2f85-d252-4132-ac7e-f982c9964dc8 service nova] Acquiring lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:09:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b5f70b6a-5308-4f37-949f-cca1e120996c req-b5ce2f85-d252-4132-ac7e-f982c9964dc8 service nova] Acquired lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:09:18 user nova-compute[74630]: DEBUG nova.network.neutron [req-b5f70b6a-5308-4f37-949f-cca1e120996c req-b5ce2f85-d252-4132-ac7e-f982c9964dc8 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Refreshing network info cache for port 9b9b5e63-0904-437f-a6dc-4df9cc88bcbb {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:09:18 user nova-compute[74630]: DEBUG nova.network.neutron [req-b5f70b6a-5308-4f37-949f-cca1e120996c req-b5ce2f85-d252-4132-ac7e-f982c9964dc8 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updated VIF entry in instance network info cache for port 9b9b5e63-0904-437f-a6dc-4df9cc88bcbb. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:09:18 user nova-compute[74630]: DEBUG nova.network.neutron [req-b5f70b6a-5308-4f37-949f-cca1e120996c req-b5ce2f85-d252-4132-ac7e-f982c9964dc8 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating instance_info_cache with network_info: [{"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:09:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-b5f70b6a-5308-4f37-949f-cca1e120996c req-b5ce2f85-d252-4132-ac7e-f982c9964dc8 service nova] Releasing lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:09:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:09:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:09:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:09:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG nova.objects.instance [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lazy-loading 'flavor' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:09:25 user nova-compute[74630]: INFO nova.compute.manager [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Attaching volume ae4abc1c-c228-443d-a2da-2ee07f27767a to /dev/vdb
Oct 26 04:09:25 user nova-compute[74630]: DEBUG os_brick.utils [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0511d5-2f71-4b58-84df-761950f6f2a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[24883809-b003-4220-af4a-944905e25f42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[de52bdb5-a311-4dc4-b16d-45486a7020da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[044adacb-c634-4734-b75d-b775c907b610]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:09:25 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 04:09:25 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20c85de-c3a7-4e3b-97fa-7433178f9f31]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG os_brick.utils [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:09:25 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating existing volume attachment record: 3ab3fe0f-56d8-417f-97dc-aa3f152db50e {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 04:09:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:09:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:09:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:09:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:09:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsTtGBkL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:09:43 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:09:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:09:43 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:09:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:09:43 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c26afd-415c-422b-8b64-5de857f3b135]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 04:09:43 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5471ea61-5c15-4297-a876-cef2a66bc943]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a] added
Oct 26 04:09:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[da167bc9-40b2-43a0-8298-cceb67e37cc1]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[de369918-9d8c-47cb-9714-aecbf36898f3]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nsTtGBkL {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nsTtGBkL" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b036e837-52ff-4d5f-aebf-06e998160a96]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nsTtGBkL'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7086cac2-6dfe-4688-80e9-fdcee2400754]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc1bf94-b2e1-4ae0-b265-80e30a824f8d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:09:43 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:09:43 user nova-compute[74630]:  {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:09:43 user nova-compute[74630]: WARNING os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 04:09:43 user nova-compute[74630]: 
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02e7219-997c-455a-b5d7-bc4a4ed5cf7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a, portal: 172.16.0.220,3260]
Oct 26 04:09:43 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a, portal: 172.16.0.220,3260] successful.
Oct 26 04:09:43 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:09:43 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f648dfbf-4bf2-4702-bf04-306c75e88112]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cf54ca-3aec-4d43-924e-594b3803e787]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a (non-flash)
Oct 26 04:09:44 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a (non-flash)
Oct 26 04:09:44 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dd7136-2bd4-443a-b47f-a33ad545ec13]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsTtGBkL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:09:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:09:45 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:09:45 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23366323662353262', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:09:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366323662353262', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 04:09:45 user nova-compute[74630]: DEBUG nova.objects.instance [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lazy-loading 'flavor' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:09:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 04:09:45 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:09:45 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:09:45 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:09:45 user nova-compute[74630]:   <serial>ae4abc1c-c228-443d-a2da-2ee07f27767a</serial>
Oct 26 04:09:45 user nova-compute[74630]: </disk>
Oct 26 04:09:45 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 04:09:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:09:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:09:45 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] No VIF found with MAC fa:16:3e:0c:4b:dc, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 04:09:45 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8ed34e0b-0e2c-47fb-99c0-e508a176ac73 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.450s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:09:47 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:09:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:09:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:09:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:09:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:09:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:09:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:09:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:09:58 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:09:58 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:09:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:09:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:03 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:10:03 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:10:03 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:10:03 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:10:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:10:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:10:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:10:03 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:10:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:10:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:10:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:10:03 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:10:03 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74630) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 04:10:03 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:10:03 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:10:03 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8898MB free_disk=24.932552337646484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:10:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:10:03 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:10:04 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:10:04 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:10:04 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:10:04 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:10:04 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:10:04 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:10:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:10:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:10:06 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:10:06 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:10:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:10:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:10:06 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:10:06 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:10:06 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating instance_info_cache with network_info: [{"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:10:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:10:06 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:10:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:10:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:10:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:10:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:10:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:10:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:10:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:10:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:10:20 user nova-compute[74630]: INFO nova.compute.manager [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Detaching volume ae4abc1c-c228-443d-a2da-2ee07f27767a
Oct 26 04:10:20 user nova-compute[74630]: INFO nova.virt.block_device [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Attempting to driver detach volume ae4abc1c-c228-443d-a2da-2ee07f27767a from mountpoint /dev/vdb
Oct 26 04:10:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Attempting to detach device vdb from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 04:10:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:10:20 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:10:20 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:10:20 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:10:20 user nova-compute[74630]:   <serial>ae4abc1c-c228-443d-a2da-2ee07f27767a</serial>
Oct 26 04:10:20 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:10:20 user nova-compute[74630]: </disk>
Oct 26 04:10:20 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:10:20 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Successfully detached device vdb from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the persistent domain config.
Oct 26 04:10:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 04:10:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:10:20 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:10:20 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:10:20 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:10:20 user nova-compute[74630]:   <serial>ae4abc1c-c228-443d-a2da-2ee07f27767a</serial>
Oct 26 04:10:20 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:10:20 user nova-compute[74630]: </disk>
Oct 26 04:10:20 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:10:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 04:10:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:10:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:10:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:10:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:10:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:10:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:10:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:10:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:10:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:10:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:10:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:10:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:10:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:10:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:41 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 is timed out.
Oct 26 04:10:41 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Successfully detached device vdb from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the live domain config.
Oct 26 04:10:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsTtGBkL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:10:41 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[03177fc5-b578-40d4-862c-9e5abb83938c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 04:10:41 user nova-compute[74630]: No targets found.
Oct 26 04:10:41 user nova-compute[74630]: iSNS:
Oct 26 04:10:41 user nova-compute[74630]: No targets found.
Oct 26 04:10:41 user nova-compute[74630]: STATIC:
Oct 26 04:10:41 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a
Oct 26 04:10:41 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:10:41 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:10:41 user nova-compute[74630]: FIRMWARE:
Oct 26 04:10:41 user nova-compute[74630]: No targets found.
Oct 26 04:10:41 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 04:10:41 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 04:10:41 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a41491-8cb1-45e6-96da-01985932d422]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5d01ab-abd5-4a58-9ccb-5aeba958e717]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a (non-flash)
Oct 26 04:10:41 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a (non-flash)
Oct 26 04:10:41 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3184624670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f19fbea-1928-4ece-9f47-1bf341b77657]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[98907665-2139-4945-9359-97fb20bc7c3c]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[450fa004-96f4-442b-811b-06ca5443ca53]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[918c062b-4e12-4841-a05c-42bf46b34f63]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f347dd3b-f37c-40c9-b37c-12f0a36c116f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e894b17-cabc-46ae-b35c-7434d6c82bc3]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a, portal: 172.16.0.220,3260]
Oct 26 04:10:41 user nova-compute[74630]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a, portal: 172.16.0.220,3260] successful.
Oct 26 04:10:41 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4abc1c-c228-443d-a2da-2ee07f27767a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f349c37-1fc1-485b-a378-2a67d2a2da7e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] <== disconnect_volume: return (280ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:10:41 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 04:10:42 user nova-compute[74630]: DEBUG nova.objects.instance [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lazy-loading 'flavor' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:10:42 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-a461cc28-ba2a-4e54-afb0-70235e7ea626 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.748s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:10:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:10:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:10:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:10:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:10:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:48 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:10:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:10:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:57 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:10:59 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:10:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:00 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:11:03 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:11:03 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:11:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:11:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:11:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:05 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:11:05 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:11:05 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=24.931167602539062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:11:05 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:11:06 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:11:06 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:11:06 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:11:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:11:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:11:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:11:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:11:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:11:08 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:11:08 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:11:08 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating instance_info_cache with network_info: [{"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:11:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:11:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:11:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:11:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:11:12 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:11:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:11:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:11:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:11:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG nova.objects.instance [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lazy-loading 'flavor' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:11:17 user nova-compute[74630]: INFO nova.compute.manager [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Attaching volume d5d1eb24-5731-4d83-a92d-84892c7d7fda to /dev/vdb
Oct 26 04:11:17 user nova-compute[74630]: DEBUG os_brick.utils [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f88308f-f062-480d-9350-38bed8d128d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d425066-bdd4-4da9-8b0e-96db30d51802]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c182b758-470f-4f03-a6f3-ac2e6899d09d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80cf299-d99d-4eef-8369-b50efaa7b0ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:11:17 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 04:11:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d0ce66-d6d1-4141-86af-cb6556915ee4]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG os_brick.utils [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:11:17 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating existing volume attachment record: 66b02fec-16d2-468f-b1b6-67e2fa8644a4 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 04:11:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:11:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:11:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goeBqVlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:11:34 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:11:34 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:11:34 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9d6f1d-a8c6-4058-ab76-7aec21df7a20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 04:11:34 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aea9204-b7e3-4bc6-9b81-0b8dda8a6ae3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda] added
Oct 26 04:11:34 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5281b676-679d-4bb1-88c8-e9d7ffb83753]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[89845410-1b6f-4d91-ae82-3f126e2d8e90]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v goeBqVlJ {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v goeBqVlJ" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7973f56-f2a6-4578-9009-9fc5185815d4]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'goeBqVlJ'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[841f9b14-b33a-47c9-9907-949acb27dcc2]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f6f390-f06a-4aa1-ab3d-7eacde21cc13]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:11:34 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:11:34 user nova-compute[74630]:  {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:11:34 user nova-compute[74630]: WARNING os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 04:11:34 user nova-compute[74630]: 
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe7c5c2-03c2-411c-bba5-4aef22b99b06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda, portal: 172.16.0.220,3260]
Oct 26 04:11:34 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda, portal: 172.16.0.220,3260] successful.
Oct 26 04:11:34 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef0d2a-5c66-448f-8739-cf3079cfab6e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd36431a-16cc-4934-a994-92a0a1847fc5]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda (non-flash)
Oct 26 04:11:34 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda (non-flash)
Oct 26 04:11:34 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[050940e2-622b-44a6-99cd-b1e2b7213aea]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:35 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:11:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goeBqVlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 04:11:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:11:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26466323338383331', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:11:35 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466323338383331', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 04:11:35 user nova-compute[74630]: DEBUG nova.objects.instance [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lazy-loading 'flavor' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:11:35 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 04:11:35 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:11:35 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:11:35 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:11:35 user nova-compute[74630]:   <serial>d5d1eb24-5731-4d83-a92d-84892c7d7fda</serial>
Oct 26 04:11:35 user nova-compute[74630]: </disk>
Oct 26 04:11:35 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 04:11:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:11:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:11:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] No VIF found with MAC fa:16:3e:0c:4b:dc, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 04:11:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-3f75eac6-5af8-41b3-9030-bf31f0295147 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.984s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:11:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:11:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:11:38 user nova-compute[74630]: INFO nova.compute.manager [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Detaching volume d5d1eb24-5731-4d83-a92d-84892c7d7fda
Oct 26 04:11:38 user nova-compute[74630]: INFO nova.virt.block_device [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Attempting to driver detach volume d5d1eb24-5731-4d83-a92d-84892c7d7fda from mountpoint /dev/vdb
Oct 26 04:11:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Attempting to detach device vdb from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 04:11:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:11:38 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:11:38 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:11:38 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:11:38 user nova-compute[74630]:   <serial>d5d1eb24-5731-4d83-a92d-84892c7d7fda</serial>
Oct 26 04:11:38 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:11:38 user nova-compute[74630]: </disk>
Oct 26 04:11:38 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:11:38 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Successfully detached device vdb from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the persistent domain config.
Oct 26 04:11:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 04:11:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:11:38 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:11:38 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:11:38 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:11:38 user nova-compute[74630]:   <serial>d5d1eb24-5731-4d83-a92d-84892c7d7fda</serial>
Oct 26 04:11:38 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:11:38 user nova-compute[74630]: </disk>
Oct 26 04:11:38 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:11:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 04:11:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:11:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:11:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:48 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:11:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:11:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:11:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:11:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:53 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:11:53 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74630) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 04:11:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:11:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:11:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:11:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:58 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 is timed out.
Oct 26 04:11:58 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Successfully detached device vdb from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the live domain config.
Oct 26 04:11:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goeBqVlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:11:58 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:11:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1768f7fa-9817-43ce-bfcf-3be45fbeb3fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 04:11:58 user nova-compute[74630]: No targets found.
Oct 26 04:11:58 user nova-compute[74630]: iSNS:
Oct 26 04:11:58 user nova-compute[74630]: No targets found.
Oct 26 04:11:58 user nova-compute[74630]: STATIC:
Oct 26 04:11:58 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda
Oct 26 04:11:58 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:11:58 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:11:58 user nova-compute[74630]: FIRMWARE:
Oct 26 04:11:58 user nova-compute[74630]: No targets found.
Oct 26 04:11:58 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 04:11:58 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 04:11:58 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[367ff3f9-5f1c-4279-97b1-57bfc3d107f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5aeccdb-a77f-4015-9b4a-4ae9d59591f5]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda (non-flash)
Oct 26 04:11:58 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda (non-flash)
Oct 26 04:11:58 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c280040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1ce09f-40a7-4434-aa3f-dd63ea2e2b44]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[515ae115-7480-427f-bbaa-26b44f6c9a81]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 04:11:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b03ecd-0639-4073-b4b9-75ef7580d738]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caef34b-0681-4692-b577-89c79827d444]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a7fa55-7f72-4e9c-aa2e-d9624d2baa79]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ce1faa-464b-4f0d-9111-e54c7c62c497]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda, portal: 172.16.0.220,3260]
Oct 26 04:11:59 user nova-compute[74630]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda, portal: 172.16.0.220,3260] successful.
Oct 26 04:11:59 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d1eb24-5731-4d83-a92d-84892c7d7fda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1dc8d8-4b66-486e-af1f-bd690f6b53f9]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] <== disconnect_volume: return (268ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:11:59 user nova-compute[74630]: DEBUG nova.objects.instance [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lazy-loading 'flavor' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:12:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8da22617-14d2-4bd4-9085-397b3687add4 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.668s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:12:01 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:12:02 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:12:03 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:12:03 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:12:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:12:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:12:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:12:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:12:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:12:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:12:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:12:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:07 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:07 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:12:07 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:12:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=24.92227554321289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:12:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:12:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:12:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:12:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:12:07 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:12:08 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:12:08 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:12:08 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:12:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:12:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:12:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:12:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:12:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:12:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:12:09 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:12:09 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:12:09 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating instance_info_cache with network_info: [{"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:12:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:12:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:12:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:12:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:12:11 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:12:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 04:12:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] There are 0 instances to clean {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 04:12:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:12:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:12:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:12:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:12:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:12:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:12:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:12:15 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:12:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:12:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:12:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:12:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:12:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:12:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:12:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:12:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:12:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:12:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:12:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:12:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:12:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG nova.objects.instance [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lazy-loading 'flavor' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:12:33 user nova-compute[74630]: INFO nova.compute.manager [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Attaching volume effce7cb-708c-46f4-85df-0e597d4c7159 to /dev/vdb
Oct 26 04:12:33 user nova-compute[74630]: DEBUG os_brick.utils [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b11599-c819-4cd9-b58a-2138f32bac6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1d9cd0-542b-418b-b6e8-e2788ad0ee52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3097db81-ce42-4941-b19d-0a9326a4022f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d389d670-b74b-43d4-ab40-0b3132f0cf73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:12:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 04:12:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:12:34 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 04:12:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70abda4-2774-47ec-8fc9-0c17eb27bb2e]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 04:12:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 04:12:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 04:12:34 user nova-compute[74630]: DEBUG os_brick.utils [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:12:34 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating existing volume attachment record: d005e391-5ae3-4979-a27b-2dcf1aa45bea {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 04:12:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:12:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:12:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:12:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:12:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:12:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:12:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:12:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:12:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:12:49 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:12:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:12:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:12:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:12:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:12:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:12:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:12:50 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 04:12:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noGadQzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:12:50 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:12:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:12:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:12:50 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:12:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:12:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:12:50 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 04:12:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d10ea2-7270-4d0b-ab89-3a2a4b328850]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 04:12:50 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:12:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:50 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9519e9b6-3085-430d-8355-aab3428d2c9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:50 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159] added
Oct 26 04:12:50 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:12:50 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afebae0-def0-4ec0-9be5-39982b069bec]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aacbde-b8bf-4c43-9a8b-f8ff40182ef1]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v noGadQzr {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v noGadQzr" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[18923df9-3909-4842-a130-1e9557940e92]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'noGadQzr'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e5c1f4-f419-46a7-95b7-5fc7a33324eb]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe1d264-7d8f-432b-a0cb-43a3ef51cba5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:12:51 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:12:51 user nova-compute[74630]:  {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:12:51 user nova-compute[74630]: WARNING os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 04:12:51 user nova-compute[74630]: 
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c323c9a5-db66-4ce3-b793-e5be05db2e67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159, portal: 172.16.0.220,3260]
Oct 26 04:12:51 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159, portal: 172.16.0.220,3260] successful.
Oct 26 04:12:51 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.108s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c778e127-a7ba-4dfb-b5bc-0e6a5f8f6f9a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b2c7f7-74fa-4d98-bc78-bfa82ebc3680]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 (non-flash)
Oct 26 04:12:51 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 (non-flash)
Oct 26 04:12:51 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77169a6-2ba5-43e5-bb63-4fbe7f12786f]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:12:51 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:12:52 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:12:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noGadQzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 04:12:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:12:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23737613630306630', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:12:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737613630306630', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 04:12:52 user nova-compute[74630]: DEBUG nova.objects.instance [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lazy-loading 'flavor' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:12:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 04:12:52 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:12:52 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:12:52 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:12:52 user nova-compute[74630]:   <serial>effce7cb-708c-46f4-85df-0e597d4c7159</serial>
Oct 26 04:12:52 user nova-compute[74630]: </disk>
Oct 26 04:12:52 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 04:12:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:12:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:12:52 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] No VIF found with MAC fa:16:3e:0c:4b:dc, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 04:12:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-820b6cf6-7fdb-4df4-9875-25a92c89bcd5 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.101s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:12:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:12:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:12:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:12:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:12:55 user nova-compute[74630]: INFO nova.compute.manager [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Detaching volume effce7cb-708c-46f4-85df-0e597d4c7159
Oct 26 04:12:55 user nova-compute[74630]: INFO nova.virt.block_device [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Attempting to driver detach volume effce7cb-708c-46f4-85df-0e597d4c7159 from mountpoint /dev/vdb
Oct 26 04:12:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Attempting to detach device vdb from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 04:12:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:12:55 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:12:55 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:12:55 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:12:55 user nova-compute[74630]:   <serial>effce7cb-708c-46f4-85df-0e597d4c7159</serial>
Oct 26 04:12:55 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:12:55 user nova-compute[74630]: </disk>
Oct 26 04:12:55 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:12:55 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Successfully detached device vdb from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the persistent domain config.
Oct 26 04:12:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 04:12:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:12:55 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:12:55 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:12:55 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:12:55 user nova-compute[74630]:   <serial>effce7cb-708c-46f4-85df-0e597d4c7159</serial>
Oct 26 04:12:55 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:12:55 user nova-compute[74630]: </disk>
Oct 26 04:12:55 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:12:55 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 04:12:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:12:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:13:02 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:13:02 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:13:04 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:13:04 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:13:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:13:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:13:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:13:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:13:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:13:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:13:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating instance_info_cache with network_info: [{"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:13:10 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:13:10 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:13:10 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=24.92127227783203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:13:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:13:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:13:10 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:13:10 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:13:10 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:13:10 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing inventories for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 04:13:10 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating ProviderTree inventory for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 04:13:10 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating inventory in ProviderTree for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 04:13:10 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing aggregate associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, aggregates: None {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 04:13:10 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing trait associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, traits: HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 04:13:10 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:13:10 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:13:10 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:13:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:13:11 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:13:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:13:15 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 is timed out.
Oct 26 04:13:15 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Successfully detached device vdb from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the live domain config.
Oct 26 04:13:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noGadQzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:13:15 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[66341c64-4a76-43f9-8564-0b3044e36343]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 04:13:15 user nova-compute[74630]: No targets found.
Oct 26 04:13:15 user nova-compute[74630]: iSNS:
Oct 26 04:13:15 user nova-compute[74630]: No targets found.
Oct 26 04:13:15 user nova-compute[74630]: STATIC:
Oct 26 04:13:15 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159
Oct 26 04:13:15 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:13:15 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:13:15 user nova-compute[74630]: FIRMWARE:
Oct 26 04:13:15 user nova-compute[74630]: No targets found.
Oct 26 04:13:15 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 04:13:15 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 04:13:15 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[07147113-394a-44ae-aaad-fc5773e9a0a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d7005e-32a5-40ad-8bb5-81a9d99386f4]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 (non-flash)
Oct 26 04:13:15 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 (non-flash)
Oct 26 04:13:15 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c6649d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecd73f2-95db-405e-af89-f073c107e93c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bde0bda-04c3-4e88-ba1a-126da872b40f]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6510087c-a12a-4a46-aff2-5780e9f96fca]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13cb491-d656-4dc0-ad30-6e68f2f1f73a]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd711a8-6773-4fbd-b739-1c624ecf75b5]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3b457d-951c-44b0-ac34-7097c6c71652]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159, portal: 172.16.0.220,3260]
Oct 26 04:13:15 user nova-compute[74630]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159, portal: 172.16.0.220,3260] successful.
Oct 26 04:13:15 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:effce7cb-708c-46f4-85df-0e597d4c7159 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f680788c-0cb5-43ea-93bf-bc697cf47cd4]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] <== disconnect_volume: return (291ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:13:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 04:13:16 user nova-compute[74630]: DEBUG nova.objects.instance [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lazy-loading 'flavor' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:13:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e2208184-b0cf-4682-b3c0-f0af280587a1 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.702s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:13:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:13:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:13:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:13:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:13:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:13:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:13:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:13:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:13:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:13:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:13:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:13:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:13:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:13:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:13:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:13:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:13:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:13:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:13:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:13:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:13:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:13:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:13:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:13:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:13:51 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:13:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:13:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:13:51 user nova-compute[74630]: DEBUG nova.objects.instance [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lazy-loading 'flavor' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:13:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:13:52 user nova-compute[74630]: INFO nova.compute.manager [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Attaching volume 23835292-a1e0-441c-937c-6fe051005fa2 to /dev/vdb
Oct 26 04:13:52 user nova-compute[74630]: DEBUG os_brick.utils [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[976f7136-521f-4672-b4a6-6b9df40ee71c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[df059f86-d673-4857-9157-92cd1dd56405]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e785d75e-9686-46cf-98aa-a51e3e3161f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b3f71d-8b37-4205-bad3-ba14d9aab8ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:13:52 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 04:13:52 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cbf01b-6a50-469f-beea-aed08f1e98da]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG os_brick.utils [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:13:52 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating existing volume attachment record: 4cedf57d-4b97-4773-beb7-23420c4bf712 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 04:13:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:13:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:13:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:13:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:13:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:13:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:13:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:13:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:02 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:14:04 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:14:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:14:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:14:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:14:06 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akidxRFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:14:09 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:14:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:14:09 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:14:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:14:09 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 04:14:09 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:14:09 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:14:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=24.920467376708984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0579144d-1756-40ad-9c4d-8d489f65be2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 04:14:09 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cb85b2-172b-4e1e-bb8b-0ba6f0fcc193]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2] added
Oct 26 04:14:09 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[22887786-a8d5-4903-8a15-7cc393276200]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1559ae81-826b-4abb-a600-3365e70ec27d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:14:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akidxRFG {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akidxRFG" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f984c96-485e-4d36-8f9f-66923890efab]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'akidxRFG'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8293d2-5eb8-4361-90cb-7aa9d4bd6794]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa62de9-d5b7-4d46-ab2e-dee2f5828de4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:14:10 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:14:10 user nova-compute[74630]:  {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:14:10 user nova-compute[74630]: WARNING os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 04:14:10 user nova-compute[74630]: 
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ce7de8-de42-4c11-aec3-ae729d910088]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2, portal: 172.16.0.220,3260]
Oct 26 04:14:10 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2, portal: 172.16.0.220,3260] successful.
Oct 26 04:14:10 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[696277dc-58c2-4811-b55c-e99a8c8fd762]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cc8076-b4bf-4db6-a4c0-59d4f82fe2cc]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 (non-flash)
Oct 26 04:14:10 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 (non-flash)
Oct 26 04:14:10 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d948145f-ad30-46a4-94c5-31abbf702b04]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akidxRFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:14:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:14:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:14:11 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26438663661613530', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:14:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438663661613530', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 04:14:11 user nova-compute[74630]: DEBUG nova.objects.instance [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lazy-loading 'flavor' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:14:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 04:14:11 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:14:11 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:14:11 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:14:11 user nova-compute[74630]:   <serial>23835292-a1e0-441c-937c-6fe051005fa2</serial>
Oct 26 04:14:11 user nova-compute[74630]: </disk>
Oct 26 04:14:11 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 04:14:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:14:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:14:11 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] No VIF found with MAC fa:16:3e:0c:4b:dc, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 04:14:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-6d65a328-c30b-40aa-9041-b919ea69c489 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.350s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:14:12 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:14:12 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:14:12 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:14:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:14:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:14:12 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:14:12 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:14:12 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating instance_info_cache with network_info: [{"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:14:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:14:12 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:14:12 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:14:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:14:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:14:14 user nova-compute[74630]: INFO nova.compute.manager [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Detaching volume 23835292-a1e0-441c-937c-6fe051005fa2
Oct 26 04:14:14 user nova-compute[74630]: INFO nova.virt.block_device [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Attempting to driver detach volume 23835292-a1e0-441c-937c-6fe051005fa2 from mountpoint /dev/vdb
Oct 26 04:14:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Attempting to detach device vdb from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 04:14:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:14:14 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:14:14 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:14:14 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:14:14 user nova-compute[74630]:   <serial>23835292-a1e0-441c-937c-6fe051005fa2</serial>
Oct 26 04:14:14 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:14:14 user nova-compute[74630]: </disk>
Oct 26 04:14:14 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:14:14 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Successfully detached device vdb from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the persistent domain config.
Oct 26 04:14:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 04:14:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:14:14 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:14:14 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:14:14 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:14:14 user nova-compute[74630]:   <serial>23835292-a1e0-441c-937c-6fe051005fa2</serial>
Oct 26 04:14:14 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:14:14 user nova-compute[74630]: </disk>
Oct 26 04:14:14 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:14:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:14 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 04:14:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:14:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:14:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:14:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:14:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:14:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:14:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:14:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:14:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:34 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 is timed out.
Oct 26 04:14:34 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Successfully detached device vdb from instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 from the live domain config.
Oct 26 04:14:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 04:14:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akidxRFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:14:34 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:14:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:14:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:14:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f8d677-ff59-4180-b1b6-a153ae1ca93a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 04:14:34 user nova-compute[74630]: No targets found.
Oct 26 04:14:34 user nova-compute[74630]: iSNS:
Oct 26 04:14:34 user nova-compute[74630]: No targets found.
Oct 26 04:14:34 user nova-compute[74630]: STATIC:
Oct 26 04:14:34 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2
Oct 26 04:14:34 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:14:34 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:14:34 user nova-compute[74630]: FIRMWARE:
Oct 26 04:14:34 user nova-compute[74630]: No targets found.
Oct 26 04:14:34 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:14:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 04:14:34 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 04:14:34 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 04:14:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 04:14:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4e5364-d088-4ea7-96fb-74913222ac95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7c5fdd-987e-4cdb-9450-9942592a96e9]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 (non-flash)
Oct 26 04:14:35 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 (non-flash)
Oct 26 04:14:35 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c41b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8da1b15-f255-4fe0-b707-f69ce5c2f60d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3d17d1-a90a-4a0e-b3a9-a5d93540eff6]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52ecee0-eedc-45bc-8b53-b164e9be6f36]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6e17ae-9c3f-4416-85ee-38161401ca27]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8e64da-4f71-4cce-86b0-2b7eafd4ae1e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e167226-c25a-4a2d-bb0a-860bb998d5ce]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2, portal: 172.16.0.220,3260]
Oct 26 04:14:35 user nova-compute[74630]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2, portal: 172.16.0.220,3260] successful.
Oct 26 04:14:35 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23835292-a1e0-441c-937c-6fe051005fa2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95884e8-8430-45dd-920e-e1e236deb27e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] <== disconnect_volume: return (281ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:14:35 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 04:14:36 user nova-compute[74630]: DEBUG nova.objects.instance [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lazy-loading 'flavor' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:14:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-583d050c-f630-428e-b879-3a0f59ceac1b tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.720s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:14:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:14:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:14:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:14:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:14:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:14:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:14:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:14:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:14:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:53 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:14:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:14:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:14:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:14:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:14:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:14:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:14:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:15:03 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:15:04 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:15:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:15:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:15:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:15:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:15:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:15:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:15:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:15:06 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:15:09 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:15:09 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:15:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8985MB free_disk=24.919567108154297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:15:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:15:10 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:15:10 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:15:10 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:15:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:15:11 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:15:11 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:15:13 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:15:13 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:15:13 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:15:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:15:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:15:13 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:15:13 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:15:13 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating instance_info_cache with network_info: [{"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:15:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-d7ff3289-9a55-4f3f-aee6-9e96212766e1" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:15:13 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:15:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:15:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:15:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:15:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:15:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:15:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:15:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:15:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:15:22 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:15:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:15:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:15:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:15:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:15:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:15:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:15:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:15:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:15:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:15:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:15:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:15:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:15:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:15:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:15:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:15:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:15:54 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:15:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:15:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:15:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:15:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:15:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:15:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:15:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:16:03 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:16:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:16:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:16:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:16:06 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:16:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:16:09 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:16:09 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:16:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=24.918529510498047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance d7ff3289-9a55-4f3f-aee6-9e96212766e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:16:09 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:16:10 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:16:10 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:16:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:16:12 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:16:13 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:16:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Skipping network cache update for instance because it is being deleted. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:16:15 user nova-compute[74630]: INFO nova.compute.manager [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Terminating instance
Oct 26 04:16:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG nova.compute.manager [req-d9c76ba7-5c70-4f46-908a-1fe734d409d3 req-3aed7816-6e2a-4ce2-ad93-b14afa5c1ec0 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Received event network-vif-unplugged-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d9c76ba7-5c70-4f46-908a-1fe734d409d3 req-3aed7816-6e2a-4ce2-ad93-b14afa5c1ec0 service nova] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d9c76ba7-5c70-4f46-908a-1fe734d409d3 req-3aed7816-6e2a-4ce2-ad93-b14afa5c1ec0 service nova] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-d9c76ba7-5c70-4f46-908a-1fe734d409d3 req-3aed7816-6e2a-4ce2-ad93-b14afa5c1ec0 service nova] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG nova.compute.manager [req-d9c76ba7-5c70-4f46-908a-1fe734d409d3 req-3aed7816-6e2a-4ce2-ad93-b14afa5c1ec0 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] No waiting events found dispatching network-vif-unplugged-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG nova.compute.manager [req-d9c76ba7-5c70-4f46-908a-1fe734d409d3 req-3aed7816-6e2a-4ce2-ad93-b14afa5c1ec0 service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Received event network-vif-unplugged-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:16:15 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Instance destroyed successfully.
Oct 26 04:16:15 user nova-compute[74630]: DEBUG nova.objects.instance [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lazy-loading 'resources' on Instance uuid d7ff3289-9a55-4f3f-aee6-9e96212766e1 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T04:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-317914246',display_name='tempest-SnapshotDataIntegrityTests-server-317914246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-317914246',id=52,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvQkOSCWs2i/qu/wjiHenXiY+4IX567ZkLIrRLVE+EZiZHfhVC59U6kMmKl49bKA+j7yn3ompEOb8Lc4UW2Ls+G7N4xeHhHRNcaA9P9KV3HXAgmEVOgWE4TPEKpwS4Y0Q==',key_name='tempest-keypair-790115128',keypairs=<?>,launch_index=0,launched_at=2023-10-26T04:07:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb9cea58c1ea46f0a358513888599475',ramdisk_id='',reservation_id='r-16yx4atn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-360316176',owner_user_name='tempest-SnapshotDataIntegrityTests-360316176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T04:07:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bef3d0cfc53649b49d5aa14fb3c74e2c',uuid=d7ff3289-9a55-4f3f-aee6-9e96212766e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Converting VIF {"id": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "address": "fa:16:3e:0c:4b:dc", "network": {"id": "9f8fd0e3-0f07-444e-8da2-8df9925d800c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613226030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb9cea58c1ea46f0a358513888599475", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b9b5e63-09", "ovs_interfaceid": "9b9b5e63-0904-437f-a6dc-4df9cc88bcbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:4b:dc,bridge_name='br-int',has_traffic_filtering=True,id=9b9b5e63-0904-437f-a6dc-4df9cc88bcbb,network=Network(9f8fd0e3-0f07-444e-8da2-8df9925d800c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b9b5e63-09') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG os_vif [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:4b:dc,bridge_name='br-int',has_traffic_filtering=True,id=9b9b5e63-0904-437f-a6dc-4df9cc88bcbb,network=Network(9f8fd0e3-0f07-444e-8da2-8df9925d800c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b9b5e63-09') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b9b5e63-09, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f0609a6-b7b2-477b-ad22-d64384e70ed1) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:16:15 user nova-compute[74630]: INFO os_vif [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:4b:dc,bridge_name='br-int',has_traffic_filtering=True,id=9b9b5e63-0904-437f-a6dc-4df9cc88bcbb,network=Network(9f8fd0e3-0f07-444e-8da2-8df9925d800c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b9b5e63-09')
Oct 26 04:16:15 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Deleting instance files /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1_del
Oct 26 04:16:15 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Deletion of /opt/stack/data/nova/instances/d7ff3289-9a55-4f3f-aee6-9e96212766e1_del complete
Oct 26 04:16:15 user nova-compute[74630]: INFO nova.compute.manager [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 26 04:16:15 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 04:16:15 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 04:16:16 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:16:16 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Took 0.76 seconds to deallocate network for instance.
Oct 26 04:16:16 user nova-compute[74630]: DEBUG nova.compute.manager [req-cbec6060-9901-4f60-b8df-a319e6b7d817 req-71d91102-6802-4ac9-bf31-45e71ed8ddef service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Received event network-vif-deleted-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:16:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:16:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:16:16 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:16:16 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:16:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:16:16 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Deleted allocations for instance d7ff3289-9a55-4f3f-aee6-9e96212766e1
Oct 26 04:16:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-7eb7483c-5d9c-4d96-a9c6-e5a12bdb8b19 tempest-SnapshotDataIntegrityTests-360316176 tempest-SnapshotDataIntegrityTests-360316176-project-member] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.959s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:16:17 user nova-compute[74630]: DEBUG nova.compute.manager [req-9c0698b3-dac2-450b-bbd3-f91a6076a0ce req-5172e2df-5e3f-4e2f-a664-7a388b8aeb8f service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Received event network-vif-plugged-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:16:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9c0698b3-dac2-450b-bbd3-f91a6076a0ce req-5172e2df-5e3f-4e2f-a664-7a388b8aeb8f service nova] Acquiring lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:16:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9c0698b3-dac2-450b-bbd3-f91a6076a0ce req-5172e2df-5e3f-4e2f-a664-7a388b8aeb8f service nova] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:16:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-9c0698b3-dac2-450b-bbd3-f91a6076a0ce req-5172e2df-5e3f-4e2f-a664-7a388b8aeb8f service nova] Lock "d7ff3289-9a55-4f3f-aee6-9e96212766e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:16:17 user nova-compute[74630]: DEBUG nova.compute.manager [req-9c0698b3-dac2-450b-bbd3-f91a6076a0ce req-5172e2df-5e3f-4e2f-a664-7a388b8aeb8f service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] No waiting events found dispatching network-vif-plugged-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:16:17 user nova-compute[74630]: WARNING nova.compute.manager [req-9c0698b3-dac2-450b-bbd3-f91a6076a0ce req-5172e2df-5e3f-4e2f-a664-7a388b8aeb8f service nova] [instance: d7ff3289-9a55-4f3f-aee6-9e96212766e1] Received unexpected event network-vif-plugged-9b9b5e63-0904-437f-a6dc-4df9cc88bcbb for instance with vm_state deleted and task_state None.
Oct 26 04:16:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:16:21 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:16:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:16:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:16:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:16:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:16:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:16:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:16:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:16:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:16:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:16:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:16:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:16:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:16:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:16:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:16:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:16:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:16:55 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:16:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:16:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:16:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:16:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:16:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:16:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:17:00 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:17:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74630) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 04:17:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:17:03 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:17:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:17:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:17:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:17:08 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:11 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:17:11 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:17:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:17:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:17:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:17:11 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:17:11 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:17:11 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:17:11 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=9101MB free_disk=24.945247650146484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:17:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:17:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:17:11 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:17:11 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:17:11 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:17:11 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:17:11 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:17:11 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:17:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:15 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:17:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:17:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:17:15 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 04:17:15 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:17:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:16 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:17:18 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:17:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:17:22 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:17:25 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:17:25 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:17:25 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 04:17:25 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] There are 0 instances to clean {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 04:17:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:17:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:17:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:17:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:17:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:37 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:17:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:42 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:17:56 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:17:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:17:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:17:57 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Starting instance... {{(pid=74630) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74630) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 04:17:58 user nova-compute[74630]: INFO nova.compute.claims [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Claim successful on node user
Oct 26 04:17:58 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Start building networks asynchronously for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Allocating IP information in the background. {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] allocate_for_instance() {{(pid=74630) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 04:17:58 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 04:17:58 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Start building block device mappings for instance. {{(pid=74630) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG nova.policy [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '363358deec9d432499d1b0bd6866c7cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9443689a30914a1293a8bacfa9439291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74630) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Start spawning the instance on the hypervisor. {{(pid=74630) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Creating instance directory {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 04:17:58 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Creating image(s)
Oct 26 04:17:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "/opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "/opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "/opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.195s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "e83ecc82d871a951e1d88a72177228df7a876c8b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:17:58 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.218s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk 1073741824 {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b,backing_fmt=raw /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk 1073741824" returned: 0 in 0.110s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "e83ecc82d871a951e1d88a72177228df7a876c8b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e83ecc82d871a951e1d88a72177228df7a876c8b --force-share --output=json" returned: 0 in 0.208s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk. size=1073741824 {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Successfully created port: 1bf25c77-6063-499c-a108-969bcd5ef34f {{(pid=74630) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG nova.virt.disk.api [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Cannot resize image /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk to a smaller size. {{(pid=74630) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Created local disks {{(pid=74630) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Ensure instance console log exists: /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/console.log {{(pid=74630) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:17:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Successfully updated port: 1bf25c77-6063-499c-a108-969bcd5ef34f {{(pid=74630) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquired lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Building network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-4b954134-4527-4329-8a60-c6ef1277c2c5 req-6632c5b7-2bf3-4d08-b694-8f4a6867c498 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Received event network-changed-1bf25c77-6063-499c-a108-969bcd5ef34f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.compute.manager [req-4b954134-4527-4329-8a60-c6ef1277c2c5 req-6632c5b7-2bf3-4d08-b694-8f4a6867c498 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Refreshing instance network info cache due to event network-changed-1bf25c77-6063-499c-a108-969bcd5ef34f. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4b954134-4527-4329-8a60-c6ef1277c2c5 req-6632c5b7-2bf3-4d08-b694-8f4a6867c498 service nova] Acquiring lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Instance cache missing network info. {{(pid=74630) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.network.neutron [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating instance_info_cache with network_info: [{"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Releasing lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Instance network_info: |[{"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74630) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4b954134-4527-4329-8a60-c6ef1277c2c5 req-6632c5b7-2bf3-4d08-b694-8f4a6867c498 service nova] Acquired lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.network.neutron [req-4b954134-4527-4329-8a60-c6ef1277c2c5 req-6632c5b7-2bf3-4d08-b694-8f4a6867c498 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Refreshing network info cache for port 1bf25c77-6063-499c-a108-969bcd5ef34f {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Start _get_guest_xml network_info=[{"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encrypted': False, 'image_id': '8519fea8-ccda-4565-9023-82b90e4bb746'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 04:18:00 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:18:00 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] CPU controller missing on host. {{(pid=74630) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.host [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] CPU controller found on host. {{(pid=74630) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74630) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T03:16:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T03:16:35Z,direct_url=<?>,disk_format='qcow2',id=8519fea8-ccda-4565-9023-82b90e4bb746,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='353df6cf0134444f8bcf2604c1eceaa8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T03:16:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Flavor limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Image limits 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Flavor pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Image pref 0:0:0 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Got 1 possible topologies {{(pid=74630) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.hardware [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74630) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T04:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-380078743',display_name='tempest-SnapshotDataIntegrityTests-server-380078743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-380078743',id=53,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuCxyICn2Giy100uPegS85k584+LNNI8zvC4T7eQZ+kpaXQa1VKd7UmJP5slbNk/n/o5J255CzSI88kzgtCl0pQak3qlomqOFUh15JBsh36uGaD1KboUidHg0PoCHP4DA==',key_name='tempest-keypair-1504687679',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9443689a30914a1293a8bacfa9439291',ramdisk_id='',reservation_id='r-g4pxmf5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1857579661',owner_user_name='tempest-SnapshotDataIntegrityTests-1857579661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T04:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='363358deec9d432499d1b0bd6866c7cc',uuid=a794673b-c12c-451a-a741-a734d229a795,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74630) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Converting VIF {"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b7:21,bridge_name='br-int',has_traffic_filtering=True,id=1bf25c77-6063-499c-a108-969bcd5ef34f,network=Network(438c12e1-5141-4603-8cbd-a8189e1d7060),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf25c77-60') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.objects.instance [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lazy-loading 'pci_devices' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] End _get_guest_xml xml=<domain type="kvm">
Oct 26 04:18:00 user nova-compute[74630]:   <uuid>a794673b-c12c-451a-a741-a734d229a795</uuid>
Oct 26 04:18:00 user nova-compute[74630]:   <name>instance-00000035</name>
Oct 26 04:18:00 user nova-compute[74630]:   <memory>524288</memory>
Oct 26 04:18:00 user nova-compute[74630]:   <vcpu>1</vcpu>
Oct 26 04:18:00 user nova-compute[74630]:   <metadata>
Oct 26 04:18:00 user nova-compute[74630]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 04:18:00 user nova-compute[74630]:       <nova:package version="0.0.0"/>
Oct 26 04:18:00 user nova-compute[74630]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-380078743</nova:name>
Oct 26 04:18:00 user nova-compute[74630]:       <nova:creationTime>2023-10-26 04:18:00</nova:creationTime>
Oct 26 04:18:00 user nova-compute[74630]:       <nova:flavor name="m1.tiny">
Oct 26 04:18:00 user nova-compute[74630]:         <nova:memory>512</nova:memory>
Oct 26 04:18:00 user nova-compute[74630]:         <nova:disk>1</nova:disk>
Oct 26 04:18:00 user nova-compute[74630]:         <nova:swap>0</nova:swap>
Oct 26 04:18:00 user nova-compute[74630]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 04:18:00 user nova-compute[74630]:         <nova:vcpus>1</nova:vcpus>
Oct 26 04:18:00 user nova-compute[74630]:       </nova:flavor>
Oct 26 04:18:00 user nova-compute[74630]:       <nova:owner>
Oct 26 04:18:00 user nova-compute[74630]:         <nova:user uuid="363358deec9d432499d1b0bd6866c7cc">tempest-SnapshotDataIntegrityTests-1857579661-project-member</nova:user>
Oct 26 04:18:00 user nova-compute[74630]:         <nova:project uuid="9443689a30914a1293a8bacfa9439291">tempest-SnapshotDataIntegrityTests-1857579661</nova:project>
Oct 26 04:18:00 user nova-compute[74630]:       </nova:owner>
Oct 26 04:18:00 user nova-compute[74630]:       <nova:root type="image" uuid="8519fea8-ccda-4565-9023-82b90e4bb746"/>
Oct 26 04:18:00 user nova-compute[74630]:       <nova:ports>
Oct 26 04:18:00 user nova-compute[74630]:         <nova:port uuid="1bf25c77-6063-499c-a108-969bcd5ef34f">
Oct 26 04:18:00 user nova-compute[74630]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 04:18:00 user nova-compute[74630]:         </nova:port>
Oct 26 04:18:00 user nova-compute[74630]:       </nova:ports>
Oct 26 04:18:00 user nova-compute[74630]:     </nova:instance>
Oct 26 04:18:00 user nova-compute[74630]:   </metadata>
Oct 26 04:18:00 user nova-compute[74630]:   <sysinfo type="smbios">
Oct 26 04:18:00 user nova-compute[74630]:     <system>
Oct 26 04:18:00 user nova-compute[74630]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 04:18:00 user nova-compute[74630]:       <entry name="product">OpenStack Nova</entry>
Oct 26 04:18:00 user nova-compute[74630]:       <entry name="version">0.0.0</entry>
Oct 26 04:18:00 user nova-compute[74630]:       <entry name="serial">a794673b-c12c-451a-a741-a734d229a795</entry>
Oct 26 04:18:00 user nova-compute[74630]:       <entry name="uuid">a794673b-c12c-451a-a741-a734d229a795</entry>
Oct 26 04:18:00 user nova-compute[74630]:       <entry name="family">Virtual Machine</entry>
Oct 26 04:18:00 user nova-compute[74630]:     </system>
Oct 26 04:18:00 user nova-compute[74630]:   </sysinfo>
Oct 26 04:18:00 user nova-compute[74630]:   <os>
Oct 26 04:18:00 user nova-compute[74630]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 04:18:00 user nova-compute[74630]:     <boot dev="hd"/>
Oct 26 04:18:00 user nova-compute[74630]:     <smbios mode="sysinfo"/>
Oct 26 04:18:00 user nova-compute[74630]:   </os>
Oct 26 04:18:00 user nova-compute[74630]:   <features>
Oct 26 04:18:00 user nova-compute[74630]:     <acpi/>
Oct 26 04:18:00 user nova-compute[74630]:     <apic/>
Oct 26 04:18:00 user nova-compute[74630]:     <vmcoreinfo/>
Oct 26 04:18:00 user nova-compute[74630]:   </features>
Oct 26 04:18:00 user nova-compute[74630]:   <clock offset="utc">
Oct 26 04:18:00 user nova-compute[74630]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 04:18:00 user nova-compute[74630]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 04:18:00 user nova-compute[74630]:     <timer name="hpet" present="no"/>
Oct 26 04:18:00 user nova-compute[74630]:   </clock>
Oct 26 04:18:00 user nova-compute[74630]:   <cpu mode="custom" match="exact">
Oct 26 04:18:00 user nova-compute[74630]:     <model>Nehalem</model>
Oct 26 04:18:00 user nova-compute[74630]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 04:18:00 user nova-compute[74630]:   </cpu>
Oct 26 04:18:00 user nova-compute[74630]:   <devices>
Oct 26 04:18:00 user nova-compute[74630]:     <disk type="file" device="disk">
Oct 26 04:18:00 user nova-compute[74630]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 04:18:00 user nova-compute[74630]:       <source file="/opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk"/>
Oct 26 04:18:00 user nova-compute[74630]:       <target dev="vda" bus="virtio"/>
Oct 26 04:18:00 user nova-compute[74630]:     </disk>
Oct 26 04:18:00 user nova-compute[74630]:     <interface type="ethernet">
Oct 26 04:18:00 user nova-compute[74630]:       <mac address="fa:16:3e:a8:b7:21"/>
Oct 26 04:18:00 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 04:18:00 user nova-compute[74630]:       <mtu size="1442"/>
Oct 26 04:18:00 user nova-compute[74630]:       <target dev="tap1bf25c77-60"/>
Oct 26 04:18:00 user nova-compute[74630]:     </interface>
Oct 26 04:18:00 user nova-compute[74630]:     <serial type="pty">
Oct 26 04:18:00 user nova-compute[74630]:       <log file="/opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/console.log" append="off"/>
Oct 26 04:18:00 user nova-compute[74630]:     </serial>
Oct 26 04:18:00 user nova-compute[74630]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 04:18:00 user nova-compute[74630]:     <video>
Oct 26 04:18:00 user nova-compute[74630]:       <model type="virtio"/>
Oct 26 04:18:00 user nova-compute[74630]:     </video>
Oct 26 04:18:00 user nova-compute[74630]:     <rng model="virtio">
Oct 26 04:18:00 user nova-compute[74630]:       <backend model="random">/dev/urandom</backend>
Oct 26 04:18:00 user nova-compute[74630]:     </rng>
Oct 26 04:18:00 user nova-compute[74630]:     <controller type="usb" index="0" model="none"/>
Oct 26 04:18:00 user nova-compute[74630]:     <memballoon model="virtio">
Oct 26 04:18:00 user nova-compute[74630]:       <stats period="10"/>
Oct 26 04:18:00 user nova-compute[74630]:     </memballoon>
Oct 26 04:18:00 user nova-compute[74630]:   </devices>
Oct 26 04:18:00 user nova-compute[74630]: </domain>
Oct 26 04:18:00 user nova-compute[74630]:  {{(pid=74630) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T04:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-380078743',display_name='tempest-SnapshotDataIntegrityTests-server-380078743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-380078743',id=53,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuCxyICn2Giy100uPegS85k584+LNNI8zvC4T7eQZ+kpaXQa1VKd7UmJP5slbNk/n/o5J255CzSI88kzgtCl0pQak3qlomqOFUh15JBsh36uGaD1KboUidHg0PoCHP4DA==',key_name='tempest-keypair-1504687679',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9443689a30914a1293a8bacfa9439291',ramdisk_id='',reservation_id='r-g4pxmf5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1857579661',owner_user_name='tempest-SnapshotDataIntegrityTests-1857579661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T04:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='363358deec9d432499d1b0bd6866c7cc',uuid=a794673b-c12c-451a-a741-a734d229a795,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Converting VIF {"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b7:21,bridge_name='br-int',has_traffic_filtering=True,id=1bf25c77-6063-499c-a108-969bcd5ef34f,network=Network(438c12e1-5141-4603-8cbd-a8189e1d7060),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf25c77-60') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG os_vif [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b7:21,bridge_name='br-int',has_traffic_filtering=True,id=1bf25c77-6063-499c-a108-969bcd5ef34f,network=Network(438c12e1-5141-4603-8cbd-a8189e1d7060),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf25c77-60') {{(pid=74630) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e83c41d3-a4b5-587a-b0ae-de6fe8193fe7', '_type': 'linux-noop'}}, row=False) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bf25c77-60, may_exist=True, interface_attrs={}) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bf25c77-60, col_values=(('qos', UUID('2187ada9-3cf8-4ec6-83d9-1c248408a748')),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bf25c77-60, col_values=(('external_ids', {'iface-id': '1bf25c77-6063-499c-a108-969bcd5ef34f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:b7:21', 'vm-uuid': 'a794673b-c12c-451a-a741-a734d229a795'}),), if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:00 user nova-compute[74630]: INFO os_vif [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:b7:21,bridge_name='br-int',has_traffic_filtering=True,id=1bf25c77-6063-499c-a108-969bcd5ef34f,network=Network(438c12e1-5141-4603-8cbd-a8189e1d7060),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf25c77-60')
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:18:00 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] No VIF found with MAC fa:16:3e:a8:b7:21, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 04:18:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-4b954134-4527-4329-8a60-c6ef1277c2c5 req-6632c5b7-2bf3-4d08-b694-8f4a6867c498 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Updated VIF entry in instance network info cache for port 1bf25c77-6063-499c-a108-969bcd5ef34f. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:18:01 user nova-compute[74630]: DEBUG nova.network.neutron [req-4b954134-4527-4329-8a60-c6ef1277c2c5 req-6632c5b7-2bf3-4d08-b694-8f4a6867c498 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating instance_info_cache with network_info: [{"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:18:01 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-4b954134-4527-4329-8a60-c6ef1277c2c5 req-6632c5b7-2bf3-4d08-b694-8f4a6867c498 service nova] Releasing lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:18:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-1fb3e049-1b14-4300-9534-c2ed2dda3596 req-8f3793b5-028b-4eb3-95ec-3cbaa1ae4cb9 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Received event network-vif-plugged-1bf25c77-6063-499c-a108-969bcd5ef34f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:18:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1fb3e049-1b14-4300-9534-c2ed2dda3596 req-8f3793b5-028b-4eb3-95ec-3cbaa1ae4cb9 service nova] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:18:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1fb3e049-1b14-4300-9534-c2ed2dda3596 req-8f3793b5-028b-4eb3-95ec-3cbaa1ae4cb9 service nova] Lock "a794673b-c12c-451a-a741-a734d229a795-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:18:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-1fb3e049-1b14-4300-9534-c2ed2dda3596 req-8f3793b5-028b-4eb3-95ec-3cbaa1ae4cb9 service nova] Lock "a794673b-c12c-451a-a741-a734d229a795-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:18:02 user nova-compute[74630]: DEBUG nova.compute.manager [req-1fb3e049-1b14-4300-9534-c2ed2dda3596 req-8f3793b5-028b-4eb3-95ec-3cbaa1ae4cb9 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] No waiting events found dispatching network-vif-plugged-1bf25c77-6063-499c-a108-969bcd5ef34f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:18:02 user nova-compute[74630]: WARNING nova.compute.manager [req-1fb3e049-1b14-4300-9534-c2ed2dda3596 req-8f3793b5-028b-4eb3-95ec-3cbaa1ae4cb9 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Received unexpected event network-vif-plugged-1bf25c77-6063-499c-a108-969bcd5ef34f for instance with vm_state building and task_state spawning.
Oct 26 04:18:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:03 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-c7158757-fa5a-4fbb-a728-0da55671cac9 req-9077fc22-9e40-4ecb-8390-c20a706e04a4 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Received event network-vif-plugged-1bf25c77-6063-499c-a108-969bcd5ef34f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:18:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c7158757-fa5a-4fbb-a728-0da55671cac9 req-9077fc22-9e40-4ecb-8390-c20a706e04a4 service nova] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:18:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c7158757-fa5a-4fbb-a728-0da55671cac9 req-9077fc22-9e40-4ecb-8390-c20a706e04a4 service nova] Lock "a794673b-c12c-451a-a741-a734d229a795-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:18:04 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-c7158757-fa5a-4fbb-a728-0da55671cac9 req-9077fc22-9e40-4ecb-8390-c20a706e04a4 service nova] Lock "a794673b-c12c-451a-a741-a734d229a795-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:18:04 user nova-compute[74630]: DEBUG nova.compute.manager [req-c7158757-fa5a-4fbb-a728-0da55671cac9 req-9077fc22-9e40-4ecb-8390-c20a706e04a4 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] No waiting events found dispatching network-vif-plugged-1bf25c77-6063-499c-a108-969bcd5ef34f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:18:04 user nova-compute[74630]: WARNING nova.compute.manager [req-c7158757-fa5a-4fbb-a728-0da55671cac9 req-9077fc22-9e40-4ecb-8390-c20a706e04a4 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Received unexpected event network-vif-plugged-1bf25c77-6063-499c-a108-969bcd5ef34f for instance with vm_state building and task_state spawning.
Oct 26 04:18:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:04 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Instance event wait completed in 0 seconds for  {{(pid=74630) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 04:18:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Guest created on hypervisor {{(pid=74630) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 04:18:04 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: a794673b-c12c-451a-a741-a734d229a795] Instance spawned successfully.
Oct 26 04:18:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 04:18:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Found default for hw_cdrom_bus of ide {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:18:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Found default for hw_disk_bus of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:18:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Found default for hw_input_bus of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:18:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Found default for hw_pointer_model of None {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:18:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Found default for hw_video_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:18:04 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Found default for hw_vif_model of virtio {{(pid=74630) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 04:18:04 user nova-compute[74630]: INFO nova.compute.manager [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Took 6.38 seconds to spawn the instance on the hypervisor.
Oct 26 04:18:04 user nova-compute[74630]: DEBUG nova.compute.manager [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Checking state {{(pid=74630) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 04:18:05 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:18:05 user nova-compute[74630]: INFO nova.compute.manager [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Took 7.01 seconds to build instance.
Oct 26 04:18:05 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-e02f6f73-0d00-4e58-adb9-3c7441e5c13f tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.142s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:18:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:18:07 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:18:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:18:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:13 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:18:13 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:18:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:18:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:18:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:18:13 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:18:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:18:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:18:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:18:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:18:14 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:18:14 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:18:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8707MB free_disk=24.922565460205078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:18:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:18:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:18:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance a794673b-c12c-451a-a741-a734d229a795 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:18:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:18:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:18:14 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing inventories for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 04:18:14 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating ProviderTree inventory for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 04:18:14 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating inventory in ProviderTree for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 04:18:14 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing aggregate associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, aggregates: None {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 04:18:14 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing trait associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, traits: HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 04:18:14 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:18:14 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:18:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:18:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.396s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:18:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:18:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:18:17 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:18:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:18:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:18:17 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:18:17 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:18:18 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating instance_info_cache with network_info: [{"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:18:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:18:18 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:18:18 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:18:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:18:24 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:18:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:29 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:18:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:18:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:18:56 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:19:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:19:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:19:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:19:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:19:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:19:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:19:10 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:19:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:19:13 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:19:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:19:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:19:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:19:13 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:19:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:19:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:19:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:19:13 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:19:13 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:19:13 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:19:13 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=24.88339614868164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:19:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:19:13 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:19:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance a794673b-c12c-451a-a741-a734d229a795 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:19:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:19:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:19:14 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:19:14 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:19:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:19:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:19:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:19:16 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:19:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:19:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:19:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:19:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:19:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:19:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:19:19 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:19:19 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:19:19 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating instance_info_cache with network_info: [{"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:19:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:19:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:19:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:19:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:19:26 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:19:26 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:19:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:19:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:19:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:19:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:19:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-7e069cee-36f1-48f8-9059-42fda655d5a8 req-de6e53fe-46e4-4876-9c3d-1cc1975035b1 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Received event network-changed-1bf25c77-6063-499c-a108-969bcd5ef34f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:19:49 user nova-compute[74630]: DEBUG nova.compute.manager [req-7e069cee-36f1-48f8-9059-42fda655d5a8 req-de6e53fe-46e4-4876-9c3d-1cc1975035b1 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Refreshing instance network info cache due to event network-changed-1bf25c77-6063-499c-a108-969bcd5ef34f. {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 04:19:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7e069cee-36f1-48f8-9059-42fda655d5a8 req-de6e53fe-46e4-4876-9c3d-1cc1975035b1 service nova] Acquiring lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:19:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7e069cee-36f1-48f8-9059-42fda655d5a8 req-de6e53fe-46e4-4876-9c3d-1cc1975035b1 service nova] Acquired lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:19:49 user nova-compute[74630]: DEBUG nova.network.neutron [req-7e069cee-36f1-48f8-9059-42fda655d5a8 req-de6e53fe-46e4-4876-9c3d-1cc1975035b1 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Refreshing network info cache for port 1bf25c77-6063-499c-a108-969bcd5ef34f {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 04:19:49 user nova-compute[74630]: DEBUG nova.network.neutron [req-7e069cee-36f1-48f8-9059-42fda655d5a8 req-de6e53fe-46e4-4876-9c3d-1cc1975035b1 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Updated VIF entry in instance network info cache for port 1bf25c77-6063-499c-a108-969bcd5ef34f. {{(pid=74630) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 04:19:49 user nova-compute[74630]: DEBUG nova.network.neutron [req-7e069cee-36f1-48f8-9059-42fda655d5a8 req-de6e53fe-46e4-4876-9c3d-1cc1975035b1 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating instance_info_cache with network_info: [{"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:19:49 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-7e069cee-36f1-48f8-9059-42fda655d5a8 req-de6e53fe-46e4-4876-9c3d-1cc1975035b1 service nova] Releasing lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:19:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:19:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:19:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:19:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:19:57 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:19:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG nova.objects.instance [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lazy-loading 'flavor' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:20:02 user nova-compute[74630]: INFO nova.compute.manager [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Attaching volume 4a3a2fe9-bec7-4f34-b4df-47793822c02e to /dev/vdb
Oct 26 04:20:02 user nova-compute[74630]: DEBUG os_brick.utils [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8315146-9bd1-4922-a059-3159c6989e8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcd6a26-91b2-4f8f-8149-cf9d92990dc6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9359850-769b-4a4c-b6d4-c07c76d05341]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[38501901-1966-45e8-a961-3caa9d0e473d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:20:02 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 04:20:02 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fbca06-0414-45b4-9da4-f45260db0d61]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG os_brick.utils [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:20:02 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating existing volume attachment record: 9b20383c-0574-44bc-aff1-0d55846f6900 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 04:20:04 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:20:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:20:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:20:10 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:20:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:20:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:20:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:20:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:20:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:20:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:20:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:14 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:20:14 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:20:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8936MB free_disk=24.88064193725586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:20:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:20:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:20:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance a794673b-c12c-451a-a741-a734d229a795 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:20:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:20:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:20:15 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:20:15 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:20:15 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:20:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:20:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:20:18 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:20:18 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating instance_info_cache with network_info: [{"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXxbgdoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:20:19 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:20:19 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:20:19 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92be506-f8aa-4564-9745-ae651948d83f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 04:20:19 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19d29a6-1084-4504-b460-ba3484580263]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e] added
Oct 26 04:20:19 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2979e8-3b01-431e-ae40-8f1b24fa05c3]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a523d3-fb42-4992-91d1-ea613ab23e14]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXxbgdoe {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXxbgdoe" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8557af49-e6f6-4161-9c10-ad7a694b34d8]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vXxbgdoe'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[858395b0-0ccb-4039-a6ea-d8e9ad344cd8]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8630b6-9ef7-49c3-b32e-8d00d5d2c9f8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:20:19 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:20:19 user nova-compute[74630]:  {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:20:19 user nova-compute[74630]: WARNING os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 04:20:19 user nova-compute[74630]: 
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2feae4b-d21d-4552-b960-f390adca53d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e, portal: 172.16.0.220,3260]
Oct 26 04:20:19 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e, portal: 172.16.0.220,3260] successful.
Oct 26 04:20:19 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08f0e2e-b590-4342-b120-349f708f186f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4fb683-1fe1-458e-83c9-97b50672678e]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e (non-flash)
Oct 26 04:20:19 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e (non-flash)
Oct 26 04:20:19 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fb1b7c-e106-4cad-834d-db53b24c82f4]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:20:19 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXxbgdoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 04:20:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:20:20 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23332646634363265', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:20:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332646634363265', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 04:20:20 user nova-compute[74630]: DEBUG nova.objects.instance [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lazy-loading 'flavor' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:20:20 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 04:20:20 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:20:20 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:20:20 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:20:20 user nova-compute[74630]:   <serial>4a3a2fe9-bec7-4f34-b4df-47793822c02e</serial>
Oct 26 04:20:20 user nova-compute[74630]: </disk>
Oct 26 04:20:20 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 04:20:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:20:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:20:21 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] No VIF found with MAC fa:16:3e:a8:b7:21, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 04:20:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-d7cad3cd-04f6-43b5-beee-a29ffcf29e37 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.057s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:20:24 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:26 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:20:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:20:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:20:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:20:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:20:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:20:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:44 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:20:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:20:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:20:56 user nova-compute[74630]: INFO nova.compute.manager [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Detaching volume 4a3a2fe9-bec7-4f34-b4df-47793822c02e
Oct 26 04:20:56 user nova-compute[74630]: INFO nova.virt.block_device [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Attempting to driver detach volume 4a3a2fe9-bec7-4f34-b4df-47793822c02e from mountpoint /dev/vdb
Oct 26 04:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Attempting to detach device vdb from instance a794673b-c12c-451a-a741-a734d229a795 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 04:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:20:56 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:20:56 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:20:56 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:20:56 user nova-compute[74630]:   <serial>4a3a2fe9-bec7-4f34-b4df-47793822c02e</serial>
Oct 26 04:20:56 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:20:56 user nova-compute[74630]: </disk>
Oct 26 04:20:56 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:20:56 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Successfully detached device vdb from instance a794673b-c12c-451a-a741-a734d229a795 from the persistent domain config.
Oct 26 04:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a794673b-c12c-451a-a741-a734d229a795 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 04:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:20:56 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:20:56 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:20:56 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:20:56 user nova-compute[74630]:   <serial>4a3a2fe9-bec7-4f34-b4df-47793822c02e</serial>
Oct 26 04:20:56 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:20:56 user nova-compute[74630]: </disk>
Oct 26 04:20:56 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:20:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 04:20:59 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:21:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:21:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:21:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:21:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:21:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:21:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:21:12 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:21:14 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:21:14 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:21:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=24.879302978515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance a794673b-c12c-451a-a741-a734d229a795 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:21:14 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:21:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:21:16 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a794673b-c12c-451a-a741-a734d229a795 is timed out.
Oct 26 04:21:16 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Successfully detached device vdb from instance a794673b-c12c-451a-a741-a734d229a795 from the live domain config.
Oct 26 04:21:16 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXxbgdoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:21:16 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4171c5dd-1661-4b6f-b872-1fad5a139075]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 04:21:16 user nova-compute[74630]: No targets found.
Oct 26 04:21:16 user nova-compute[74630]: iSNS:
Oct 26 04:21:16 user nova-compute[74630]: No targets found.
Oct 26 04:21:16 user nova-compute[74630]: STATIC:
Oct 26 04:21:16 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e
Oct 26 04:21:16 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:21:16 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:21:16 user nova-compute[74630]: FIRMWARE:
Oct 26 04:21:16 user nova-compute[74630]: No targets found.
Oct 26 04:21:16 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 04:21:16 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 04:21:16 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[233aef06-6735-4f1f-86d3-f7bf823af16b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f9c617-2d4d-4bdc-bd51-7aae5554ed73]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e (non-flash)
Oct 26 04:21:16 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e (non-flash)
Oct 26 04:21:16 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f31841981f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[766aa136-1f31-44c4-bbf2-e1691b5d474a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ed189f-e2d6-405c-ada8-080bfb0f8f90]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b21538-a6d6-4a1f-9881-39ded543f96f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[59831dbc-9e6c-4a74-85ed-2ebc7bbe30bf]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a92bd7-fb7e-4970-8521-1b0f8502a3ad]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc804d3-1272-4d2b-81bd-f4d5d282c063]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e, portal: 172.16.0.220,3260]
Oct 26 04:21:16 user nova-compute[74630]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e, portal: 172.16.0.220,3260] successful.
Oct 26 04:21:16 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:21:16 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a3a2fe9-bec7-4f34-b4df-47793822c02e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:21:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[352b3b30-46c8-45ba-b8b6-19d82f2ed555]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:21:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:21:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:21:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] <== disconnect_volume: return (309ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:21:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 04:21:17 user nova-compute[74630]: DEBUG nova.objects.instance [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lazy-loading 'flavor' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:21:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-15aee7b6-3073-4a4a-b288-6a38c0b33c82 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.731s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:21:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:21:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:21:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:21:21 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:21:21 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:21:21 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:21:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:21:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:21:21 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:21:21 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:21:21 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating instance_info_cache with network_info: [{"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:21:21 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:21:21 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:21:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:21:26 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:21:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:21:31 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:21:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:21:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:21:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:21:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG nova.objects.instance [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lazy-loading 'flavor' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.250s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:21:51 user nova-compute[74630]: INFO nova.compute.manager [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Attaching volume 3f404960-5b53-42a2-8a43-12b54a00a210 to /dev/vdb
Oct 26 04:21:51 user nova-compute[74630]: DEBUG os_brick.utils [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfb8806-3e2f-40b0-a0bd-3dd8d761fe9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[5520cf0a-ce16-4a9e-912f-062a5314fb45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba84781-cf81-466c-859e-d45069d9db0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac488a8a-b9f8-41ae-a31d-86aa4dce94a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:21:51 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 04:21:51 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69cb640-cdcb-40a6-ba1f-bf92578195ca]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG os_brick.utils [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:21:51 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating existing volume attachment record: 8a0b5008-a13f-41c9-9f0f-89413134c1b7 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 04:21:54 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:21:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:22:00 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:22:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:22:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:22:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74630) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqeyFmnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:22:08 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:22:08 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:22:08 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a355d2b1-59c1-4ab4-b864-8b01866ec68e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 04:22:08 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98d4188-5a74-45f3-8d3f-8b6d9995f93f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210] added
Oct 26 04:22:08 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[78729dee-ede6-426d-866c-b40e8868f154]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0f5d8c-ab22-4487-a016-9db27621df0e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uqeyFmnZ {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uqeyFmnZ" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c163f2-c0fa-4148-a04a-b55f15e42c71]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uqeyFmnZ'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41bbd87-690a-4e18-84eb-d90a4359f01d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[665118ee-fa85-41ce-a758-c01380f13c85]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:22:08 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:22:08 user nova-compute[74630]:  {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:22:08 user nova-compute[74630]: WARNING os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 04:22:08 user nova-compute[74630]: 
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1045cdd4-17e6-4aad-985b-bb7fecbe1ac5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210, portal: 172.16.0.220,3260]
Oct 26 04:22:08 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210, portal: 172.16.0.220,3260] successful.
Oct 26 04:22:08 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abf3c34-fdf0-439d-91f5-c6d7afb17782]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2b69c4-73ce-4944-9c9e-2495d4d3afa4]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 (non-flash)
Oct 26 04:22:08 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 (non-flash)
Oct 26 04:22:08 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2992a543-5ac0-4bde-90c4-da0afe2aade4]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:08 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:22:09 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:22:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqeyFmnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 04:22:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:22:09 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23935663236643464', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:22:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935663236643464', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 04:22:09 user nova-compute[74630]: DEBUG nova.objects.instance [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lazy-loading 'flavor' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:22:09 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 04:22:09 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:22:09 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:22:09 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:22:09 user nova-compute[74630]:   <serial>3f404960-5b53-42a2-8a43-12b54a00a210</serial>
Oct 26 04:22:09 user nova-compute[74630]: </disk>
Oct 26 04:22:09 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 04:22:10 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:22:10 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:22:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:22:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:22:10 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] No VIF found with MAC fa:16:3e:a8:b7:21, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 04:22:10 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-29b51964-f53c-4993-b5fd-e431bda7364c tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.658s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:22:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:22:12 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:22:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:22:12 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:22:12 user nova-compute[74630]: INFO nova.compute.manager [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Detaching volume 3f404960-5b53-42a2-8a43-12b54a00a210
Oct 26 04:22:12 user nova-compute[74630]: INFO nova.virt.block_device [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Attempting to driver detach volume 3f404960-5b53-42a2-8a43-12b54a00a210 from mountpoint /dev/vdb
Oct 26 04:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Attempting to detach device vdb from instance a794673b-c12c-451a-a741-a734d229a795 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 04:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:22:12 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:22:12 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:22:12 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:22:12 user nova-compute[74630]:   <serial>3f404960-5b53-42a2-8a43-12b54a00a210</serial>
Oct 26 04:22:12 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:22:12 user nova-compute[74630]: </disk>
Oct 26 04:22:12 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:22:12 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Successfully detached device vdb from instance a794673b-c12c-451a-a741-a734d229a795 from the persistent domain config.
Oct 26 04:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a794673b-c12c-451a-a741-a734d229a795 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 04:22:12 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:22:12 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:22:12 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:22:12 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:22:12 user nova-compute[74630]:   <serial>3f404960-5b53-42a2-8a43-12b54a00a210</serial>
Oct 26 04:22:12 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:22:12 user nova-compute[74630]: </disk>
Oct 26 04:22:12 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:22:13 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 04:22:14 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:22:15 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:22:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:22:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:22:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:22:15 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:22:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:15 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:15 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:22:15 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:22:15 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=24.870513916015625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:22:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:22:15 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:22:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:22:15 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance a794673b-c12c-451a-a741-a734d229a795 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:22:15 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:22:15 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:22:16 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:22:16 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:22:16 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:22:16 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:22:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:22:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:22:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:22:22 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:22:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:22:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:22:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:22:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:22:22 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:22:22 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:22:22 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating instance_info_cache with network_info: [{"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:22:22 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:22:22 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:22:22 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:22:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:22:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:22:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:22:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:22:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:22:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:22:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:22:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:22:33 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a794673b-c12c-451a-a741-a734d229a795 is timed out.
Oct 26 04:22:33 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Successfully detached device vdb from instance a794673b-c12c-451a-a741-a734d229a795 from the live domain config.
Oct 26 04:22:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqeyFmnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:22:33 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d14ad5-30a1-4357-85dd-2dd5bf35892c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 04:22:33 user nova-compute[74630]: No targets found.
Oct 26 04:22:33 user nova-compute[74630]: iSNS:
Oct 26 04:22:33 user nova-compute[74630]: No targets found.
Oct 26 04:22:33 user nova-compute[74630]: STATIC:
Oct 26 04:22:33 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210
Oct 26 04:22:33 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:22:33 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:22:33 user nova-compute[74630]: FIRMWARE:
Oct 26 04:22:33 user nova-compute[74630]: No targets found.
Oct 26 04:22:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 04:22:33 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 04:22:33 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[3229fb88-d00d-490d-8f9c-52d207bcc569]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f90561-01f4-41d2-be85-f30687a84bd2]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 (non-flash)
Oct 26 04:22:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 (non-flash)
Oct 26 04:22:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f317c1cae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2d9786-827f-4a17-b757-ecd1fdb08cec]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4620c556-da1b-4b10-b453-0c16a8acb5fb]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ea14fd-ee80-4fe3-8f63-7783bf307f22]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a27c52-5442-4735-8173-5d6378d73df8]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6090fe-bfce-4820-9af2-37fc251d56d0]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6516acb6-6294-456b-9f2a-4e9f2ab488d1]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210, portal: 172.16.0.220,3260]
Oct 26 04:22:33 user nova-compute[74630]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210, portal: 172.16.0.220,3260] successful.
Oct 26 04:22:33 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f404960-5b53-42a2-8a43-12b54a00a210 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[1427288b-8e7d-4320-a62e-3e79b85879d4]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] <== disconnect_volume: return (310ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:22:33 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 04:22:34 user nova-compute[74630]: DEBUG nova.objects.instance [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lazy-loading 'flavor' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:22:34 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-ae014f2d-351f-49ba-a3fa-488f3c6f7cfb tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.736s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:22:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:22:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:22:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 04:22:36 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] There are 0 instances to clean {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 04:22:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:22:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:22:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:22:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:22:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:22:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:22:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:22:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:22:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:23:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:23:01 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:23:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:23:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:23:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:23:07 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:23:07 user nova-compute[74630]: DEBUG nova.objects.instance [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lazy-loading 'flavor' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:23:08 user nova-compute[74630]: INFO nova.compute.manager [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Attaching volume a5b65718-8b2b-414b-bab3-247fdeb060f9 to /dev/vdb
Oct 26 04:23:08 user nova-compute[74630]: DEBUG os_brick.utils [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e8d181-dbc5-4063-a74c-50e6c0096b81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e269591c-a063-4bc1-badf-c71f43e9302e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e942aa-0da4-4ceb-8be4-f1aaef604ed9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2636106-840b-4e53-9383-bc5ffa7d4de3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:23:08 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 04:23:08 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[78010dc0-cb62-49de-9d41-ba49a00015fd]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG os_brick.utils [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:23:08 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating existing volume attachment record: a6e771f3-4819-4e26-a0b9-df84fba54794 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 04:23:09 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:23:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:23:11 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:23:11 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:23:12 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:23:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:23:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:23:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:17 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:23:17 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:23:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8983MB free_disk=24.869686126708984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:23:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:23:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance a794673b-c12c-451a-a741-a734d229a795 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:23:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:23:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:23:18 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing inventories for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 04:23:18 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating ProviderTree inventory for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 04:23:18 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Updating inventory in ProviderTree for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 04:23:18 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing aggregate associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, aggregates: None {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 04:23:18 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Refreshing trait associations for resource provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5, traits: HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE {{(pid=74630) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 04:23:18 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:23:18 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:23:18 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:23:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:23:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:23:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:23:21 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:23:24 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:23:24 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:23:24 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:23:24 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:23:24 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:23:24 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating instance_info_cache with network_info: [{"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:23:24 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:23:24 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:23:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:23:28 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:23:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqwDpgLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:23:34 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:23:34 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:23:34 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ced4b67-752a-47ad-a2d9-67fb55523b78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 04:23:34 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b200a1-414c-45d9-bc97-d4fc8c0f9429]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9] added
Oct 26 04:23:34 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fe02a8-a13c-44ea-9ddf-7b6e8574b024]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e741095-725e-4a89-a80c-fb95adf04f65]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqwDpgLV {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kqwDpgLV" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40302d5-adaf-4936-a7a7-fe3a2add4b2e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kqwDpgLV'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdce3656-38f8-439d-b989-27de442f152a]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6658a3-f560-4b88-b782-0483097ddcc1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:23:34 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:23:34 user nova-compute[74630]:  {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:23:34 user nova-compute[74630]: WARNING os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 04:23:34 user nova-compute[74630]: 
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[231a0aee-5eb1-41e6-950c-0e8db3642ec0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9, portal: 172.16.0.220,3260]
Oct 26 04:23:34 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9, portal: 172.16.0.220,3260] successful.
Oct 26 04:23:34 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4691b416-4b5a-499f-bfd2-01b1899f5102]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38df756-3602-4f68-9a83-24f9e32cff45]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 (non-flash)
Oct 26 04:23:34 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 (non-flash)
Oct 26 04:23:34 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c9258a-3c55-4c5d-a83d-50c46568cfda]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:34 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:23:35 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:23:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqwDpgLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 04:23:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:23:35 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26637333834643866', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:23:35 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637333834643866', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 04:23:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:23:35 user nova-compute[74630]: DEBUG nova.objects.instance [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lazy-loading 'flavor' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:23:35 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 04:23:35 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:23:35 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:23:35 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:23:35 user nova-compute[74630]:   <serial>a5b65718-8b2b-414b-bab3-247fdeb060f9</serial>
Oct 26 04:23:35 user nova-compute[74630]: </disk>
Oct 26 04:23:35 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 04:23:36 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:23:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:23:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:23:36 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] No VIF found with MAC fa:16:3e:a8:b7:21, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 04:23:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-8f4fa742-e00c-4946-b4a8-bada13d7db5a tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.398s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:23:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:23:38 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:23:38 user nova-compute[74630]: INFO nova.compute.manager [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Detaching volume a5b65718-8b2b-414b-bab3-247fdeb060f9
Oct 26 04:23:38 user nova-compute[74630]: INFO nova.virt.block_device [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Attempting to driver detach volume a5b65718-8b2b-414b-bab3-247fdeb060f9 from mountpoint /dev/vdb
Oct 26 04:23:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Attempting to detach device vdb from instance a794673b-c12c-451a-a741-a734d229a795 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 04:23:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:23:38 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:23:38 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:23:38 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:23:38 user nova-compute[74630]:   <serial>a5b65718-8b2b-414b-bab3-247fdeb060f9</serial>
Oct 26 04:23:38 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:23:38 user nova-compute[74630]: </disk>
Oct 26 04:23:38 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:23:38 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Successfully detached device vdb from instance a794673b-c12c-451a-a741-a734d229a795 from the persistent domain config.
Oct 26 04:23:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a794673b-c12c-451a-a741-a734d229a795 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 04:23:38 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:23:38 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:23:38 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:23:38 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:23:38 user nova-compute[74630]:   <serial>a5b65718-8b2b-414b-bab3-247fdeb060f9</serial>
Oct 26 04:23:38 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:23:38 user nova-compute[74630]: </disk>
Oct 26 04:23:38 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:23:39 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 04:23:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:23:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:23:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:23:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:23:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:23:59 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a794673b-c12c-451a-a741-a734d229a795 is timed out.
Oct 26 04:23:59 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Successfully detached device vdb from instance a794673b-c12c-451a-a741-a734d229a795 from the live domain config.
Oct 26 04:23:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kqwDpgLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:23:59 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0643b8-728f-4819-a888-13717b99c016]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 04:23:59 user nova-compute[74630]: No targets found.
Oct 26 04:23:59 user nova-compute[74630]: iSNS:
Oct 26 04:23:59 user nova-compute[74630]: No targets found.
Oct 26 04:23:59 user nova-compute[74630]: STATIC:
Oct 26 04:23:59 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9
Oct 26 04:23:59 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:23:59 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:23:59 user nova-compute[74630]: FIRMWARE:
Oct 26 04:23:59 user nova-compute[74630]: No targets found.
Oct 26 04:23:59 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 04:23:59 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 04:23:59 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda5b7b4-732c-4daa-b126-05ef7c3c2677]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3a8b11-0fa0-4d9c-85ec-0d244d00806a]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 (non-flash)
Oct 26 04:23:59 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 (non-flash)
Oct 26 04:23:59 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f315c792b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[31382645-6126-4f12-97ea-747abe481fd5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c68922-b2ac-4bae-a734-5dcc02a439e4]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeffae2-f590-4f5f-bfae-8335d3f40c9e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b262358-e59f-4ba4-9ba8-54deab7c9b0b]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6f959c-eef8-4a71-8553-0f6b865270ad]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fa5333-6c7a-475c-b10c-10e6e70ec9e0]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9, portal: 172.16.0.220,3260]
Oct 26 04:23:59 user nova-compute[74630]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9, portal: 172.16.0.220,3260] successful.
Oct 26 04:23:59 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5b65718-8b2b-414b-bab3-247fdeb060f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[109f0b3c-d75d-42e1-876d-532bb2a3aa0f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] <== disconnect_volume: return (297ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:23:59 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 04:24:00 user nova-compute[74630]: DEBUG nova.objects.instance [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lazy-loading 'flavor' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:24:00 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fa688001-89f5-423e-bec3-5715cd133d4d tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.730s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:24:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:24:03 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:24:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:24:07 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:24:10 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:24:13 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:24:13 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:24:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:24:15 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:24:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:24:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:24:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:24:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:24:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:24:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:17 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:24:17 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:24:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8957MB free_disk=24.86882781982422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:24:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:24:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:24:18 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance a794673b-c12c-451a-a741-a734d229a795 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:24:18 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:24:18 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:24:18 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:24:18 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:24:18 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:24:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:24:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:24:20 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:24:23 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:24:25 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:24:26 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:24:26 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:24:26 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:24:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:24:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:24:26 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:24:26 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:24:26 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating instance_info_cache with network_info: [{"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:24:26 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:24:26 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:24:29 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:24:30 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:24:34 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:24:35 user nova-compute[74630]: DEBUG nova.objects.instance [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lazy-loading 'flavor' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:24:35 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:24:35 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:24:36 user nova-compute[74630]: INFO nova.compute.manager [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Attaching volume 6d8c64d8-d802-4b65-8cf6-7594c0f27120 to /dev/vdb
Oct 26 04:24:36 user nova-compute[74630]: DEBUG os_brick.utils [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1578f4-c0f2-40db-a95d-fc559fac2645]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8a7c2599fb4b\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[febab794-f642-4d2c-8425-dabe55cfd0cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0876dd6-390d-4632-bf7a-f4c538db16e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[b791c9a2-fde8-42a3-9e45-9af2d28abf21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Running cmd (subprocess): nvme version {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] 'nvme version' failed. Not Retrying. {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] nvme not present on system {{(pid=74630) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 04:24:36 user nova-compute[74630]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 04:24:36 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec99d5b9-eed3-4d60-9bf6-6e33667b2cf9]: (4, '') {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74630) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.lightos [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] LIGHTOS: no hostnqn found. {{(pid=74630) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG os_brick.utils [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8a7c2599fb4b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:24:36 user nova-compute[74630]: DEBUG nova.virt.block_device [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating existing volume attachment record: cc205e16-f8bc-4ce7-9a77-d776168a8e56 {{(pid=74630) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 04:24:39 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:24:40 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:24:45 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:24:50 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Calling os-brick to attach iSCSI Volume {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCKohmcl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:24:53 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:24:53 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:24:53 user nova-compute[74630]: INFO os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dc5a16-6482-40c0-9846-c5f3d4313a18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 04:24:53 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --interface default --op new {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[c173a914-9e1a-4545-973a-f6b1599c08e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120] added\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120] added
Oct 26 04:24:53 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb980431-b98f-49b9-91a9-ef0870c2e72d]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad9a4b0-1cd8-4bce-85fb-4925852e55c9]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bCKohmcl {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bCKohmcl" returned: 0 in 0.017s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7602b39-3b9f-4dea-bf93-74ce9fb772ce]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bCKohmcl'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a250cc-2900-47a2-bb54-1724c9f9ce6e]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[729557ac-b8cd-40fe-be2d-e3157a97e330]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:24:53 user nova-compute[74630]:  {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 04:24:53 user nova-compute[74630]:  {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:24:53 user nova-compute[74630]: WARNING os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 04:24:53 user nova-compute[74630]: 
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --login {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb84b98-114c-43b4-abe6-129e943bb8ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120, portal: 172.16.0.220,3260]
Oct 26 04:24:53 user nova-compute[74630]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120, portal: 172.16.0.220,3260] successful.
Oct 26 04:24:53 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfad0af-3c67-4450-bece-8bcb3324af64]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3df07c-bdee-4c86-9c58-82ccf2246ccd]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 (non-flash)
Oct 26 04:24:53 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 (non-flash)
Oct 26 04:24:53 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Connected to 172.16.0.220:3260 {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74630) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74630) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4ee6e7-3c30-4aba-b809-1e29c9563756]: (4, ('- - 0', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:24:53 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:24:54 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74630) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 04:24:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCKohmcl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74630) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 04:24:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:24:54 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23161656232623332', 'path': '/dev/sdb'} {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:24:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161656232623332', 'path': '/dev/sdb'} {{(pid=74630) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 04:24:54 user nova-compute[74630]: DEBUG nova.objects.instance [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lazy-loading 'flavor' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:24:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 04:24:54 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:24:54 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:24:54 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:24:54 user nova-compute[74630]:   <serial>6d8c64d8-d802-4b65-8cf6-7594c0f27120</serial>
Oct 26 04:24:54 user nova-compute[74630]: </disk>
Oct 26 04:24:54 user nova-compute[74630]:  {{(pid=74630) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 04:24:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:24:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74630) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 04:24:54 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] No VIF found with MAC fa:16:3e:a8:b7:21, not building metadata {{(pid=74630) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 04:24:54 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-fad70b6f-e9cf-4ca0-8c7a-a6e0d0955757 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.865s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:24:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:24:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:24:56 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:24:56 user nova-compute[74630]: INFO nova.compute.manager [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Detaching volume 6d8c64d8-d802-4b65-8cf6-7594c0f27120
Oct 26 04:24:56 user nova-compute[74630]: INFO nova.virt.block_device [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Attempting to driver detach volume 6d8c64d8-d802-4b65-8cf6-7594c0f27120 from mountpoint /dev/vdb
Oct 26 04:24:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Attempting to detach device vdb from instance a794673b-c12c-451a-a741-a734d229a795 from the persistent domain config. {{(pid=74630) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 04:24:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:24:56 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:24:56 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:24:56 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:24:56 user nova-compute[74630]:   <serial>6d8c64d8-d802-4b65-8cf6-7594c0f27120</serial>
Oct 26 04:24:56 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:24:56 user nova-compute[74630]: </disk>
Oct 26 04:24:56 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:24:56 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Successfully detached device vdb from instance a794673b-c12c-451a-a741-a734d229a795 from the persistent domain config.
Oct 26 04:24:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a794673b-c12c-451a-a741-a734d229a795 from the live domain config. {{(pid=74630) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 04:24:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.guest [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 04:24:56 user nova-compute[74630]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 04:24:56 user nova-compute[74630]:   <source dev="/dev/sdb"/>
Oct 26 04:24:56 user nova-compute[74630]:   <target dev="vdb" bus="virtio"/>
Oct 26 04:24:56 user nova-compute[74630]:   <serial>6d8c64d8-d802-4b65-8cf6-7594c0f27120</serial>
Oct 26 04:24:56 user nova-compute[74630]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 04:24:56 user nova-compute[74630]: </disk>
Oct 26 04:24:56 user nova-compute[74630]:  {{(pid=74630) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 04:24:57 user nova-compute[74630]: DEBUG nova.virt.libvirt.driver [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 04:24:59 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:25:00 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:25:05 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:25:05 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:25:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:25:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:25:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:25:14 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:25:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:25:16 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:25:17 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a794673b-c12c-451a-a741-a734d229a795 is timed out.
Oct 26 04:25:17 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Successfully detached device vdb from instance a794673b-c12c-451a-a741-a734d229a795 from the live domain config.
Oct 26 04:25:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] calling os-brick to detach iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f31841d2c20>, {'target_iqn': 'iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bCKohmcl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 04:25:17 user nova-compute[74630]: WARNING os_brick.initiator.connectors.base [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[243c6cd0-357b-4120-8d24-c80fbc8c3d35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 04:25:17 user nova-compute[74630]: No targets found.
Oct 26 04:25:17 user nova-compute[74630]: iSNS:
Oct 26 04:25:17 user nova-compute[74630]: No targets found.
Oct 26 04:25:17 user nova-compute[74630]: STATIC:
Oct 26 04:25:17 user nova-compute[74630]: Target: iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120
Oct 26 04:25:17 user nova-compute[74630]:         Portal: 172.16.0.220:3260,-1
Oct 26 04:25:17 user nova-compute[74630]:                 Iface Name: default
Oct 26 04:25:17 user nova-compute[74630]: FIRMWARE:
Oct 26 04:25:17 user nova-compute[74630]: No targets found.
Oct 26 04:25:17 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 04:25:17 user nova-compute[74630]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 04:25:17 user nova-compute[74630]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74630) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120', 0)] {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[569f6731-76e7-44d8-a75b-450b4584ee08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae230d97-7878-4a6f-9bb2-8769519a7fbd]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 (non-flash)\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 (non-flash)
Oct 26 04:25:17 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 (non-flash)
Oct 26 04:25:17 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f315c791f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120'): ({'sdb'}, set())}) {{(pid=74630) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Removing single pathed devices sdb {{(pid=74630) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c078394-2ed7-49cb-9244-f66ade6cfa45]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be8d972-107a-48b0-8d44-c4b3b58dbcbf]: (4, ('ok\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Flushing IO for device /dev/sdb {{(pid=74630) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ba038f-2470-4769-aec1-1fd0e3da4089]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74630) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97948b5-0f96-4086-b101-87542c201828]: (4, ('1', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.linuxscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] SCSI volumes sdb have been removed. {{(pid=74630) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120')] {{(pid=74630) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b43e4ec-3800-49a2-9a09-245d28084e53]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --logout {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f5f5ce-7d80-401d-ad77-9684fca322a1]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120, portal: 172.16.0.220,3260]
Oct 26 04:25:17 user nova-compute[74630]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120, portal: 172.16.0.220,3260] successful.
Oct 26 04:25:17 user nova-compute[74630]:  stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --op delete {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:25:17 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:25:17 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:25:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=24.867813110351562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d8c64d8-d802-4b65-8cf6-7594c0f27120 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86251) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e719a2-046c-48b9-aae1-5edd6d7af25f]: (4, ('', '')) {{(pid=86251) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74630) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.base [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.574s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] <== disconnect_volume: return (577ms) None {{(pid=74630) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Disconnected iSCSI Volume {{(pid=74630) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance a794673b-c12c-451a-a741-a734d229a795 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:25:17 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:25:18 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:25:18 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:25:18 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:25:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:25:18 user nova-compute[74630]: DEBUG nova.objects.instance [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lazy-loading 'flavor' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:25:18 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-c7b6e63d-f594-466c-b69d-40fb2eb63fd4 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.052s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:25:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:25:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:25:24 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:25:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:25:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:25:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:25:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:25:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:25:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:25:27 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:25:27 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:25:27 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating instance_info_cache with network_info: [{"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:25:27 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:25:27 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:25:29 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:25:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:25:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:25:38 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:25:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:25:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:25:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:25:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:26:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:26:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:26:14 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:26:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:16 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:26:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:26:19 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:26:19 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 04:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.processutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74630) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 04:26:19 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:26:19 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:26:19 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=8996MB free_disk=24.86691665649414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:26:19 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:26:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Instance a794673b-c12c-451a-a741-a734d229a795 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74630) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 04:26:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:26:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:26:20 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:26:20 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:26:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:26:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:26:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:26:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:26 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:26:29 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 04:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquired lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 04:26:29 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Forcefully refreshing network info cache for instance {{(pid=74630) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 04:26:29 user nova-compute[74630]: DEBUG nova.objects.instance [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lazy-loading 'info_cache' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:26:29 user nova-compute[74630]: DEBUG nova.network.neutron [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating instance_info_cache with network_info: [{"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:26:29 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Releasing lock "refresh_cache-a794673b-c12c-451a-a741-a734d229a795" {{(pid=74630) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 04:26:29 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] [instance: a794673b-c12c-451a-a741-a734d229a795] Updated the network info_cache for instance {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 04:26:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:26:31 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:26:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:26:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:26:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:26:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:26:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:26:55 user nova-compute[74630]: INFO nova.compute.manager [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Terminating instance
Oct 26 04:26:55 user nova-compute[74630]: DEBUG nova.compute.manager [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Start destroying the instance on the hypervisor. {{(pid=74630) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 04:26:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:55 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-bf4e9da7-6ce1-4b61-bde0-aab45281ba14 req-84dad2f5-28fb-4448-a5b6-c0a55ebe6c9b service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Received event network-vif-unplugged-1bf25c77-6063-499c-a108-969bcd5ef34f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:26:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bf4e9da7-6ce1-4b61-bde0-aab45281ba14 req-84dad2f5-28fb-4448-a5b6-c0a55ebe6c9b service nova] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:26:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bf4e9da7-6ce1-4b61-bde0-aab45281ba14 req-84dad2f5-28fb-4448-a5b6-c0a55ebe6c9b service nova] Lock "a794673b-c12c-451a-a741-a734d229a795-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:26:55 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-bf4e9da7-6ce1-4b61-bde0-aab45281ba14 req-84dad2f5-28fb-4448-a5b6-c0a55ebe6c9b service nova] Lock "a794673b-c12c-451a-a741-a734d229a795-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:26:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-bf4e9da7-6ce1-4b61-bde0-aab45281ba14 req-84dad2f5-28fb-4448-a5b6-c0a55ebe6c9b service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] No waiting events found dispatching network-vif-unplugged-1bf25c77-6063-499c-a108-969bcd5ef34f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:26:55 user nova-compute[74630]: DEBUG nova.compute.manager [req-bf4e9da7-6ce1-4b61-bde0-aab45281ba14 req-84dad2f5-28fb-4448-a5b6-c0a55ebe6c9b service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Received event network-vif-unplugged-1bf25c77-6063-499c-a108-969bcd5ef34f for instance with task_state deleting. {{(pid=74630) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:26:56 user nova-compute[74630]: INFO nova.virt.libvirt.driver [-] [instance: a794673b-c12c-451a-a741-a734d229a795] Instance destroyed successfully.
Oct 26 04:26:56 user nova-compute[74630]: DEBUG nova.objects.instance [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lazy-loading 'resources' on Instance uuid a794673b-c12c-451a-a741-a734d229a795 {{(pid=74630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG nova.virt.libvirt.vif [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T04:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-380078743',display_name='tempest-SnapshotDataIntegrityTests-server-380078743',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-380078743',id=53,image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuCxyICn2Giy100uPegS85k584+LNNI8zvC4T7eQZ+kpaXQa1VKd7UmJP5slbNk/n/o5J255CzSI88kzgtCl0pQak3qlomqOFUh15JBsh36uGaD1KboUidHg0PoCHP4DA==',key_name='tempest-keypair-1504687679',keypairs=<?>,launch_index=0,launched_at=2023-10-26T04:18:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9443689a30914a1293a8bacfa9439291',ramdisk_id='',reservation_id='r-g4pxmf5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8519fea8-ccda-4565-9023-82b90e4bb746',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1857579661',owner_user_name='tempest-SnapshotDataIntegrityTests-1857579661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T04:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='363358deec9d432499d1b0bd6866c7cc',uuid=a794673b-c12c-451a-a741-a734d229a795,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Converting VIF {"id": "1bf25c77-6063-499c-a108-969bcd5ef34f", "address": "fa:16:3e:a8:b7:21", "network": {"id": "438c12e1-5141-4603-8cbd-a8189e1d7060", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1366319243-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9443689a30914a1293a8bacfa9439291", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf25c77-60", "ovs_interfaceid": "1bf25c77-6063-499c-a108-969bcd5ef34f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG nova.network.os_vif_util [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:b7:21,bridge_name='br-int',has_traffic_filtering=True,id=1bf25c77-6063-499c-a108-969bcd5ef34f,network=Network(438c12e1-5141-4603-8cbd-a8189e1d7060),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf25c77-60') {{(pid=74630) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG os_vif [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:b7:21,bridge_name='br-int',has_traffic_filtering=True,id=1bf25c77-6063-499c-a108-969bcd5ef34f,network=Network(438c12e1-5141-4603-8cbd-a8189e1d7060),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf25c77-60') {{(pid=74630) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bf25c77-60, bridge=br-int, if_exists=True) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2187ada9-3cf8-4ec6-83d9-1c248408a748) {{(pid=74630) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:26:56 user nova-compute[74630]: INFO os_vif [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:b7:21,bridge_name='br-int',has_traffic_filtering=True,id=1bf25c77-6063-499c-a108-969bcd5ef34f,network=Network(438c12e1-5141-4603-8cbd-a8189e1d7060),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf25c77-60')
Oct 26 04:26:56 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Deleting instance files /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795_del
Oct 26 04:26:56 user nova-compute[74630]: INFO nova.virt.libvirt.driver [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Deletion of /opt/stack/data/nova/instances/a794673b-c12c-451a-a741-a734d229a795_del complete
Oct 26 04:26:56 user nova-compute[74630]: INFO nova.compute.manager [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] [instance: a794673b-c12c-451a-a741-a734d229a795] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 26 04:26:56 user nova-compute[74630]: DEBUG oslo.service.loopingcall [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74630) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG nova.compute.manager [-] [instance: a794673b-c12c-451a-a741-a734d229a795] Deallocating network for instance {{(pid=74630) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 04:26:56 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: a794673b-c12c-451a-a741-a734d229a795] deallocate_for_instance() {{(pid=74630) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 04:26:57 user nova-compute[74630]: DEBUG nova.network.neutron [-] [instance: a794673b-c12c-451a-a741-a734d229a795] Updating instance_info_cache with network_info: [] {{(pid=74630) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 04:26:57 user nova-compute[74630]: INFO nova.compute.manager [-] [instance: a794673b-c12c-451a-a741-a734d229a795] Took 0.98 seconds to deallocate network for instance.
Oct 26 04:26:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:26:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:26:57 user nova-compute[74630]: DEBUG nova.compute.manager [req-5334da0d-7fbd-457f-80b3-b349ee75a0c7 req-de833a3a-e95e-4fea-bbb5-5526fb8bcdec service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Received event network-vif-deleted-1bf25c77-6063-499c-a108-969bcd5ef34f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:26:57 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:26:57 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:26:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:26:57 user nova-compute[74630]: INFO nova.scheduler.client.report [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Deleted allocations for instance a794673b-c12c-451a-a741-a734d229a795
Oct 26 04:26:57 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-efb6144f-a4b6-41c5-aceb-6adf46b13d20 tempest-SnapshotDataIntegrityTests-1857579661 tempest-SnapshotDataIntegrityTests-1857579661-project-member] Lock "a794673b-c12c-451a-a741-a734d229a795" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.177s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:26:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-171a9a41-c9de-4da2-a165-0c46d39e3742 req-5c890669-849d-4ca4-9328-171bbb299345 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Received event network-vif-plugged-1bf25c77-6063-499c-a108-969bcd5ef34f {{(pid=74630) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 04:26:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-171a9a41-c9de-4da2-a165-0c46d39e3742 req-5c890669-849d-4ca4-9328-171bbb299345 service nova] Acquiring lock "a794673b-c12c-451a-a741-a734d229a795-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:26:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-171a9a41-c9de-4da2-a165-0c46d39e3742 req-5c890669-849d-4ca4-9328-171bbb299345 service nova] Lock "a794673b-c12c-451a-a741-a734d229a795-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:26:58 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [req-171a9a41-c9de-4da2-a165-0c46d39e3742 req-5c890669-849d-4ca4-9328-171bbb299345 service nova] Lock "a794673b-c12c-451a-a741-a734d229a795-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:26:58 user nova-compute[74630]: DEBUG nova.compute.manager [req-171a9a41-c9de-4da2-a165-0c46d39e3742 req-5c890669-849d-4ca4-9328-171bbb299345 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] No waiting events found dispatching network-vif-plugged-1bf25c77-6063-499c-a108-969bcd5ef34f {{(pid=74630) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 04:26:58 user nova-compute[74630]: WARNING nova.compute.manager [req-171a9a41-c9de-4da2-a165-0c46d39e3742 req-5c890669-849d-4ca4-9328-171bbb299345 service nova] [instance: a794673b-c12c-451a-a741-a734d229a795] Received unexpected event network-vif-plugged-1bf25c77-6063-499c-a108-969bcd5ef34f for instance with vm_state deleted and task_state None.
Oct 26 04:27:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:27:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:27:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:27:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:27:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:27:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:27:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:27:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:27:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:27:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:27:14 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:27:14 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:27:16 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:27:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:27:20 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:27:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Auditing locally available compute resources for user (node: user) {{(pid=74630) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 04:27:20 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:27:20 user nova-compute[74630]: WARNING nova.virt.libvirt.driver [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 04:27:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Hypervisor/Node resource view: name=user free_ram=9121MB free_disk=24.8941650390625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74630) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 04:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 04:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 04:27:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 04:27:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74630) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 04:27:20 user nova-compute[74630]: DEBUG nova.compute.provider_tree [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed in ProviderTree for provider: 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 {{(pid=74630) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 04:27:20 user nova-compute[74630]: DEBUG nova.scheduler.client.report [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Inventory has not changed for provider 2f1b6f01-11e1-40ee-9e9b-a22fe0de58d5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74630) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 04:27:20 user nova-compute[74630]: DEBUG nova.compute.resource_tracker [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Compute_service record updated for user:user {{(pid=74630) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 04:27:20 user nova-compute[74630]: DEBUG oslo_concurrency.lockutils [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=74630) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 04:27:21 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:27:21 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:27:21 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=74630) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 04:27:21 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:27:26 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:27:27 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:27:30 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:27:30 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Starting heal instance info cache {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 04:27:30 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Rebuilding the list of instances to heal {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 04:27:30 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Didn't find any instances for network info cache update. {{(pid=74630) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 04:27:31 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:27:32 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:27:34 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:27:36 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:27:38 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:27:38 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Cleaning up deleted instances {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 04:27:38 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] There are 0 instances to clean {{(pid=74630) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 04:27:39 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:27:41 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:27:46 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:27:49 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:27:51 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:27:52 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:27:56 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:28:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:28:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:28:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74630) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 04:28:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:28:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74630) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 04:28:01 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:28:02 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._sync_power_states {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:28:06 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:28:06 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 30 {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 04:28:08 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:28:11 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:28:16 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 04:28:16 user nova-compute[74630]: DEBUG nova.compute.manager [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74630) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 04:28:16 user nova-compute[74630]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74630) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 04:28:17 user nova-compute[74630]: DEBUG oslo_service.periodic_task [None req-5cd1d49f-162c-4c34-a4e5-66ef3e41df2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74630) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}